Jun 11 18:25:29.900208 ip-10-0-128-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 18:25:29.900219 ip-10-0-128-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 18:25:29.900242 ip-10-0-128-178 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 18:25:29.900463 ip-10-0-128-178 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 18:25:40.058904 ip-10-0-128-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 18:25:40.058923 ip-10-0-128-178 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 620646fea7614dae9b042420eb601c94 -- Jun 11 18:27:58.323775 ip-10-0-128-178 systemd[1]: Starting Kubernetes Kubelet... Jun 11 18:27:58.723448 ip-10-0-128-178 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:27:58.723448 ip-10-0-128-178 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 18:27:58.723448 ip-10-0-128-178 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:27:58.723448 ip-10-0-128-178 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 18:27:58.723448 ip-10-0-128-178 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:27:58.724909 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.724820 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 18:27:58.729980 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729966 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:27:58.729980 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729980 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729984 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729988 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729992 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729995 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.729998 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730001 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730004 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730006 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730009 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730012 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730015 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730018 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730022 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730026 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730028 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730031 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730034 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730041 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:27:58.730041 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730044 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730047 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730050 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730053 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730056 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730058 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730061 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730063 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730066 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730069 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730071 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730074 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730076 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730079 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730081 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730084 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730086 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730089 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730091 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730094 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:27:58.730504 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730096 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730101 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730104 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730107 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730110 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730112 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730116 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730118 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730121 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730123 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730126 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730129 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730132 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730135 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730139 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730142 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730144 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730147 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730149 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:27:58.731014 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730153 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730157 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730160 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730163 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730167 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730169 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730172 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730174 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730177 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730179 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730182 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730184 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730187 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730190 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730192 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730195 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730198 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730200 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730203 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730206 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:27:58.731481 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730208 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730211 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730213 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730216 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730218 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730221 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730223 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730227 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730230 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730232 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730235 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730237 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730240 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730242 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730245 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730248 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730250 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730252 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730255 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730257 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:27:58.731972 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730984 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730991 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730994 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.730997 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731000 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731004 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731006 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731009 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731012 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731014 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731017 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731020 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731022 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731025 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731028 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731030 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731033 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731035 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731038 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:27:58.732538 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731042 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731045 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731047 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731050 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731053 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731055 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731058 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731061 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731063 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731065 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731068 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731071 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731073 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731075 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731078 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731082 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731086 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731089 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731092 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:27:58.733018 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731096 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731098 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731101 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731104 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731106 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731109 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731111 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731113 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731116 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731118 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731121 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731123 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731126 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731130 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731133 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731135 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731138 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731140 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731143 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731145 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:27:58.733542 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731148 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731150 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731153 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731155 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731158 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731161 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731164 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731166 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731169 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731174 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731177 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731180 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731184 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731186 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731189 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731192 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731194 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731197 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731199 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731201 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:27:58.734035 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731204 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731206 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731209 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731211 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731214 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731217 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731220 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731223 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731225 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731228 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731231 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731233 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731236 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731238 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731240 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731243 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731245 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731248 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731250 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731253 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:27:58.734531 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731255 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731640 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731645 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731649 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731651 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731654 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731657 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731660 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731663 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731665 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731668 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731670 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731673 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731675 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731678 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731681 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731684 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731687 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731689 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731692 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:27:58.735020 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731695 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731697 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731700 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731702 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731705 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731709 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731713 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731715 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731718 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731721 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731724 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731726 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731729 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731732 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731734 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731738 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731741 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731743 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731746 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:27:58.735519 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731749 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731751 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731754 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731757 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731760 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731764 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731767 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731770 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731773 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731776 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731779 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731782 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731785 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731787 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731791 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731793 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731796 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731800 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731803 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:27:58.735991 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731805 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731808 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731810 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731812 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731815 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731817 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731820 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731822 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731825 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731827 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731830 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731832 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731834 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731837 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731840 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731842 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731844 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731847 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731849 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731852 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:27:58.736452 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731854 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731857 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731859 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731862 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731864 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731867 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731869 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731872 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731874 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731877 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731881 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731883 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731886 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731889 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731891 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731893 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731896 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731899 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731901 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731904 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:27:58.736948 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731906 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.731909 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.731982 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.731991 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732001 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732008 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732015 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732019 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732023 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732027 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732031 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732034 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732037 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732040 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732043 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732046 2576 flags.go:64] FLAG: --cgroup-root="" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732049 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732052 2576 flags.go:64] FLAG: --client-ca-file="" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732055 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732058 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732062 2576 flags.go:64] FLAG: --cluster-domain="" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732064 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732068 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732071 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 18:27:58.737443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732074 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732078 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732081 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732084 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732087 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732090 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732093 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732097 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732100 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732103 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732108 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732110 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732113 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732116 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732119 2576 flags.go:64] FLAG: --enable-server="true" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732123 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732127 2576 flags.go:64] FLAG: --event-burst="100" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732131 2576 flags.go:64] FLAG: --event-qps="50" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732133 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732136 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732139 2576 flags.go:64] FLAG: --eviction-hard="" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732143 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732149 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732152 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732155 2576 flags.go:64] FLAG: --eviction-soft="" Jun 11 18:27:58.738024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732158 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732161 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732164 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732167 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732170 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732173 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732176 2576 flags.go:64] FLAG: --feature-gates="" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732179 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732182 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732185 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732188 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732191 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732194 2576 flags.go:64] FLAG: --help="false" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732197 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-178.ec2.internal" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732200 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732203 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732206 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732209 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732212 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732215 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732218 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732221 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732224 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 18:27:58.738690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732227 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732230 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732233 2576 flags.go:64] FLAG: --kube-reserved="" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732236 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732239 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732242 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732246 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732249 2576 flags.go:64] FLAG: --lock-file="" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732252 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732255 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732257 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732263 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732265 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732268 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732271 2576 flags.go:64] FLAG: --logging-format="text" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732274 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732278 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732280 2576 flags.go:64] FLAG: --manifest-url="" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732283 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732287 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732290 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732295 2576 flags.go:64] FLAG: --max-pods="110" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732298 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732300 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732303 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 18:27:58.739264 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732306 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732309 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732312 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732315 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732326 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732329 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732332 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732335 2576 flags.go:64] FLAG: --pod-cidr="" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732339 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732344 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732347 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732350 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732353 2576 flags.go:64] FLAG: --port="10250" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732356 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732360 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2bbf8c48568ffcc" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732363 2576 flags.go:64] FLAG: --qos-reserved="" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732366 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732369 2576 flags.go:64] FLAG: --register-node="true" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732372 2576 flags.go:64] FLAG: --register-with-taints="" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732375 2576 flags.go:64] FLAG: --registry-burst="10" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732378 2576 flags.go:64] FLAG: --registry-qps="5" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732381 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732384 2576 flags.go:64] FLAG: --reserved-memory="" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732387 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732390 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 18:27:58.739882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732393 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732396 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732399 2576 flags.go:64] FLAG: --runonce="false" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732402 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732405 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732408 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732411 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732414 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732416 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732419 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732422 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732425 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732428 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732431 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732433 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732436 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732440 2576 flags.go:64] FLAG: --system-cgroups="" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732442 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732448 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732450 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732453 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732459 2576 flags.go:64] FLAG: --tls-min-version="" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732462 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732465 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732467 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 18:27:58.740499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732470 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732473 2576 flags.go:64] FLAG: --v="2" Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732477 2576 flags.go:64] FLAG: --version="false" Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732482 2576 flags.go:64] FLAG: --vmodule="" Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732497 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.732500 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732615 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732618 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732622 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732625 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732627 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732630 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732633 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732635 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732638 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732642 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732646 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732649 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732652 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732655 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:27:58.741115 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732657 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732660 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732662 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732665 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732668 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732671 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732673 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732676 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732680 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732683 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732685 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732688 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732690 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732693 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732695 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732699 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732702 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732705 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732708 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732710 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:27:58.741729 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732713 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732716 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732718 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732721 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732723 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732726 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732729 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732731 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732734 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732736 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732739 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732742 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732744 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732747 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732749 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732752 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732754 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732757 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732760 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732762 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:27:58.742480 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732766 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732768 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732771 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732773 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732776 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732779 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732781 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732785 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732788 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732790 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732793 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732795 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732798 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732801 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732803 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732806 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732808 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732811 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732814 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732816 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:27:58.743236 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732819 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732821 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732824 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732826 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732829 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732832 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732834 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732836 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732839 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732841 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732844 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732847 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732851 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732855 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732858 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732861 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732864 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732867 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732869 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732873 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:27:58.743748 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732876 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732880 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732883 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732886 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.732889 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.733643 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.740201 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.740216 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.740237 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.740244 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740307 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740313 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740316 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740319 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:27:58.744243 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740321 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740324 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740328 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740332 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740335 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740337 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740340 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740343 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740345 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740348 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740351 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740353 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740356 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740359 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740361 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740364 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740366 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740369 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740371 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740374 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:27:58.744636 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740376 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740379 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740382 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740385 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740387 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740396 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740399 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740402 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740405 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740408 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740410 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740413 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740415 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740418 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740420 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740423 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740425 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740428 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740431 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:27:58.745132 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740433 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740436 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740438 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740441 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740444 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740446 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740449 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740452 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740455 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740457 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740460 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740462 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740465 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740467 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740470 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740472 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740475 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740477 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740480 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740504 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:27:58.745669 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740508 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740511 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740514 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740517 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740519 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740522 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740524 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740527 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740530 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740532 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740535 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740538 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740540 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740543 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740545 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740548 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740551 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740553 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740556 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:27:58.746158 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740558 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740562 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740566 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740569 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740572 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740574 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740577 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740579 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740582 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740584 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740587 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740591 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740594 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740603 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740605 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740608 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:27:58.746627 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740611 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.740616 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740758 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740763 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740766 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740769 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740772 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740791 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740795 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740798 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740801 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740803 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740806 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740809 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740811 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:27:58.747019 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740814 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740816 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740819 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740821 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740824 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740826 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740829 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740831 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740834 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740836 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740839 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740841 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740850 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740853 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740856 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740863 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740866 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740869 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740871 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740874 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:27:58.747389 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740876 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740879 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740881 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740884 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740887 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740889 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740892 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740894 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740896 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740899 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740902 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740904 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740907 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740909 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740912 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740914 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740917 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740919 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740922 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:27:58.747885 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740926 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740930 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740932 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740935 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740938 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740940 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740943 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740945 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740948 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740956 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740959 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740961 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740964 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740966 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740969 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740971 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740974 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740976 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740979 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740981 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740984 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:27:58.748351 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740986 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740989 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740991 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740994 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740996 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.740999 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741001 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741004 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741006 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741009 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741012 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741015 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741018 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741021 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741024 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741028 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741032 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741035 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741037 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:27:58.748868 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741039 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741042 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741050 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741052 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741055 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741057 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:58.741060 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.741065 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.741184 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.746039 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.747676 2576 server.go:1019] "Starting client certificate rotation" Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.747771 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:27:58.749358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.747808 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:27:58.750318 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.750304 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:27:58.752385 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.752366 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:27:58.764106 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.764090 2576 log.go:25] "Validated CRI v1 runtime API" Jun 11 18:27:58.766733 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.766719 2576 log.go:25] "Validated CRI v1 image API" Jun 11 18:27:58.768174 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.768156 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 18:27:58.770787 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.770766 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94cc8b56-040e-40a9-abb8-e925b8a6da87:/dev/nvme0n1p4 bf797e53-9f05-4d45-8fed-ba29baff6701:/dev/nvme0n1p3] Jun 11 18:27:58.770873 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.770785 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 18:27:58.777572 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.777449 2576 manager.go:216] Machine: {Timestamp:2026-06-11 18:27:58.776143502 +0000 UTC m=+0.338340119 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105340 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2289f2038245f3482986186596ecf4 SystemUUID:ec2289f2-0382-45f3-4829-86186596ecf4 BootID:620646fe-a761-4dae-9b04-2420eb601c94 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:7e:ac:e8:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:7e:ac:e8:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:8f:e3:56:bd:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 18:27:58.777572 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.777564 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 18:27:58.777703 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.777648 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 18:27:58.777703 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.777682 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:27:58.780420 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.780393 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 18:27:58.780570 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.780422 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 18:27:58.781066 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.781056 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 18:27:58.781100 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.781068 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 18:27:58.781100 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.781075 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:27:58.781756 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.781745 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:27:58.782831 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.782822 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 18:27:58.785290 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785279 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:27:58.785415 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785406 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 18:27:58.785462 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785435 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 11 18:27:58.785462 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785445 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 18:27:58.785462 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785458 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 18:27:58.785595 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785469 2576 kubelet.go:398] "Adding apiserver pod source" Jun 11 18:27:58.785595 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785483 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 18:27:58.785914 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785902 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:27:58.785949 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.785921 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:27:58.788671 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.788657 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 18:27:58.791622 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.791540 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 18:27:58.791622 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.791597 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 18:27:58.793325 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793309 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793329 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793336 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793341 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793350 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793356 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793365 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793371 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793377 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 18:27:58.793388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793383 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 18:27:58.793700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793400 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 18:27:58.793700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793406 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 18:27:58.793700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793431 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 18:27:58.793700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.793437 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 18:27:58.796788 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.796774 2576 server.go:1268] "Started kubelet" Jun 11 18:27:58.796863 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.796789 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 18:27:58.796863 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.796785 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 18:27:58.796951 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.796867 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 18:27:58.796951 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.796896 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 18:27:58.796951 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.796882 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 18:27:58.796951 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.796949 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 18:27:58.797635 ip-10-0-128-178 systemd[1]: Started Kubernetes Kubelet. Jun 11 18:27:58.799284 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.799272 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 11 18:27:58.801079 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.801063 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 18:27:58.803723 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.803706 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 18:27:58.804328 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804307 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 18:27:58.804328 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804316 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 18:27:58.804468 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.804412 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:58.804636 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.803530 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18b81a379db9d03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-06-11 18:27:58.796755003 +0000 UTC m=+0.358951598,LastTimestamp:2026-06-11 18:27:58.796755003 +0000 UTC m=+0.358951598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}" Jun 11 18:27:58.804854 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804836 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 18:27:58.804922 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804857 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 18:27:58.804922 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804837 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 18:27:58.805010 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804987 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 11 18:27:58.805010 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.804995 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.805652 2576 factory.go:55] Registering systemd factory Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.805671 2576 factory.go:223] Registration of the systemd container factory successfully Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.806025 2576 factory.go:153] Registering CRI-O factory Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.806042 2576 factory.go:223] Registration of the crio container factory successfully Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.806112 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.806136 2576 factory.go:103] Registering Raw factory Jun 11 18:27:58.806191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.806150 2576 manager.go:1196] Started watching for new ooms in manager Jun 11 18:27:58.806673 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.806652 2576 manager.go:349] Starting recovery of all containers Jun 11 18:27:58.811351 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.811187 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 18:27:58.811351 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.811218 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 18:27:58.817080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.817060 2576 manager.go:354] Recovery completed Jun 11 18:27:58.823050 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.823037 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.824909 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.824891 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.824971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.824922 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.824971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.824932 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.825458 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.825439 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 18:27:58.825564 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.825461 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.825564 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.825455 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 18:27:58.825564 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.825482 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:27:58.826191 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.826176 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.826262 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.826200 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.826262 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.826209 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.826805 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.826795 2576 policy_none.go:49] "None policy: Start" Jun 11 18:27:58.826850 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.826812 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 18:27:58.826850 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.826827 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 18:27:58.827051 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.826960 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18b81a379f67695c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-06-11 18:27:58.824909148 +0000 UTC m=+0.387105746,LastTimestamp:2026-06-11 18:27:58.824909148 +0000 UTC m=+0.387105746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}" Jun 11 18:27:58.827764 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.827750 2576 policy_none.go:47] "Start" Jun 11 18:27:58.828704 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.828687 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xzdt9" Jun 11 18:27:58.835806 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.835729 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18b81a379f67adc2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-06-11 18:27:58.824926658 +0000 UTC m=+0.387123253,LastTimestamp:2026-06-11 18:27:58.824926658 +0000 UTC m=+0.387123253,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}" Jun 11 18:27:58.836624 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.836609 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xzdt9" Jun 11 18:27:58.837464 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.837410 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-178.ec2.internal.18b81a379f67d2ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-178.ec2.internal,UID:ip-10-0-128-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-178.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-178.ec2.internal,},FirstTimestamp:2026-06-11 18:27:58.824936191 +0000 UTC m=+0.387132786,LastTimestamp:2026-06-11 18:27:58.824936191 +0000 UTC m=+0.387132786,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-178.ec2.internal,}" Jun 11 18:27:58.861237 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861223 2576 manager.go:337] "Starting Device Plugin manager" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.861255 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861266 2576 server.go:87] "Starting device plugin registration server" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861544 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861556 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861638 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861719 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.861728 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.862283 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.862334 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.871662 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.872855 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.872887 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.872906 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 18:27:58.874080 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.872936 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 18:27:58.875005 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.874987 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:27:58.962267 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.962227 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.963410 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.963391 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.963549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.963427 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.963549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.963440 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.963549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.963471 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-178.ec2.internal" Jun 11 18:27:58.972408 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.972387 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-178.ec2.internal" Jun 11 18:27:58.972477 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.972411 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-178.ec2.internal\": node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:58.973640 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.973591 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal"] Jun 11 18:27:58.973685 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.973648 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.974434 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.974419 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.974480 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.974451 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.974480 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.974465 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.975659 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.975645 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.975774 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.975761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:58.975816 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.975796 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.976353 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.976336 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.976419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.976354 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.976419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.976369 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.976419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.976375 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.976419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.976383 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.976419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.976387 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.977451 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.977434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jun 11 18:27:58.977534 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.977469 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:27:58.978118 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.978102 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:27:58.978192 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.978130 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:27:58.978192 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:58.978140 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:27:58.995069 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.995047 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-178.ec2.internal\" not found" node="ip-10-0-128-178.ec2.internal" Jun 11 18:27:58.995174 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.995105 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:58.998338 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:58.998322 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-178.ec2.internal\" not found" node="ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.095662 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.095625 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.105963 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.105943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42c5d8240a4f821dcf0edd49b0ba0c1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"42c5d8240a4f821dcf0edd49b0ba0c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.106066 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.105978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c5d8240a4f821dcf0edd49b0ba0c1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"42c5d8240a4f821dcf0edd49b0ba0c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.106066 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.105996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53d466c74d7f99aaa0cbb6d6a61f99f9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"53d466c74d7f99aaa0cbb6d6a61f99f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.196096 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.196069 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.206352 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.206326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53d466c74d7f99aaa0cbb6d6a61f99f9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"53d466c74d7f99aaa0cbb6d6a61f99f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.206419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.206361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42c5d8240a4f821dcf0edd49b0ba0c1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"42c5d8240a4f821dcf0edd49b0ba0c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.206419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.206379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c5d8240a4f821dcf0edd49b0ba0c1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"42c5d8240a4f821dcf0edd49b0ba0c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.206524 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.206428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53d466c74d7f99aaa0cbb6d6a61f99f9-config\") pod \"kube-apiserver-proxy-ip-10-0-128-178.ec2.internal\" (UID: \"53d466c74d7f99aaa0cbb6d6a61f99f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.206524 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.206423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42c5d8240a4f821dcf0edd49b0ba0c1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"42c5d8240a4f821dcf0edd49b0ba0c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.206611 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.206526 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42c5d8240a4f821dcf0edd49b0ba0c1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal\" (UID: \"42c5d8240a4f821dcf0edd49b0ba0c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.296833 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.296760 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.296833 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.296779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.301728 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.301714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.397673 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.397641 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.498187 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.498149 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.598720 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.598634 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.699254 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.699222 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.742680 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.742652 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:27:59.746781 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.746760 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 18:27:59.746889 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.746872 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:27:59.746927 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.746899 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:27:59.782704 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:59.782656 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d466c74d7f99aaa0cbb6d6a61f99f9.slice/crio-d69ed4f506910ddd4e9d78a0164d738833a0183c70c5c99169e4e1147ddb81d0 WatchSource:0}: Error finding container d69ed4f506910ddd4e9d78a0164d738833a0183c70c5c99169e4e1147ddb81d0: Status 404 returned error can't find the container with id d69ed4f506910ddd4e9d78a0164d738833a0183c70c5c99169e4e1147ddb81d0 Jun 11 18:27:59.782934 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:27:59.782905 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c5d8240a4f821dcf0edd49b0ba0c1a.slice/crio-3866989ea43324d7063a58efd824d7b34aee69a44588859d7190a12709d22586 WatchSource:0}: Error finding container 3866989ea43324d7063a58efd824d7b34aee69a44588859d7190a12709d22586: Status 404 returned error can't find the container with id 3866989ea43324d7063a58efd824d7b34aee69a44588859d7190a12709d22586 Jun 11 18:27:59.788899 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.788882 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:27:59.799400 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:27:59.799380 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-178.ec2.internal\" not found" Jun 11 18:27:59.800226 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.800209 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:27:59.804420 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.804405 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 18:27:59.804525 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.804464 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.817208 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.817184 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:27:59.819632 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.819617 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:27:59.820551 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.820538 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" Jun 11 18:27:59.827568 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.827556 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:27:59.840757 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.840701 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 18:22:58 +0000 UTC" deadline="2028-02-25 02:52:48.073308622 +0000 UTC" Jun 11 18:27:59.840757 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.840754 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14960h24m48.232557883s" Jun 11 18:27:59.843807 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.843793 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kkfll" Jun 11 18:27:59.851571 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.851527 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kkfll" Jun 11 18:27:59.877228 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.877177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" event={"ID":"53d466c74d7f99aaa0cbb6d6a61f99f9","Type":"ContainerStarted","Data":"d69ed4f506910ddd4e9d78a0164d738833a0183c70c5c99169e4e1147ddb81d0"} Jun 11 18:27:59.878219 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:27:59.878200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"42c5d8240a4f821dcf0edd49b0ba0c1a","Type":"ContainerStarted","Data":"3866989ea43324d7063a58efd824d7b34aee69a44588859d7190a12709d22586"} Jun 11 18:28:00.409732 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.409702 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:00.787056 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.786972 2576 apiserver.go:52] "Watching apiserver" Jun 11 18:28:00.795558 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.795531 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 18:28:00.796043 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.796011 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-gk72q","openshift-multus/multus-additional-cni-plugins-qlgj4","openshift-multus/multus-z25c4","openshift-multus/network-metrics-daemon-8hpjf","openshift-network-diagnostics/network-check-target-vzm4r","kube-system/konnectivity-agent-2g66n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn","openshift-image-registry/node-ca-5wgjq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal","openshift-network-operator/iptables-alerter-8p25q","openshift-ovn-kubernetes/ovnkube-node-xkzp6","kube-system/global-pull-secret-syncer-8jxc4","kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nchkq"] Jun 11 18:28:00.797627 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.797607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.798650 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.798626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:00.798752 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.798733 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:00.799690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.799670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.800353 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.800207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 18:28:00.800353 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.800221 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8855z\"" Jun 11 18:28:00.800509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.800380 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.800509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.800425 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.801611 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.801592 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 18:28:00.801967 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.801945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 18:28:00.802056 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.801998 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.802169 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.802153 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.802287 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.802266 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xnbw2\"" Jun 11 18:28:00.802455 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.802441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:00.802543 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.802524 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:00.803575 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.803457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.804646 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.804628 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.805359 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.805338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hrbfz\"" Jun 11 18:28:00.805550 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.805532 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 18:28:00.805660 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.805643 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 18:28:00.805849 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.805827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.806544 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.806523 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.806639 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.806606 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.806833 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.806813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-649f5\"" Jun 11 18:28:00.807280 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.807261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:00.808154 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.807808 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 18:28:00.808154 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.807820 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cz6x6\"" Jun 11 18:28:00.808154 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.808051 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 18:28:00.809034 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.809013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.809414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.809392 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 18:28:00.809938 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.809780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4vgsk\"" Jun 11 18:28:00.810033 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.809963 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.810127 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.810111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.811585 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.811564 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.811747 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.811730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:00.811926 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.811812 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:00.812249 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.812231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f294x\"" Jun 11 18:28:00.812776 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.812742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc7b581b-f379-4d02-8a13-69f7b2307575-agent-certs\") pod \"konnectivity-agent-2g66n\" (UID: \"dc7b581b-f379-4d02-8a13-69f7b2307575\") " pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.812860 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.812824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc7b581b-f379-4d02-8a13-69f7b2307575-konnectivity-ca\") pod \"konnectivity-agent-2g66n\" (UID: \"dc7b581b-f379-4d02-8a13-69f7b2307575\") " pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.812912 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.812859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.812912 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.812904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:00.813006 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.812972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk4nf\" (UniqueName: \"kubernetes.io/projected/3e0e60f3-65ad-4766-bc3a-119af36da44e-kube-api-access-bk4nf\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.813074 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.813146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-netns\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.813214 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-cni-multus\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.813266 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-conf-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.813520 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-cnibin\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.813592 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0e60f3-65ad-4766-bc3a-119af36da44e-tmp-dir\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.813592 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-sys-fs\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.813691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-multus-certs\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.813691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-os-release\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.813691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-cni-binary-copy\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.813832 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-socket-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.813832 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-cnibin\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.813832 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-socket-dir-parent\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.813832 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-k8s-cni-cncf-io\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813830 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-cni-bin\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r4fl\" (UniqueName: \"kubernetes.io/projected/e406224b-967b-450f-8936-41d854d09815-kube-api-access-8r4fl\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfd2d\" (UniqueName: \"kubernetes.io/projected/81e97285-de0c-40d4-8a68-fa7c2408b535-kube-api-access-jfd2d\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.813971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjttg\" (UniqueName: \"kubernetes.io/projected/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-kube-api-access-vjttg\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814014 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwgp8\" (UniqueName: \"kubernetes.io/projected/37349a6b-2cc5-494d-a734-0efa01e7aa61-kube-api-access-kwgp8\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e0e60f3-65ad-4766-bc3a-119af36da44e-hosts-file\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-registration-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-etc-selinux\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-cni-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-system-cni-dir\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-device-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-system-cni-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814332 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-os-release\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-cni-binary-copy\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-daemon-config\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-etc-kubernetes\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814479 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-kubelet\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.814952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.814566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-hostroot\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.816794 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.816776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.817250 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.817230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:00.817697 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.816511 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 18:28:00.819563 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.819542 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.819657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.819585 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.819843 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.819824 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nlxbl\"" Jun 11 18:28:00.819906 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.819882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 18:28:00.820108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.820089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9p2lk\"" Jun 11 18:28:00.820419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.820403 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 18:28:00.821006 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.820988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 18:28:00.853435 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.853406 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:22:59 +0000 UTC" deadline="2027-11-21 11:46:23.256087394 +0000 UTC" Jun 11 18:28:00.853540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.853442 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12665h18m22.40265308s" Jun 11 18:28:00.905644 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.905618 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 18:28:00.915359 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.915479 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-node-log\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.915479 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-cni-bin\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.915479 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-kubernetes\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.915479 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysctl-conf\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-sys\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-host\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-device-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-system-cni-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-os-release\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.915691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-os-release\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-system-cni-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-var-lib-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.915729 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-device-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-run\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.915834 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:01.415787181 +0000 UTC m=+2.977983783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-kubelet\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-kubelet\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-hostroot\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc7b581b-f379-4d02-8a13-69f7b2307575-agent-certs\") pod \"konnectivity-agent-2g66n\" (UID: \"dc7b581b-f379-4d02-8a13-69f7b2307575\") " pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc7b581b-f379-4d02-8a13-69f7b2307575-konnectivity-ca\") pod \"konnectivity-agent-2g66n\" (UID: \"dc7b581b-f379-4d02-8a13-69f7b2307575\") " pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.916007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.915991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-cni-netd\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f43e5b98-7fb5-4094-950f-f705d3553b90-ovn-node-metrics-cert\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-netns\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-hostroot\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-cnibin\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-os-release\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-netns\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-cnibin\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-env-overrides\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-kubelet-config\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-os-release\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-socket-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-cnibin\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-slash\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.916689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-run-netns\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-socket-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916401 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916424 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-cnibin\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-k8s-cni-cncf-io\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-k8s-cni-cncf-io\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdj67\" (UniqueName: \"kubernetes.io/projected/f49be2b5-1336-46d9-bd76-da52c2e8029f-kube-api-access-kdj67\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r4fl\" (UniqueName: \"kubernetes.io/projected/e406224b-967b-450f-8936-41d854d09815-kube-api-access-8r4fl\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfd2d\" (UniqueName: \"kubernetes.io/projected/81e97285-de0c-40d4-8a68-fa7c2408b535-kube-api-access-jfd2d\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwgp8\" (UniqueName: \"kubernetes.io/projected/37349a6b-2cc5-494d-a734-0efa01e7aa61-kube-api-access-kwgp8\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-modprobe-d\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysconfig\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dc7b581b-f379-4d02-8a13-69f7b2307575-konnectivity-ca\") pod \"konnectivity-agent-2g66n\" (UID: \"dc7b581b-f379-4d02-8a13-69f7b2307575\") " pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e0e60f3-65ad-4766-bc3a-119af36da44e-hosts-file\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.917509 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-registration-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-cni-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-registration-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-system-cni-dir\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.916993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-cni-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-systemd\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37349a6b-2cc5-494d-a734-0efa01e7aa61-system-cni-dir\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-tuned\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f19f85d6-05a8-4de9-bf42-ba230417e665-serviceca\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e0e60f3-65ad-4766-bc3a-119af36da44e-hosts-file\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-cni-binary-copy\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-daemon-config\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-etc-kubernetes\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-systemd-units\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-ovnkube-script-lib\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-etc-kubernetes\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.918295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhbhg\" (UniqueName: \"kubernetes.io/projected/f43e5b98-7fb5-4094-950f-f705d3553b90-kube-api-access-dhbhg\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-tmp\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-kubelet\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-etc-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk4nf\" (UniqueName: \"kubernetes.io/projected/3e0e60f3-65ad-4766-bc3a-119af36da44e-kube-api-access-bk4nf\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-cni-multus\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-conf-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-cni-binary-copy\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-var-lib-kubelet\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0e60f3-65ad-4766-bc3a-119af36da44e-tmp-dir\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-sys-fs\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.917978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-daemon-config\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918018 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-cni-multus\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-multus-certs\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-sys-fs\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.919156 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-cni-binary-copy\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-systemd\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-ovnkube-config\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e0e60f3-65ad-4766-bc3a-119af36da44e-tmp-dir\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-run-multus-certs\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f49be2b5-1336-46d9-bd76-da52c2e8029f-host-slash\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-conf-dir\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f49be2b5-1336-46d9-bd76-da52c2e8029f-iptables-alerter-script\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-socket-dir-parent\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-cni-bin\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-multus-socket-dir-parent\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-log-socket\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-host-var-lib-cni-bin\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-dbus\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrj7\" (UniqueName: \"kubernetes.io/projected/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-kube-api-access-vlrj7\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v447h\" (UniqueName: \"kubernetes.io/projected/f19f85d6-05a8-4de9-bf42-ba230417e665-kube-api-access-v447h\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:00.919971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjttg\" (UniqueName: \"kubernetes.io/projected/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-kube-api-access-vjttg\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-ovn\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysctl-d\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37349a6b-2cc5-494d-a734-0efa01e7aa61-cni-binary-copy\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-lib-modules\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f19f85d6-05a8-4de9-bf42-ba230417e665-host\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-etc-selinux\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.918959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e406224b-967b-450f-8936-41d854d09815-etc-selinux\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.920791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.920031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dc7b581b-f379-4d02-8a13-69f7b2307575-agent-certs\") pod \"konnectivity-agent-2g66n\" (UID: \"dc7b581b-f379-4d02-8a13-69f7b2307575\") " pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:00.927431 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.927379 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:00.927431 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.927407 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:00.927431 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.927420 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:00.927659 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:00.927478 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:28:01.427458219 +0000 UTC m=+2.989654826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:00.929752 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.929727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk4nf\" (UniqueName: \"kubernetes.io/projected/3e0e60f3-65ad-4766-bc3a-119af36da44e-kube-api-access-bk4nf\") pod \"node-resolver-gk72q\" (UID: \"3e0e60f3-65ad-4766-bc3a-119af36da44e\") " pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:00.930568 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.930278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfd2d\" (UniqueName: \"kubernetes.io/projected/81e97285-de0c-40d4-8a68-fa7c2408b535-kube-api-access-jfd2d\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:00.930568 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.930430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjttg\" (UniqueName: \"kubernetes.io/projected/604c7605-88f9-43d0-b9d3-3cb68fc1b71b-kube-api-access-vjttg\") pod \"multus-z25c4\" (UID: \"604c7605-88f9-43d0-b9d3-3cb68fc1b71b\") " pod="openshift-multus/multus-z25c4" Jun 11 18:28:00.930568 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.930515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r4fl\" (UniqueName: \"kubernetes.io/projected/e406224b-967b-450f-8936-41d854d09815-kube-api-access-8r4fl\") pod \"aws-ebs-csi-driver-node-wz9bn\" (UID: \"e406224b-967b-450f-8936-41d854d09815\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:00.931379 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:00.931186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwgp8\" (UniqueName: \"kubernetes.io/projected/37349a6b-2cc5-494d-a734-0efa01e7aa61-kube-api-access-kwgp8\") pod \"multus-additional-cni-plugins-qlgj4\" (UID: \"37349a6b-2cc5-494d-a734-0efa01e7aa61\") " pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:01.019135 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-slash\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019135 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-run-netns\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdj67\" (UniqueName: \"kubernetes.io/projected/f49be2b5-1336-46d9-bd76-da52c2e8029f-kube-api-access-kdj67\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-modprobe-d\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysconfig\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-run-netns\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-systemd\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-slash\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019302 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysconfig\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.019304 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-modprobe-d\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-systemd\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.019382 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:28:01.519362094 +0000 UTC m=+3.081558677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-tuned\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f19f85d6-05a8-4de9-bf42-ba230417e665-serviceca\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-systemd-units\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-ovnkube-script-lib\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhbhg\" (UniqueName: \"kubernetes.io/projected/f43e5b98-7fb5-4094-950f-f705d3553b90-kube-api-access-dhbhg\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-tmp\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-systemd-units\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-kubelet\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-etc-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-etc-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-kubelet\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-var-lib-kubelet\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-systemd\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-ovnkube-config\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-var-lib-kubelet\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.019907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f49be2b5-1336-46d9-bd76-da52c2e8029f-host-slash\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f49be2b5-1336-46d9-bd76-da52c2e8029f-iptables-alerter-script\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f19f85d6-05a8-4de9-bf42-ba230417e665-serviceca\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f49be2b5-1336-46d9-bd76-da52c2e8029f-host-slash\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-log-socket\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-systemd\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-dbus\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrj7\" (UniqueName: \"kubernetes.io/projected/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-kube-api-access-vlrj7\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.019991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v447h\" (UniqueName: \"kubernetes.io/projected/f19f85d6-05a8-4de9-bf42-ba230417e665-kube-api-access-v447h\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-ovn\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysctl-d\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-lib-modules\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f19f85d6-05a8-4de9-bf42-ba230417e665-host\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-dbus\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-node-log\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-node-log\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.020744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-ovnkube-script-lib\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysctl-d\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-lib-modules\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-log-socket\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f19f85d6-05a8-4de9-bf42-ba230417e665-host\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020586 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-cni-bin\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-cni-bin\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f49be2b5-1336-46d9-bd76-da52c2e8029f-iptables-alerter-script\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-run-ovn\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-kubernetes\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysctl-conf\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-sys\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-host\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-kubernetes\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-var-lib-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-sys\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-run\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.021657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-cni-netd\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-sysctl-conf\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-var-lib-openvswitch\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.020987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-host\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-run\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-cni-netd\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-ovnkube-config\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f43e5b98-7fb5-4094-950f-f705d3553b90-ovn-node-metrics-cert\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-env-overrides\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-kubelet-config\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f43e5b98-7fb5-4094-950f-f705d3553b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021277 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-kubelet-config\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.021593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f43e5b98-7fb5-4094-950f-f705d3553b90-env-overrides\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.022444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.022146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-etc-tuned\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.023211 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.023005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-tmp\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.023318 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.023297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f43e5b98-7fb5-4094-950f-f705d3553b90-ovn-node-metrics-cert\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.031344 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.031318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdj67\" (UniqueName: \"kubernetes.io/projected/f49be2b5-1336-46d9-bd76-da52c2e8029f-kube-api-access-kdj67\") pod \"iptables-alerter-8p25q\" (UID: \"f49be2b5-1336-46d9-bd76-da52c2e8029f\") " pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.031764 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.031733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhbhg\" (UniqueName: \"kubernetes.io/projected/f43e5b98-7fb5-4094-950f-f705d3553b90-kube-api-access-dhbhg\") pod \"ovnkube-node-xkzp6\" (UID: \"f43e5b98-7fb5-4094-950f-f705d3553b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.032027 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.032004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v447h\" (UniqueName: \"kubernetes.io/projected/f19f85d6-05a8-4de9-bf42-ba230417e665-kube-api-access-v447h\") pod \"node-ca-5wgjq\" (UID: \"f19f85d6-05a8-4de9-bf42-ba230417e665\") " pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.032118 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.032081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrj7\" (UniqueName: \"kubernetes.io/projected/82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f-kube-api-access-vlrj7\") pod \"tuned-nchkq\" (UID: \"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f\") " pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.113201 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.113117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" Jun 11 18:28:01.118958 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.118935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z25c4" Jun 11 18:28:01.126273 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.126253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:01.133807 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.133784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gk72q" Jun 11 18:28:01.141255 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.141232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" Jun 11 18:28:01.149750 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.149718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8p25q" Jun 11 18:28:01.157339 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.157323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:01.164838 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.164821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nchkq" Jun 11 18:28:01.171230 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.171213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5wgjq" Jun 11 18:28:01.256386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.256355 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:01.423386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.423290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:01.423533 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.423426 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:01.423533 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.423502 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:02.423473666 +0000 UTC m=+3.985670253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:01.523889 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.523857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:01.524043 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.523898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:01.524043 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.524009 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:01.524043 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.524019 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:01.524043 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.524043 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:01.524166 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.524055 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:01.524166 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.524061 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:28:02.524048775 +0000 UTC m=+4.086245357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:01.524166 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.524097 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:28:02.524086129 +0000 UTC m=+4.086282735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:01.843872 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.843833 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604c7605_88f9_43d0_b9d3_3cb68fc1b71b.slice/crio-e244b43795c66f04e20e9d117d381e0c89b502dc0404b1c644cda9140b7b0583 WatchSource:0}: Error finding container e244b43795c66f04e20e9d117d381e0c89b502dc0404b1c644cda9140b7b0583: Status 404 returned error can't find the container with id e244b43795c66f04e20e9d117d381e0c89b502dc0404b1c644cda9140b7b0583 Jun 11 18:28:01.845705 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.845624 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7b581b_f379_4d02_8a13_69f7b2307575.slice/crio-71353befe565a3b69a5876749433b1db73442b9a40efb0e9ca48824caaa0ff4a WatchSource:0}: Error finding container 71353befe565a3b69a5876749433b1db73442b9a40efb0e9ca48824caaa0ff4a: Status 404 returned error can't find the container with id 71353befe565a3b69a5876749433b1db73442b9a40efb0e9ca48824caaa0ff4a Jun 11 18:28:01.848941 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.848909 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82aa3c22_8a92_4e24_9ba8_f0f8bbaba11f.slice/crio-9f6096270a2dd7d07f5de1fa8130e83b7d4c9ee0430ff228755cca3255b82363 WatchSource:0}: Error finding container 9f6096270a2dd7d07f5de1fa8130e83b7d4c9ee0430ff228755cca3255b82363: Status 404 returned error can't find the container with id 9f6096270a2dd7d07f5de1fa8130e83b7d4c9ee0430ff228755cca3255b82363 Jun 11 18:28:01.849724 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.849707 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19f85d6_05a8_4de9_bf42_ba230417e665.slice/crio-7bbac26bd1bf5e4b4ce466692ab34a9e8ab5ed1630b3ed0d2a4dff52c9147509 WatchSource:0}: Error finding container 7bbac26bd1bf5e4b4ce466692ab34a9e8ab5ed1630b3ed0d2a4dff52c9147509: Status 404 returned error can't find the container with id 7bbac26bd1bf5e4b4ce466692ab34a9e8ab5ed1630b3ed0d2a4dff52c9147509 Jun 11 18:28:01.851011 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.850988 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37349a6b_2cc5_494d_a734_0efa01e7aa61.slice/crio-dd8a4e85c86861695ecb48d95b99238d6e14b6e42be088eaeb97f329be4e4ecc WatchSource:0}: Error finding container dd8a4e85c86861695ecb48d95b99238d6e14b6e42be088eaeb97f329be4e4ecc: Status 404 returned error can't find the container with id dd8a4e85c86861695ecb48d95b99238d6e14b6e42be088eaeb97f329be4e4ecc Jun 11 18:28:01.852177 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.852069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode406224b_967b_450f_8936_41d854d09815.slice/crio-9f64a43f19d3335a1fe0d90a5b9c4f81cb7a4d88a69176fe6a7a7949247e4954 WatchSource:0}: Error finding container 9f64a43f19d3335a1fe0d90a5b9c4f81cb7a4d88a69176fe6a7a7949247e4954: Status 404 returned error can't find the container with id 9f64a43f19d3335a1fe0d90a5b9c4f81cb7a4d88a69176fe6a7a7949247e4954 Jun 11 18:28:01.852914 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.852891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43e5b98_7fb5_4094_950f_f705d3553b90.slice/crio-f99f4104cec260c3f0b289f3d40ee20bcdca6ab39cd048e1df698bff2feddc45 WatchSource:0}: Error finding container f99f4104cec260c3f0b289f3d40ee20bcdca6ab39cd048e1df698bff2feddc45: Status 404 returned error can't find the container with id f99f4104cec260c3f0b289f3d40ee20bcdca6ab39cd048e1df698bff2feddc45 Jun 11 18:28:01.853859 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.853548 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:22:59 +0000 UTC" deadline="2027-11-06 10:46:41.756355519 +0000 UTC" Jun 11 18:28:01.853859 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.853590 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12304h18m39.902768972s" Jun 11 18:28:01.855227 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.855056 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0e60f3_65ad_4766_bc3a_119af36da44e.slice/crio-6c5d89d41246b008bd5f81d5f8a8b47a1481dbf2740a342ecbdc302bc3caee7f WatchSource:0}: Error finding container 6c5d89d41246b008bd5f81d5f8a8b47a1481dbf2740a342ecbdc302bc3caee7f: Status 404 returned error can't find the container with id 6c5d89d41246b008bd5f81d5f8a8b47a1481dbf2740a342ecbdc302bc3caee7f Jun 11 18:28:01.855306 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:01.855236 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49be2b5_1336_46d9_bd76_da52c2e8029f.slice/crio-00a3a33473925f4853492da921f42f5654a20935539fa3d8398573515fd2e594 WatchSource:0}: Error finding container 00a3a33473925f4853492da921f42f5654a20935539fa3d8398573515fd2e594: Status 404 returned error can't find the container with id 00a3a33473925f4853492da921f42f5654a20935539fa3d8398573515fd2e594 Jun 11 18:28:01.873446 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.873204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:01.873596 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:01.873568 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:01.887232 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.887203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerStarted","Data":"dd8a4e85c86861695ecb48d95b99238d6e14b6e42be088eaeb97f329be4e4ecc"} Jun 11 18:28:01.888441 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.888411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"f99f4104cec260c3f0b289f3d40ee20bcdca6ab39cd048e1df698bff2feddc45"} Jun 11 18:28:01.889421 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.889399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nchkq" event={"ID":"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f","Type":"ContainerStarted","Data":"9f6096270a2dd7d07f5de1fa8130e83b7d4c9ee0430ff228755cca3255b82363"} Jun 11 18:28:01.890360 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.890340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2g66n" event={"ID":"dc7b581b-f379-4d02-8a13-69f7b2307575","Type":"ContainerStarted","Data":"71353befe565a3b69a5876749433b1db73442b9a40efb0e9ca48824caaa0ff4a"} Jun 11 18:28:01.891348 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.891326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z25c4" event={"ID":"604c7605-88f9-43d0-b9d3-3cb68fc1b71b","Type":"ContainerStarted","Data":"e244b43795c66f04e20e9d117d381e0c89b502dc0404b1c644cda9140b7b0583"} Jun 11 18:28:01.892319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.892302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5wgjq" event={"ID":"f19f85d6-05a8-4de9-bf42-ba230417e665","Type":"ContainerStarted","Data":"7bbac26bd1bf5e4b4ce466692ab34a9e8ab5ed1630b3ed0d2a4dff52c9147509"} Jun 11 18:28:01.893292 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.893274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8p25q" event={"ID":"f49be2b5-1336-46d9-bd76-da52c2e8029f","Type":"ContainerStarted","Data":"00a3a33473925f4853492da921f42f5654a20935539fa3d8398573515fd2e594"} Jun 11 18:28:01.898418 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.898393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gk72q" event={"ID":"3e0e60f3-65ad-4766-bc3a-119af36da44e","Type":"ContainerStarted","Data":"6c5d89d41246b008bd5f81d5f8a8b47a1481dbf2740a342ecbdc302bc3caee7f"} Jun 11 18:28:01.900052 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.900033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" event={"ID":"e406224b-967b-450f-8936-41d854d09815","Type":"ContainerStarted","Data":"9f64a43f19d3335a1fe0d90a5b9c4f81cb7a4d88a69176fe6a7a7949247e4954"} Jun 11 18:28:01.939448 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:01.939421 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:02.431127 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.431043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:02.431283 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.431169 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:02.431283 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.431240 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:04.431218125 +0000 UTC m=+5.993414712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.531756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.531811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.531958 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.532019 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:28:04.532001928 +0000 UTC m=+6.094198527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.532418 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.532440 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.532455 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:02.532558 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.532516 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:28:04.532483436 +0000 UTC m=+6.094680021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:02.875065 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.874329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:02.875065 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.874473 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:02.875065 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.874894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:02.875065 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:02.874986 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:02.916443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.916401 2576 generic.go:356] "Generic (PLEG): container finished" podID="42c5d8240a4f821dcf0edd49b0ba0c1a" containerID="370dee163ecc7be914d01aeb29288af36eec9e58f0c93d76a164ee810409af50" exitCode=0 Jun 11 18:28:02.916618 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.916521 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"42c5d8240a4f821dcf0edd49b0ba0c1a","Type":"ContainerDied","Data":"370dee163ecc7be914d01aeb29288af36eec9e58f0c93d76a164ee810409af50"} Jun 11 18:28:02.935641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:02.935593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" event={"ID":"53d466c74d7f99aaa0cbb6d6a61f99f9","Type":"ContainerStarted","Data":"f95133ad37b40845bc50a4f48f31fb675ac8c8b668e440ecd3cde37084e17b79"} Jun 11 18:28:03.876533 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:03.876477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:03.877003 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:03.876631 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:03.945578 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:03.945546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" event={"ID":"42c5d8240a4f821dcf0edd49b0ba0c1a","Type":"ContainerStarted","Data":"fc17207ea5d3574fa6eff519a5f2c749b541fb6cbc35d4777836247aa5cc96ac"} Jun 11 18:28:03.962001 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:03.961457 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-178.ec2.internal" podStartSLOduration=4.961436197 podStartE2EDuration="4.961436197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:03.9606723 +0000 UTC m=+5.522868907" watchObservedRunningTime="2026-06-11 18:28:03.961436197 +0000 UTC m=+5.523632804" Jun 11 18:28:03.962001 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:03.961832 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-178.ec2.internal" podStartSLOduration=4.961822606 podStartE2EDuration="4.961822606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:02.951164983 +0000 UTC m=+4.513361590" watchObservedRunningTime="2026-06-11 18:28:03.961822606 +0000 UTC m=+5.524019213" Jun 11 18:28:04.449517 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:04.449469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:04.449710 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.449691 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:04.449787 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.449759 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:08.449741427 +0000 UTC m=+10.011938032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:04.549859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:04.549916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.550034 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.550091 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:28:08.550071929 +0000 UTC m=+10.112268514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.550511 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.550533 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.550545 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:04.550648 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.550588 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:28:08.550573586 +0000 UTC m=+10.112770171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:04.873925 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:04.873846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:04.874087 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.873993 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:04.874147 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:04.874109 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:04.874242 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:04.874209 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:05.873459 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:05.873416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:05.873992 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:05.873567 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:06.873621 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:06.873586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:06.874053 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:06.873603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:06.874053 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:06.873713 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:06.874053 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:06.873817 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:07.874066 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:07.874032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:07.874588 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:07.874164 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:08.481913 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:08.481877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:08.482090 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.482065 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:08.482167 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.482128 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:16.482110508 +0000 UTC m=+18.044307105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:08.582637 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:08.582598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:08.582814 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:08.582649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:08.582814 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.582778 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:08.582814 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.582786 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:08.582814 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.582809 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:08.582989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.582822 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:08.582989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.582843 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:28:16.582826642 +0000 UTC m=+18.145023228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:08.582989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.582873 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:28:16.582855833 +0000 UTC m=+18.145052429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:08.874126 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:08.874056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:08.874126 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:08.874091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:08.874615 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.874170 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:08.874615 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:08.874277 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:09.873646 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:09.873600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:09.873839 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:09.873731 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:10.873189 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:10.873156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:10.873685 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:10.873160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:10.873685 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:10.873304 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:10.873685 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:10.873397 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:11.874358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.874081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:11.874861 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:11.874401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:11.963976 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.963942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nchkq" event={"ID":"82aa3c22-8a92-4e24-9ba8-f0f8bbaba11f","Type":"ContainerStarted","Data":"740f1e92438a5e9af9d841b96a165938001b23ccc5d06de916e69a70cbada81b"} Jun 11 18:28:11.965464 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.965432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2g66n" event={"ID":"dc7b581b-f379-4d02-8a13-69f7b2307575","Type":"ContainerStarted","Data":"299e09fba5bd50ba35935af73656c5c5126ae6e3b3d895f3b94f6fc1e3083b0c"} Jun 11 18:28:11.967027 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.966999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5wgjq" event={"ID":"f19f85d6-05a8-4de9-bf42-ba230417e665","Type":"ContainerStarted","Data":"7e6534a6cd66ae8f5f06c38b94263c495eafb3c2f2b6a8bf4d756e012c86ca9b"} Jun 11 18:28:11.968545 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.968520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gk72q" event={"ID":"3e0e60f3-65ad-4766-bc3a-119af36da44e","Type":"ContainerStarted","Data":"7ea488b3058b28e51c881a6bd105c072f3a84f96268e051ce6fb149a92044264"} Jun 11 18:28:11.970128 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.970081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" event={"ID":"e406224b-967b-450f-8936-41d854d09815","Type":"ContainerStarted","Data":"1e9317bb5e35cd0ad7e6511069c1f7f52cb4dc229d9c9aa36423a0ee2e984707"} Jun 11 18:28:11.971667 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.971643 2576 generic.go:356] "Generic (PLEG): container finished" podID="37349a6b-2cc5-494d-a734-0efa01e7aa61" containerID="22da0a95db4ee7d0572e1173a979f807e4cc6222492b45e2e73ae738460546ad" exitCode=0 Jun 11 18:28:11.971793 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.971684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerDied","Data":"22da0a95db4ee7d0572e1173a979f807e4cc6222492b45e2e73ae738460546ad"} Jun 11 18:28:11.982570 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.982534 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nchkq" podStartSLOduration=3.483512448 podStartE2EDuration="12.982521218s" totalImagesPullingTime="9.49900877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:11.981855506 +0000 UTC m=+13.544052110" watchObservedRunningTime="2026-06-11 18:28:11.982521218 +0000 UTC m=+13.544717822" Jun 11 18:28:11.995750 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:11.995707 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5wgjq" podStartSLOduration=3.535095041 podStartE2EDuration="12.995690601s" totalImagesPullingTime="9.46059556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:11.995393982 +0000 UTC m=+13.557590587" watchObservedRunningTime="2026-06-11 18:28:11.995690601 +0000 UTC m=+13.557887206" Jun 11 18:28:12.047696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.047641 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2g66n" podStartSLOduration=3.571676796 podStartE2EDuration="13.047622514s" totalImagesPullingTime="9.475945718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:12.047613133 +0000 UTC m=+13.609809750" watchObservedRunningTime="2026-06-11 18:28:12.047622514 +0000 UTC m=+13.609819137" Jun 11 18:28:12.062682 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.062635 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gk72q" podStartSLOduration=3.599639761 podStartE2EDuration="13.062618198s" totalImagesPullingTime="9.462978437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:12.062125518 +0000 UTC m=+13.624322124" watchObservedRunningTime="2026-06-11 18:28:12.062618198 +0000 UTC m=+13.624814803" Jun 11 18:28:12.750674 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.750572 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 18:28:12.871607 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.871454 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T18:28:12.750588944Z","UUID":"263cb06c-2359-4c86-bd69-1fd11016f78d","Handler":null,"Name":"","Endpoint":""} Jun 11 18:28:12.873226 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.873205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:12.873354 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:12.873332 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:12.874000 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.873694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:12.874000 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.873723 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 18:28:12.874000 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.873764 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 18:28:12.874000 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:12.873794 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:12.976235 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.976197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8p25q" event={"ID":"f49be2b5-1336-46d9-bd76-da52c2e8029f","Type":"ContainerStarted","Data":"81b5c174a21cc7279ac0a44ce426aea500cc891ea0677af3f8bebda8923bc33d"} Jun 11 18:28:12.979587 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.979371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" event={"ID":"e406224b-967b-450f-8936-41d854d09815","Type":"ContainerStarted","Data":"6358a3b546b040c9dd48837ebd5121136f6d9de78393b776507481bdbf852210"} Jun 11 18:28:12.991166 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:12.991114 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8p25q" podStartSLOduration=4.52940431 podStartE2EDuration="13.991096453s" totalImagesPullingTime="9.461692143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:12.991048443 +0000 UTC m=+14.553245049" watchObservedRunningTime="2026-06-11 18:28:12.991096453 +0000 UTC m=+14.553293074" Jun 11 18:28:13.873773 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:13.873742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:13.873926 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:13.873868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:13.983809 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:13.983768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" event={"ID":"e406224b-967b-450f-8936-41d854d09815","Type":"ContainerStarted","Data":"df6dae0e1d6167db66800b66c0e85b0822eadeacc807df417eee1e5352104675"} Jun 11 18:28:14.001537 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:14.000965 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wz9bn" podStartSLOduration=4.401988592 podStartE2EDuration="16.000945296s" totalImagesPullingTime="11.598956704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:14.00026194 +0000 UTC m=+15.562458589" watchObservedRunningTime="2026-06-11 18:28:14.000945296 +0000 UTC m=+15.563141902" Jun 11 18:28:14.873213 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:14.873182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:14.873213 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:14.873202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:14.873459 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:14.873330 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:14.873577 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:14.873549 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:15.874085 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:15.874048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:15.874716 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:15.874182 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:16.546684 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.546646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:16.546881 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.546823 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:16.546956 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.546909 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:32.546889724 +0000 UTC m=+34.109086327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:16.648011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.647977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:16.648011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.648016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:16.648223 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.648112 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:16.648223 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.648163 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:16.648223 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.648190 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:16.648223 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.648204 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:16.648390 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.648173 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:28:32.648156456 +0000 UTC m=+34.210353041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:16.648390 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.648272 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:28:32.64825437 +0000 UTC m=+34.210450956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:16.873692 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.873612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:16.873858 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.873758 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:16.873858 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.873796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:16.873966 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:16.873909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:16.878479 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.878457 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:16.879388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.879364 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:16.989887 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.989827 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:16.990533 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:16.990507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2g66n" Jun 11 18:28:17.873326 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:17.873289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:17.873523 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:17.873425 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:18.874430 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:18.874392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:18.874856 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:18.874508 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:18.874856 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:18.874544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:18.874856 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:18.874645 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:19.873554 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:19.873512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:19.873729 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:19.873646 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:20.873773 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:20.873730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:20.874313 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:20.873863 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:20.874313 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:20.873933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:20.874313 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:20.874048 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:21.873355 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:21.873324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:21.873647 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:21.873446 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:22.873721 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:22.873688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:22.874207 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:22.873807 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:22.874207 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:22.873872 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:22.874207 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:22.873992 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:23.873482 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:23.873452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:23.873675 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:23.873567 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:24.873703 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:24.873678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:24.873987 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:24.873789 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:24.873987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:24.873843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:24.873987 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:24.873953 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:25.007255 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.007066 2576 generic.go:356] "Generic (PLEG): container finished" podID="37349a6b-2cc5-494d-a734-0efa01e7aa61" containerID="01732a5ba09f9567ec4940b28e1f2eda1ba07efc99d74d0d5b0b0436a0efd8fd" exitCode=0 Jun 11 18:28:25.007361 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.007147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerDied","Data":"01732a5ba09f9567ec4940b28e1f2eda1ba07efc99d74d0d5b0b0436a0efd8fd"} Jun 11 18:28:25.009834 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.009817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:28:25.010190 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.010161 2576 generic.go:356] "Generic (PLEG): container finished" podID="f43e5b98-7fb5-4094-950f-f705d3553b90" containerID="01e4c4624a052d54d2dbbe0579a51ba65f5f1131f50f5ba7a841dc5306695b31" exitCode=1 Jun 11 18:28:25.010190 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.010192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"9a10524b2f667d9d5314766afe7d7ccc158cb3be8c77f33258739c0f277bc6b7"} Jun 11 18:28:25.010328 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.010266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"f4b38bb5ec6180c2d210a2e436975bc05269b21d2388a787bc5f0bbafc18743b"} Jun 11 18:28:25.010328 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.010312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerDied","Data":"01e4c4624a052d54d2dbbe0579a51ba65f5f1131f50f5ba7a841dc5306695b31"} Jun 11 18:28:25.010438 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.010345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"a11f0995a8b3ea07eef12197f640d9193920005398a375b144aa9267968b0c5a"} Jun 11 18:28:25.011837 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.011804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z25c4" event={"ID":"604c7605-88f9-43d0-b9d3-3cb68fc1b71b","Type":"ContainerStarted","Data":"c3d3cc1a09e60b457e2cd8376754943fbff366e478e900f7fe42008ba001f91e"} Jun 11 18:28:25.049383 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.049340 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z25c4" podStartSLOduration=3.2691885689999998 podStartE2EDuration="26.049325715s" totalImagesPullingTime="22.780137146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:25.048775326 +0000 UTC m=+26.610971929" watchObservedRunningTime="2026-06-11 18:28:25.049325715 +0000 UTC m=+26.611522319" Jun 11 18:28:25.873428 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:25.873401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:25.873549 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:25.873513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:26.019166 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.019141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:28:26.019749 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.019539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"0a6ce38c9394337b213f755dd6a31b7399a8f065804ce5e0d499f55458c5e354"} Jun 11 18:28:26.019749 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.019626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"dc7c4a1d17175d70c09db1b2ab3c057c51e6ea10514fcdbd1ceb826a0079db54"} Jun 11 18:28:26.021444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.021421 2576 generic.go:356] "Generic (PLEG): container finished" podID="37349a6b-2cc5-494d-a734-0efa01e7aa61" containerID="be1e99bf2b45e9000fb4754ca5eff8d1cb1b6bf907d6012f545665409d55795e" exitCode=0 Jun 11 18:28:26.021570 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.021516 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerDied","Data":"be1e99bf2b45e9000fb4754ca5eff8d1cb1b6bf907d6012f545665409d55795e"} Jun 11 18:28:26.873381 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.873354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:26.873511 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:26.873471 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:26.873576 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:26.873528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:26.873643 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:26.873625 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:27.025988 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:27.025953 2576 generic.go:356] "Generic (PLEG): container finished" podID="37349a6b-2cc5-494d-a734-0efa01e7aa61" containerID="862b2743516c3197b7270cf379b3dd729eab242c5d7d91a0ad9916463eea0bd3" exitCode=0 Jun 11 18:28:27.026337 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:27.026007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerDied","Data":"862b2743516c3197b7270cf379b3dd729eab242c5d7d91a0ad9916463eea0bd3"} Jun 11 18:28:27.873860 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:27.873820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:27.874033 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:27.873958 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:28.031418 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:28.031389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:28:28.031835 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:28.031725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"8b163b0cd60db65f87983e5e6fd30967681d483352453c743dc1701197dab17c"} Jun 11 18:28:28.875428 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:28.875385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:28.875692 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:28.875663 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:28.875908 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:28.875885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:28.876116 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:28.876054 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:29.873256 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:29.873044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:29.873723 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:29.873332 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:30.040192 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.040162 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:28:30.040653 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.040606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"d8cdc766df38858c1887247eec703a3d3fd41f91905eca22bf0be98feee34a20"} Jun 11 18:28:30.041040 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.041018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:30.041162 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.041097 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:30.041162 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.041144 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:30.041162 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.041152 2576 scope.go:117] "RemoveContainer" containerID="01e4c4624a052d54d2dbbe0579a51ba65f5f1131f50f5ba7a841dc5306695b31" Jun 11 18:28:30.060413 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.060389 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:30.060546 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.060537 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:28:30.873789 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.873750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:30.874276 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:30.873909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:30.874276 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:30.873978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:30.874276 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:30.874124 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:31.048189 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.048158 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:28:31.048633 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.048599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" event={"ID":"f43e5b98-7fb5-4094-950f-f705d3553b90","Type":"ContainerStarted","Data":"264af46cc23bd4f5371f71fa1653c3a6d1b9fea6d0980a2ae4264c51aebd26ab"} Jun 11 18:28:31.078339 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.078288 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" podStartSLOduration=9.331222269 podStartE2EDuration="32.078274155s" totalImagesPullingTime="22.747051886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.077722934 +0000 UTC m=+32.639919539" watchObservedRunningTime="2026-06-11 18:28:31.078274155 +0000 UTC m=+32.640470759" Jun 11 18:28:31.368271 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.368233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vzm4r"] Jun 11 18:28:31.368434 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.368365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:31.368530 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:31.368467 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:31.370654 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.370629 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8jxc4"] Jun 11 18:28:31.370788 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.370709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:31.370866 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:31.370791 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:31.371215 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.371191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hpjf"] Jun 11 18:28:31.371307 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:31.371274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:31.371371 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:31.371341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:32.566216 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:32.566180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:32.566749 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.566339 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:32.566749 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.566407 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:04.566392205 +0000 UTC m=+66.128588791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:32.667080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:32.667038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:32.667080 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:32.667074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:32.667310 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.667186 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:32.667310 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.667213 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:32.667310 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.667240 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:32.667310 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.667254 2576 projected.go:196] Error preparing data for projected volume kube-api-access-zzc7f for pod openshift-network-diagnostics/network-check-target-vzm4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:32.667310 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.667257 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret podName:0c78d645-9ac8-4c4a-8030-501aa1b7dffc nodeName:}" failed. No retries permitted until 2026-06-11 18:29:04.667234193 +0000 UTC m=+66.229430872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret") pod "global-pull-secret-syncer-8jxc4" (UID: "0c78d645-9ac8-4c4a-8030-501aa1b7dffc") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:32.667310 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.667302 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f podName:06665a9b-d5c1-4024-9054-2d270d343bdb nodeName:}" failed. No retries permitted until 2026-06-11 18:29:04.667288532 +0000 UTC m=+66.229485117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zzc7f" (UniqueName: "kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f") pod "network-check-target-vzm4r" (UID: "06665a9b-d5c1-4024-9054-2d270d343bdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:32.873251 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:32.873159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:32.873251 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:32.873167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:32.873555 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.873296 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:32.873555 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:32.873378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:32.873555 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.873381 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:32.873555 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:32.873473 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:34.873917 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:34.873888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:34.874402 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:34.873898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:34.874402 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:34.873982 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:34.874402 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:34.874061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:34.874402 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:34.874105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:34.874402 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:34.874158 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:35.063166 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:35.063131 2576 generic.go:356] "Generic (PLEG): container finished" podID="37349a6b-2cc5-494d-a734-0efa01e7aa61" containerID="33335900fb2cd2d4394e184da5d2c3bd38571885dbbc580b7d9359118dcca836" exitCode=0 Jun 11 18:28:35.063319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:35.063189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerDied","Data":"33335900fb2cd2d4394e184da5d2c3bd38571885dbbc580b7d9359118dcca836"} Jun 11 18:28:36.068160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:36.068127 2576 generic.go:356] "Generic (PLEG): container finished" podID="37349a6b-2cc5-494d-a734-0efa01e7aa61" containerID="e618ae1a743ab9828a8bed9a48e7b00b983ffc136dccf1ab48b645eebe9898c2" exitCode=0 Jun 11 18:28:36.068750 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:36.068170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerDied","Data":"e618ae1a743ab9828a8bed9a48e7b00b983ffc136dccf1ab48b645eebe9898c2"} Jun 11 18:28:36.878858 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:36.878829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:36.879027 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:36.878909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzm4r" podUID="06665a9b-d5c1-4024-9054-2d270d343bdb" Jun 11 18:28:36.879027 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:36.878834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:36.879027 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:36.878964 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jxc4" podUID="0c78d645-9ac8-4c4a-8030-501aa1b7dffc" Jun 11 18:28:36.879027 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:36.878830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:36.879027 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:36.879025 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:28:37.074000 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.073969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" event={"ID":"37349a6b-2cc5-494d-a734-0efa01e7aa61","Type":"ContainerStarted","Data":"c588251485bbdf003f33428ffe531fb748be842c053bac603e9c1c255b43b5a4"} Jun 11 18:28:37.097374 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.097327 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qlgj4" podStartSLOduration=7.203071761 podStartE2EDuration="38.097313488s" totalImagesPullingTime="30.894241727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:37.097143906 +0000 UTC m=+38.659340511" watchObservedRunningTime="2026-06-11 18:28:37.097313488 +0000 UTC m=+38.659510091" Jun 11 18:28:37.245664 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.245592 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:37.284375 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.284350 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-178.ec2.internal" event="NodeReady" Jun 11 18:28:37.284515 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.284470 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 18:28:37.337315 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.337279 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4r6jq"] Jun 11 18:28:37.347568 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.347541 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:37.352139 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.352116 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7krc7"] Jun 11 18:28:37.352618 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.352597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.354823 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.354800 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 18:28:37.354931 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.354910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rkrwn\"" Jun 11 18:28:37.355221 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.355201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 18:28:37.355314 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.355287 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 18:28:37.368338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.368316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4r6jq"] Jun 11 18:28:37.368420 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.368342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.368420 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.368367 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7krc7"] Jun 11 18:28:37.370727 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.370712 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 18:28:37.370859 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.370795 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 18:28:37.370859 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.370827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cszq9\"" Jun 11 18:28:37.504839 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.504812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb42n\" (UniqueName: \"kubernetes.io/projected/9fa2dbd4-57d8-4551-af23-631af026e3f0-kube-api-access-qb42n\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.504987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.504851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.504987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.504874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvfr\" (UniqueName: \"kubernetes.io/projected/ad96837b-3531-45bf-8a01-7847f58e80fd-kube-api-access-hfvfr\") pod \"ingress-canary-4r6jq\" (UID: \"ad96837b-3531-45bf-8a01-7847f58e80fd\") " pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.504987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.504924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad96837b-3531-45bf-8a01-7847f58e80fd-cert\") pod \"ingress-canary-4r6jq\" (UID: \"ad96837b-3531-45bf-8a01-7847f58e80fd\") " pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.504987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.504943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa2dbd4-57d8-4551-af23-631af026e3f0-config-volume\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.504987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.504972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa2dbd4-57d8-4551-af23-631af026e3f0-tmp-dir\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.605694 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.605663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb42n\" (UniqueName: \"kubernetes.io/projected/9fa2dbd4-57d8-4551-af23-631af026e3f0-kube-api-access-qb42n\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.605694 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.605700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.605896 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.605734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvfr\" (UniqueName: \"kubernetes.io/projected/ad96837b-3531-45bf-8a01-7847f58e80fd-kube-api-access-hfvfr\") pod \"ingress-canary-4r6jq\" (UID: \"ad96837b-3531-45bf-8a01-7847f58e80fd\") " pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.605896 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.605786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad96837b-3531-45bf-8a01-7847f58e80fd-cert\") pod \"ingress-canary-4r6jq\" (UID: \"ad96837b-3531-45bf-8a01-7847f58e80fd\") " pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.605896 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.605810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa2dbd4-57d8-4551-af23-631af026e3f0-config-volume\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.605896 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:37.605816 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:37.605896 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:37.605870 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:38.105854023 +0000 UTC m=+39.668050608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:28:37.606101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.605906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa2dbd4-57d8-4551-af23-631af026e3f0-tmp-dir\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.606178 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.606163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa2dbd4-57d8-4551-af23-631af026e3f0-tmp-dir\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.606374 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.606360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fa2dbd4-57d8-4551-af23-631af026e3f0-config-volume\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.609998 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.609979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad96837b-3531-45bf-8a01-7847f58e80fd-cert\") pod \"ingress-canary-4r6jq\" (UID: \"ad96837b-3531-45bf-8a01-7847f58e80fd\") " pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.616470 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.616445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvfr\" (UniqueName: \"kubernetes.io/projected/ad96837b-3531-45bf-8a01-7847f58e80fd-kube-api-access-hfvfr\") pod \"ingress-canary-4r6jq\" (UID: \"ad96837b-3531-45bf-8a01-7847f58e80fd\") " pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.628081 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.628058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb42n\" (UniqueName: \"kubernetes.io/projected/9fa2dbd4-57d8-4551-af23-631af026e3f0-kube-api-access-qb42n\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:37.662593 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.662566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4r6jq" Jun 11 18:28:37.826682 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:37.826507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4r6jq"] Jun 11 18:28:37.830799 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:28:37.830772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad96837b_3531_45bf_8a01_7847f58e80fd.slice/crio-11867949cc2c5ed13a79bebed281424873434edae0b5ad7114a0df07ba7be46c WatchSource:0}: Error finding container 11867949cc2c5ed13a79bebed281424873434edae0b5ad7114a0df07ba7be46c: Status 404 returned error can't find the container with id 11867949cc2c5ed13a79bebed281424873434edae0b5ad7114a0df07ba7be46c Jun 11 18:28:38.077184 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.077087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4r6jq" event={"ID":"ad96837b-3531-45bf-8a01-7847f58e80fd","Type":"ContainerStarted","Data":"11867949cc2c5ed13a79bebed281424873434edae0b5ad7114a0df07ba7be46c"} Jun 11 18:28:38.110533 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.110504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:38.110669 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:38.110605 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:38.110669 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:38.110653 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:39.110640542 +0000 UTC m=+40.672837125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:28:38.875297 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.875261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:28:38.877701 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.875736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:28:38.877701 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.876423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:28:38.878614 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.878419 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:28:38.879319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.879291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7h7l\"" Jun 11 18:28:38.879431 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.879397 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85nqp\"" Jun 11 18:28:38.879534 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.879434 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:28:38.879682 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.879663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:28:38.879762 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:38.879696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:28:39.118412 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:39.118377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:39.118857 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:39.118512 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:39.118857 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:39.118594 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:41.118573278 +0000 UTC m=+42.680769877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:28:41.085957 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.085925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4r6jq" event={"ID":"ad96837b-3531-45bf-8a01-7847f58e80fd","Type":"ContainerStarted","Data":"a42efacbf0a11f36c6fa08ebea60474d52e990de334f575b406472e5bb2eb75f"} Jun 11 18:28:41.111549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.111480 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4r6jq" podStartSLOduration=1.48432399 podStartE2EDuration="4.111464103s" totalImagesPullingTime="2.627140113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:41.110279801 +0000 UTC m=+42.672476405" watchObservedRunningTime="2026-06-11 18:28:41.111464103 +0000 UTC m=+42.673660714" Jun 11 18:28:41.132135 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.132106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:41.132289 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:41.132251 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:41.132343 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:41.132314 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:45.132296795 +0000 UTC m=+46.694493382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:28:41.134626 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.134605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:41.234175 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.234092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:41.305794 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.305752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:41.942144 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:41.942106 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:42.005147 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:42.005119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:45.157810 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:45.157770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:45.158259 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:45.157890 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:45.158259 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:45.157945 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:53.157930289 +0000 UTC m=+54.720126870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:28:45.653448 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:45.653191 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:45.753669 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:45.753629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:48.043178 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:48.043145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:48.105111 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:48.105082 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:48.252814 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:48.252786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:48.317642 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:48.317576 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:28:53.211588 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:28:53.211536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:28:53.212067 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:53.211685 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:53.212067 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:28:53.211760 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:09.211743119 +0000 UTC m=+70.773939701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:29:00.949730 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.949675 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs"] Jun 11 18:29:00.952021 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.952000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:00.955370 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.955345 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 18:29:00.955370 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.955364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 18:29:00.955565 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.955366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vsdh6\"" Jun 11 18:29:00.955565 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.955422 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 18:29:00.955565 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.955366 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 18:29:00.959400 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.959379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs"] Jun 11 18:29:00.961220 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.961197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40d3dc8c-e2d0-413a-882c-b1951061a249-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs\" (UID: \"40d3dc8c-e2d0-413a-882c-b1951061a249\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:00.961311 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:00.961233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlgv7\" (UniqueName: \"kubernetes.io/projected/40d3dc8c-e2d0-413a-882c-b1951061a249-kube-api-access-nlgv7\") pod \"managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs\" (UID: \"40d3dc8c-e2d0-413a-882c-b1951061a249\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:01.062441 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:01.062398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40d3dc8c-e2d0-413a-882c-b1951061a249-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs\" (UID: \"40d3dc8c-e2d0-413a-882c-b1951061a249\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:01.062441 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:01.062443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlgv7\" (UniqueName: \"kubernetes.io/projected/40d3dc8c-e2d0-413a-882c-b1951061a249-kube-api-access-nlgv7\") pod \"managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs\" (UID: \"40d3dc8c-e2d0-413a-882c-b1951061a249\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:01.066467 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:01.066445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40d3dc8c-e2d0-413a-882c-b1951061a249-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs\" (UID: \"40d3dc8c-e2d0-413a-882c-b1951061a249\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:01.071645 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:01.071622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlgv7\" (UniqueName: \"kubernetes.io/projected/40d3dc8c-e2d0-413a-882c-b1951061a249-kube-api-access-nlgv7\") pod \"managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs\" (UID: \"40d3dc8c-e2d0-413a-882c-b1951061a249\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:01.269237 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:01.269207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:29:01.386118 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:01.386062 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs"] Jun 11 18:29:01.389571 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:29:01.389538 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40d3dc8c_e2d0_413a_882c_b1951061a249.slice/crio-9a610a05ea64ee76de7e2bcb65a26f4681296e363707ae9ad61e224db549bce4 WatchSource:0}: Error finding container 9a610a05ea64ee76de7e2bcb65a26f4681296e363707ae9ad61e224db549bce4: Status 404 returned error can't find the container with id 9a610a05ea64ee76de7e2bcb65a26f4681296e363707ae9ad61e224db549bce4 Jun 11 18:29:02.061014 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:02.060991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xkzp6" Jun 11 18:29:02.135079 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:02.135046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" event={"ID":"40d3dc8c-e2d0-413a-882c-b1951061a249","Type":"ContainerStarted","Data":"9a610a05ea64ee76de7e2bcb65a26f4681296e363707ae9ad61e224db549bce4"} Jun 11 18:29:02.267140 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:02.267107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:02.362467 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:02.362390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:03.088797 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:03.088739 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:03.189838 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:03.189787 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:04.587672 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.587584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:29:04.590581 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.590562 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:29:04.598529 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:29:04.598511 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 18:29:04.598589 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:29:04.598570 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:30:08.598553885 +0000 UTC m=+130.160750468 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : secret "metrics-daemon-secret" not found Jun 11 18:29:04.688179 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.688146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:29:04.688342 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.688182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:29:04.690707 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.690684 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:29:04.690763 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.690695 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:29:04.700969 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.700948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c78d645-9ac8-4c4a-8030-501aa1b7dffc-original-pull-secret\") pod \"global-pull-secret-syncer-8jxc4\" (UID: \"0c78d645-9ac8-4c4a-8030-501aa1b7dffc\") " pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:29:04.701165 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.701154 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:29:04.711541 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.711513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzc7f\" (UniqueName: \"kubernetes.io/projected/06665a9b-d5c1-4024-9054-2d270d343bdb-kube-api-access-zzc7f\") pod \"network-check-target-vzm4r\" (UID: \"06665a9b-d5c1-4024-9054-2d270d343bdb\") " pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:29:04.996066 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:04.995990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jxc4" Jun 11 18:29:05.005439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:05.005410 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85nqp\"" Jun 11 18:29:05.013470 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:05.013441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:29:05.145549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:05.145454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" event={"ID":"40d3dc8c-e2d0-413a-882c-b1951061a249","Type":"ContainerStarted","Data":"d94b5b920902cf8cd1eae5c0c8395e4b5947b419fc7f91036c978ea7f41c60ba"} Jun 11 18:29:05.153321 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:05.153292 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8jxc4"] Jun 11 18:29:05.156600 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:29:05.156571 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c78d645_9ac8_4c4a_8030_501aa1b7dffc.slice/crio-61c2c8c2a09cdf0c9469ada591d85a64f40e0f2d132de6707d77a87f1f5d42cd WatchSource:0}: Error finding container 61c2c8c2a09cdf0c9469ada591d85a64f40e0f2d132de6707d77a87f1f5d42cd: Status 404 returned error can't find the container with id 61c2c8c2a09cdf0c9469ada591d85a64f40e0f2d132de6707d77a87f1f5d42cd Jun 11 18:29:05.165810 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:05.165769 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" podStartSLOduration=2.295450364 podStartE2EDuration="5.16575412s" totalImagesPullingTime="2.870303756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:05.164514797 +0000 UTC m=+66.726711392" watchObservedRunningTime="2026-06-11 18:29:05.16575412 +0000 UTC m=+66.727950750" Jun 11 18:29:05.169323 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:05.169295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vzm4r"] Jun 11 18:29:05.171798 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:29:05.171772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06665a9b_d5c1_4024_9054_2d270d343bdb.slice/crio-7b696ad25669220877a4b8bbb4a8d52379a4fb1d9b58f34d75d40d91a6e66cdd WatchSource:0}: Error finding container 7b696ad25669220877a4b8bbb4a8d52379a4fb1d9b58f34d75d40d91a6e66cdd: Status 404 returned error can't find the container with id 7b696ad25669220877a4b8bbb4a8d52379a4fb1d9b58f34d75d40d91a6e66cdd Jun 11 18:29:06.150469 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:06.150427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vzm4r" event={"ID":"06665a9b-d5c1-4024-9054-2d270d343bdb","Type":"ContainerStarted","Data":"7b696ad25669220877a4b8bbb4a8d52379a4fb1d9b58f34d75d40d91a6e66cdd"} Jun 11 18:29:06.151793 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:06.151765 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8jxc4" event={"ID":"0c78d645-9ac8-4c4a-8030-501aa1b7dffc","Type":"ContainerStarted","Data":"61c2c8c2a09cdf0c9469ada591d85a64f40e0f2d132de6707d77a87f1f5d42cd"} Jun 11 18:29:09.006481 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:09.006448 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:09.071831 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:09.071790 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:09.223723 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:09.223683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:29:09.223904 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:29:09.223867 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:29:09.223981 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:29:09.223954 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:41.223937328 +0000 UTC m=+102.786133910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:29:11.167480 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:11.167439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8jxc4" event={"ID":"0c78d645-9ac8-4c4a-8030-501aa1b7dffc","Type":"ContainerStarted","Data":"725b68850f0fad6b5e2659ed30a5c13fd116e10968458dc07b2a26ae18ca0ee6"} Jun 11 18:29:11.168935 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:11.168908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vzm4r" event={"ID":"06665a9b-d5c1-4024-9054-2d270d343bdb","Type":"ContainerStarted","Data":"98eeb77b3c640d7619caa9bcfecc03a3b8d16154c5d83a318d3858e535aa0d7e"} Jun 11 18:29:11.169070 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:11.169048 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:29:11.186617 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:11.186563 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8jxc4" podStartSLOduration=66.880652926 podStartE2EDuration="1m12.186547301s" totalImagesPullingTime="5.305894375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:11.185876373 +0000 UTC m=+72.748072977" watchObservedRunningTime="2026-06-11 18:29:11.186547301 +0000 UTC m=+72.748743906" Jun 11 18:29:11.203356 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:11.203308 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vzm4r" podStartSLOduration=66.916650706 podStartE2EDuration="1m12.203291744s" totalImagesPullingTime="5.286641038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:11.203126811 +0000 UTC m=+72.765323437" watchObservedRunningTime="2026-06-11 18:29:11.203291744 +0000 UTC m=+72.765488345" Jun 11 18:29:16.772108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:16.771998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:16.827718 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:16.827695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:29:41.237939 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:41.237854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:29:41.238287 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:29:41.237981 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:29:41.238287 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:29:41.238034 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:30:45.238021365 +0000 UTC m=+166.800217947 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:29:42.173779 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:29:42.173750 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vzm4r" Jun 11 18:30:08.623477 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:30:08.623437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:30:08.623957 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:30:08.623591 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 18:30:08.623957 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:30:08.623662 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs podName:81e97285-de0c-40d4-8a68-fa7c2408b535 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:10.623644766 +0000 UTC m=+252.185841352 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs") pod "network-metrics-daemon-8hpjf" (UID: "81e97285-de0c-40d4-8a68-fa7c2408b535") : secret "metrics-daemon-secret" not found Jun 11 18:30:24.505543 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:30:24.505510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:30:40.376682 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:30:40.376643 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7krc7" podUID="9fa2dbd4-57d8-4551-af23-631af026e3f0" Jun 11 18:30:41.377565 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:30:41.377535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7krc7" Jun 11 18:30:41.889110 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:30:41.889050 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8hpjf" podUID="81e97285-de0c-40d4-8a68-fa7c2408b535" Jun 11 18:30:45.275167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:30:45.275125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:30:45.275597 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:30:45.275279 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:30:45.275597 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:30:45.275346 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls podName:9fa2dbd4-57d8-4551-af23-631af026e3f0 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:47.275331551 +0000 UTC m=+288.837528133 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls") pod "dns-default-7krc7" (UID: "9fa2dbd4-57d8-4551-af23-631af026e3f0") : secret "dns-default-metrics-tls" not found Jun 11 18:30:53.873254 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:30:53.873213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:31:04.434238 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:04.434204 2576 generic.go:356] "Generic (PLEG): container finished" podID="40d3dc8c-e2d0-413a-882c-b1951061a249" containerID="d94b5b920902cf8cd1eae5c0c8395e4b5947b419fc7f91036c978ea7f41c60ba" exitCode=255 Jun 11 18:31:04.434597 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:04.434259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" event={"ID":"40d3dc8c-e2d0-413a-882c-b1951061a249","Type":"ContainerDied","Data":"d94b5b920902cf8cd1eae5c0c8395e4b5947b419fc7f91036c978ea7f41c60ba"} Jun 11 18:31:04.450903 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:04.450879 2576 scope.go:117] "RemoveContainer" containerID="d94b5b920902cf8cd1eae5c0c8395e4b5947b419fc7f91036c978ea7f41c60ba" Jun 11 18:31:05.438977 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:05.438944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" event={"ID":"40d3dc8c-e2d0-413a-882c-b1951061a249","Type":"ContainerStarted","Data":"3e34b306b71c89ddfa01c423a4acd6e2128eeb2f46f668225846e04757b83ac3"} Jun 11 18:31:06.756008 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:06.755927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:41.175298 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.175260 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr"] Jun 11 18:31:41.176946 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.176929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.181718 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.181692 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 18:31:41.182787 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.182765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.183521 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.183500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-q8zvm\"" Jun 11 18:31:41.183782 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.183768 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 18:31:41.183856 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.183780 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.185593 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.185576 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg"] Jun 11 18:31:41.187184 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.187171 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-654f9745b4-vcvhf"] Jun 11 18:31:41.187302 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.187286 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.188778 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.188761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.191055 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.191038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xs6ct\"" Jun 11 18:31:41.193109 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 18:31:41.193414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.193414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193256 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9h7xm\"" Jun 11 18:31:41.193414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193293 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 18:31:41.193414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193103 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 18:31:41.193414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193350 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.193815 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.193801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 18:31:41.201299 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.201279 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 18:31:41.201659 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.201640 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64f64c5d4-fwz5h"] Jun 11 18:31:41.203675 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.203648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.206344 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.206326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr"] Jun 11 18:31:41.207289 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.207272 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.207391 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.207297 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 18:31:41.207391 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.207322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 18:31:41.207702 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.207443 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 18:31:41.207702 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.207685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tk5hf\"" Jun 11 18:31:41.207831 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.207707 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.208034 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.208018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 18:31:41.208259 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.208239 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 18:31:41.217457 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.217437 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj"] Jun 11 18:31:41.219108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.219095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" Jun 11 18:31:41.223535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.223516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.223663 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.223515 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.223780 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.223762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qfq26\"" Jun 11 18:31:41.225375 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.224923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654f9745b4-vcvhf"] Jun 11 18:31:41.226069 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.226021 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg"] Jun 11 18:31:41.227468 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.227446 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f64c5d4-fwz5h"] Jun 11 18:31:41.244278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5xzn\" (UniqueName: \"kubernetes.io/projected/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-kube-api-access-h5xzn\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.244395 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-default-certificate\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.244395 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.244395 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-installation-pull-secrets\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-bound-sa-token\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0917e79-f652-4d10-acc5-c28f3a83068e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.244535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grntj\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-kube-api-access-grntj\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244652 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-image-registry-private-configuration\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244652 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1482cf-8c82-4360-aef9-26edf1245dac-ca-trust-extracted\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244652 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0917e79-f652-4d10-acc5-c28f3a83068e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.244652 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.244817 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.244817 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244817 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8ws\" (UniqueName: \"kubernetes.io/projected/c0917e79-f652-4d10-acc5-c28f3a83068e-kube-api-access-5m8ws\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.244817 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-stats-auth\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.244983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr5f4\" (UniqueName: \"kubernetes.io/projected/c2c50f08-6ac9-489a-962b-32c36a29e52e-kube-api-access-tr5f4\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.244983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-certificates\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-trusted-ca\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.244983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.244943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.245150 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.245133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj"] Jun 11 18:31:41.346010 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.345955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.346203 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8ws\" (UniqueName: \"kubernetes.io/projected/c0917e79-f652-4d10-acc5-c28f3a83068e-kube-api-access-5m8ws\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.346203 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-stats-auth\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.346203 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.346112 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:31:41.346203 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.346134 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654f9745b4-vcvhf: secret "image-registry-tls" not found Jun 11 18:31:41.346203 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.346182 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls podName:6b1482cf-8c82-4360-aef9-26edf1245dac nodeName:}" failed. No retries permitted until 2026-06-11 18:31:41.846167781 +0000 UTC m=+223.408364364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls") pod "image-registry-654f9745b4-vcvhf" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac") : secret "image-registry-tls" not found Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr5f4\" (UniqueName: \"kubernetes.io/projected/c2c50f08-6ac9-489a-962b-32c36a29e52e-kube-api-access-tr5f4\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685gc\" (UniqueName: \"kubernetes.io/projected/35d8faf4-d392-4412-9908-31fb5429e97e-kube-api-access-685gc\") pod \"volume-data-source-validator-bd4ccd799-4dwlj\" (UID: \"35d8faf4-d392-4412-9908-31fb5429e97e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-certificates\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-trusted-ca\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5xzn\" (UniqueName: \"kubernetes.io/projected/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-kube-api-access-h5xzn\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.346471 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 18:31:41.346540 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-default-certificate\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.346546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:41.84652884 +0000 UTC m=+223.408725423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : secret "router-metrics-certs-default" not found Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-installation-pull-secrets\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-bound-sa-token\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0917e79-f652-4d10-acc5-c28f3a83068e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.346709 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:41.846693432 +0000 UTC m=+223.408890036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : configmap references non-existent config key: service-ca.crt Jun 11 18:31:41.346913 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-certificates\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grntj\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-kube-api-access-grntj\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-image-registry-private-configuration\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.346989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1482cf-8c82-4360-aef9-26edf1245dac-ca-trust-extracted\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0917e79-f652-4d10-acc5-c28f3a83068e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.347168 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0917e79-f652-4d10-acc5-c28f3a83068e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.347278 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.347223 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls podName:a17b02f2-2e41-4dbd-bfcd-abd2dc81b123 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:41.847205908 +0000 UTC m=+223.409402516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-k4ldg" (UID: "a17b02f2-2e41-4dbd-bfcd-abd2dc81b123") : secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:41.347741 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-trusted-ca\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.347741 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1482cf-8c82-4360-aef9-26edf1245dac-ca-trust-extracted\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.347940 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.347918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.348933 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.348913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-stats-auth\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.349577 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.349546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-image-registry-private-configuration\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.349663 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.349617 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-default-certificate\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.349700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.349683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0917e79-f652-4d10-acc5-c28f3a83068e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.349920 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.349898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-installation-pull-secrets\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.367397 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.367367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8ws\" (UniqueName: \"kubernetes.io/projected/c0917e79-f652-4d10-acc5-c28f3a83068e-kube-api-access-5m8ws\") pod \"kube-storage-version-migrator-operator-7c578b78fc-cntmr\" (UID: \"c0917e79-f652-4d10-acc5-c28f3a83068e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.369153 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.369132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr5f4\" (UniqueName: \"kubernetes.io/projected/c2c50f08-6ac9-489a-962b-32c36a29e52e-kube-api-access-tr5f4\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.377991 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.377965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5xzn\" (UniqueName: \"kubernetes.io/projected/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-kube-api-access-h5xzn\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.379447 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.379427 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grntj\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-kube-api-access-grntj\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.380457 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.380429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-bound-sa-token\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.447986 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.447888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685gc\" (UniqueName: \"kubernetes.io/projected/35d8faf4-d392-4412-9908-31fb5429e97e-kube-api-access-685gc\") pod \"volume-data-source-validator-bd4ccd799-4dwlj\" (UID: \"35d8faf4-d392-4412-9908-31fb5429e97e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" Jun 11 18:31:41.479569 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.479544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-685gc\" (UniqueName: \"kubernetes.io/projected/35d8faf4-d392-4412-9908-31fb5429e97e-kube-api-access-685gc\") pod \"volume-data-source-validator-bd4ccd799-4dwlj\" (UID: \"35d8faf4-d392-4412-9908-31fb5429e97e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" Jun 11 18:31:41.485222 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.485208 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" Jun 11 18:31:41.528377 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.528325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" Jun 11 18:31:41.531567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.531459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:41.606356 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.606326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:41.613934 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.613906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr"] Jun 11 18:31:41.617157 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:31:41.617127 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0917e79_f652_4d10_acc5_c28f3a83068e.slice/crio-f8c67e16893e46d5f662fb658cb12599800142a895cf336d8c0df6d030e9a622 WatchSource:0}: Error finding container f8c67e16893e46d5f662fb658cb12599800142a895cf336d8c0df6d030e9a622: Status 404 returned error can't find the container with id f8c67e16893e46d5f662fb658cb12599800142a895cf336d8c0df6d030e9a622 Jun 11 18:31:41.663645 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.663622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj"] Jun 11 18:31:41.665778 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:31:41.665753 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d8faf4_d392_4412_9908_31fb5429e97e.slice/crio-6d64d630e403af347480a6c99007efdc5465985dc9a41f2feab132afef19c642 WatchSource:0}: Error finding container 6d64d630e403af347480a6c99007efdc5465985dc9a41f2feab132afef19c642: Status 404 returned error can't find the container with id 6d64d630e403af347480a6c99007efdc5465985dc9a41f2feab132afef19c642 Jun 11 18:31:41.850791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.850751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.850812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.850866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:41.850895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.850898 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.850958 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:42.850944034 +0000 UTC m=+224.413140616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : secret "router-metrics-certs-default" not found Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.850972 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:41.850989 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.850981 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:42.850967594 +0000 UTC m=+224.413164175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : configmap references non-existent config key: service-ca.crt Jun 11 18:31:41.851258 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.851015 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:31:41.851258 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.851040 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654f9745b4-vcvhf: secret "image-registry-tls" not found Jun 11 18:31:41.851258 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.851016 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls podName:a17b02f2-2e41-4dbd-bfcd-abd2dc81b123 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:42.851001555 +0000 UTC m=+224.413198156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-k4ldg" (UID: "a17b02f2-2e41-4dbd-bfcd-abd2dc81b123") : secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:41.851258 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:41.851081 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls podName:6b1482cf-8c82-4360-aef9-26edf1245dac nodeName:}" failed. No retries permitted until 2026-06-11 18:31:42.851072578 +0000 UTC m=+224.413269165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls") pod "image-registry-654f9745b4-vcvhf" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac") : secret "image-registry-tls" not found Jun 11 18:31:42.545602 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:42.545564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" event={"ID":"35d8faf4-d392-4412-9908-31fb5429e97e","Type":"ContainerStarted","Data":"6d64d630e403af347480a6c99007efdc5465985dc9a41f2feab132afef19c642"} Jun 11 18:31:42.546978 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:42.546950 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" event={"ID":"c0917e79-f652-4d10-acc5-c28f3a83068e","Type":"ContainerStarted","Data":"f8c67e16893e46d5f662fb658cb12599800142a895cf336d8c0df6d030e9a622"} Jun 11 18:31:42.859968 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:42.859886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:42.859968 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:42.859935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:42.859987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:42.860018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860054 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860115 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:44.860098149 +0000 UTC m=+226.422294734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : secret "router-metrics-certs-default" not found Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860131 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860135 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:42.860188 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860142 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654f9745b4-vcvhf: secret "image-registry-tls" not found Jun 11 18:31:42.860482 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860143 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:44.86012562 +0000 UTC m=+226.422322219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : configmap references non-existent config key: service-ca.crt Jun 11 18:31:42.860482 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860231 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls podName:a17b02f2-2e41-4dbd-bfcd-abd2dc81b123 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:44.860218684 +0000 UTC m=+226.422415279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-k4ldg" (UID: "a17b02f2-2e41-4dbd-bfcd-abd2dc81b123") : secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:42.860482 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:42.860253 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls podName:6b1482cf-8c82-4360-aef9-26edf1245dac nodeName:}" failed. No retries permitted until 2026-06-11 18:31:44.860243861 +0000 UTC m=+226.422440458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls") pod "image-registry-654f9745b4-vcvhf" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac") : secret "image-registry-tls" not found Jun 11 18:31:43.550980 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:43.550903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" event={"ID":"35d8faf4-d392-4412-9908-31fb5429e97e","Type":"ContainerStarted","Data":"8ab1dc933906c57cb68d8e064de9d81ea63cbe6e74690bcf948f4559d830e7f1"} Jun 11 18:31:43.566125 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:43.566075 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4dwlj" podStartSLOduration=0.97852144 podStartE2EDuration="2.566059856s" totalImagesPullingTime="1.587538416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:43.565136561 +0000 UTC m=+225.127333186" watchObservedRunningTime="2026-06-11 18:31:43.566059856 +0000 UTC m=+225.128256460" Jun 11 18:31:43.660964 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:43.660930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:43.716791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:43.716761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:44.556139 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:44.556087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" event={"ID":"c0917e79-f652-4d10-acc5-c28f3a83068e","Type":"ContainerStarted","Data":"53fe859738c53a28f5a6b4df02a77674332f8c08feb075f9aeca322c2f2f2726"} Jun 11 18:31:44.574644 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:44.574600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" podStartSLOduration=0.729641239 podStartE2EDuration="3.574585495s" totalImagesPullingTime="2.844944256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:44.57397654 +0000 UTC m=+226.136173146" watchObservedRunningTime="2026-06-11 18:31:44.574585495 +0000 UTC m=+226.136782140" Jun 11 18:31:44.876400 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:44.876367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:44.876408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:44.876439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:44.876457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876550 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876566 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876580 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654f9745b4-vcvhf: secret "image-registry-tls" not found Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876583 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:44.876606 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876565 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:48.876548674 +0000 UTC m=+230.438745257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : configmap references non-existent config key: service-ca.crt Jun 11 18:31:44.877000 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876627 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls podName:a17b02f2-2e41-4dbd-bfcd-abd2dc81b123 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:48.876611867 +0000 UTC m=+230.438808452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-k4ldg" (UID: "a17b02f2-2e41-4dbd-bfcd-abd2dc81b123") : secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:44.877000 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876640 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls podName:6b1482cf-8c82-4360-aef9-26edf1245dac nodeName:}" failed. No retries permitted until 2026-06-11 18:31:48.876633986 +0000 UTC m=+230.438830568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls") pod "image-registry-654f9745b4-vcvhf" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac") : secret "image-registry-tls" not found Jun 11 18:31:44.877000 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:44.876651 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:48.876644241 +0000 UTC m=+230.438840824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : secret "router-metrics-certs-default" not found Jun 11 18:31:45.868681 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:45.868649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:45.961109 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:45.961080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:46.053212 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.053179 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2jxsg"] Jun 11 18:31:46.054882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.054854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:46.055597 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.055581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.057799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.057779 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 18:31:46.057908 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.057893 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 18:31:46.057996 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.057978 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrdf4\"" Jun 11 18:31:46.058552 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.058538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 18:31:46.058552 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.058546 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 18:31:46.068650 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.068627 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2jxsg"] Jun 11 18:31:46.122806 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.122717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:46.188234 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.188200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.188386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.188259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c72691ad-a24b-4808-bfd3-0f42ed98b062-crio-socket\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.188386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.188302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72691ad-a24b-4808-bfd3-0f42ed98b062-data-volume\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.188386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.188346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzz26\" (UniqueName: \"kubernetes.io/projected/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-api-access-fzz26\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.188386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.188380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.288832 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.288807 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:46.288832 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.288820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.289022 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.288871 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:46.788854751 +0000 UTC m=+228.351051333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : configmap "kube-rbac-proxy" not found Jun 11 18:31:46.289022 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.288899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c72691ad-a24b-4808-bfd3-0f42ed98b062-crio-socket\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.289022 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.288920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72691ad-a24b-4808-bfd3-0f42ed98b062-data-volume\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.289022 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.288974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c72691ad-a24b-4808-bfd3-0f42ed98b062-crio-socket\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.289022 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.288984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz26\" (UniqueName: \"kubernetes.io/projected/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-api-access-fzz26\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.289189 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.289039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.289189 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.289130 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.289189 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.289177 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:46.789167395 +0000 UTC m=+228.351363978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.289335 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.289313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c72691ad-a24b-4808-bfd3-0f42ed98b062-data-volume\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.299301 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.299278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzz26\" (UniqueName: \"kubernetes.io/projected/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-api-access-fzz26\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.365227 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.365170 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:46.421922 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.421852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:46.792975 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.792941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.793136 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.792988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:46.793136 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.793121 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.793209 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.793176 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:46.793209 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.793190 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:47.793176127 +0000 UTC m=+229.355372709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.793278 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:46.793223 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:47.79321079 +0000 UTC m=+229.355407375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : configmap "kube-rbac-proxy" not found Jun 11 18:31:46.827265 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.827209 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:46.914377 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:46.914330 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:47.154641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:47.154539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:47.254419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:47.254380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:47.799464 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:47.799425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:47.799663 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:47.799476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:47.799663 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:47.799571 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:47.799663 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:47.799602 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:47.799663 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:47.799635 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:49.799617795 +0000 UTC m=+231.361814396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : configmap "kube-rbac-proxy" not found Jun 11 18:31:47.799663 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:47.799651 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:49.799643052 +0000 UTC m=+231.361839636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:48.520116 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.520072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:48.574354 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.574328 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:48.709746 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.709713 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:48.771628 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.771552 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:48.907319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.907288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:48.907319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.907324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907430 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907437 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.907461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907518 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls podName:a17b02f2-2e41-4dbd-bfcd-abd2dc81b123 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:56.907482834 +0000 UTC m=+238.469679417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-k4ldg" (UID: "a17b02f2-2e41-4dbd-bfcd-abd2dc81b123") : secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907441 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654f9745b4-vcvhf: secret "image-registry-tls" not found Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907557 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:48.907566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907575 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls podName:6b1482cf-8c82-4360-aef9-26edf1245dac nodeName:}" failed. No retries permitted until 2026-06-11 18:31:56.907561322 +0000 UTC m=+238.469757918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls") pod "image-registry-654f9745b4-vcvhf" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac") : secret "image-registry-tls" not found Jun 11 18:31:48.907600 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907597 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:56.907586599 +0000 UTC m=+238.469783180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : secret "router-metrics-certs-default" not found Jun 11 18:31:48.907888 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:48.907627 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:31:56.907616518 +0000 UTC m=+238.469813103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : configmap references non-existent config key: service-ca.crt Jun 11 18:31:49.049724 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:49.049657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gk72q_3e0e60f3-65ad-4766-bc3a-119af36da44e/dns-node-resolver/0.log" Jun 11 18:31:49.649854 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:49.649828 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wgjq_f19f85d6-05a8-4de9-bf42-ba230417e665/node-ca/0.log" Jun 11 18:31:49.669573 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:49.669543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:49.815499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:49.815447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:49.815656 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:49.815532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:49.815656 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:49.815625 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:49.815656 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:49.815644 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:49.815836 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:49.815707 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:53.815688105 +0000 UTC m=+235.377884689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:49.815836 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:49.815728 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:53.815718588 +0000 UTC m=+235.377915171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : configmap "kube-rbac-proxy" not found Jun 11 18:31:50.452101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:50.452068 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4r6jq_ad96837b-3531-45bf-8a01-7847f58e80fd/serve-healthcheck-canary/0.log" Jun 11 18:31:50.854934 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:50.854900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:51.083613 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:51.083582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:51.185834 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:51.185757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:51.282882 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:51.282850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:51.387233 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:51.387190 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:51.450964 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:51.450898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-cntmr_c0917e79-f652-4d10-acc5-c28f3a83068e/kube-storage-version-migrator-operator/0.log" Jun 11 18:31:51.560870 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:51.560841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:52.135912 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:52.135878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:52.542125 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:52.542099 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:52.941370 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:52.941253 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:53.154288 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:53.154257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:53.343370 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:53.343336 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:53.745212 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:53.745130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:53.846600 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:53.846565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:53.846750 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:53.846676 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:53.846750 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:53.846716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:31:53.846750 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:53.846731 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:01.846717136 +0000 UTC m=+243.408913722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : configmap "kube-rbac-proxy" not found Jun 11 18:31:53.846912 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:53.846820 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:53.846912 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:53.846880 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls podName:c72691ad-a24b-4808-bfd3-0f42ed98b062 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:01.846863999 +0000 UTC m=+243.409060581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2jxsg" (UID: "c72691ad-a24b-4808-bfd3-0f42ed98b062") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:54.345543 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:54.345472 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:54.738521 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:54.738382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:54.800321 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:54.800279 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:55.141866 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:55.141838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:55.538817 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:55.538783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:55.938187 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:55.938112 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:56.337802 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.337773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:56.542955 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.542926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:56.971726 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.971687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:56.971900 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.971751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:56.971900 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.971805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:31:56.971900 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.971837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:56.972020 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:56.971922 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:56.972020 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:56.971942 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle podName:c2c50f08-6ac9-489a-962b-32c36a29e52e nodeName:}" failed. No retries permitted until 2026-06-11 18:32:12.971923746 +0000 UTC m=+254.534120332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle") pod "router-default-64f64c5d4-fwz5h" (UID: "c2c50f08-6ac9-489a-962b-32c36a29e52e") : configmap references non-existent config key: service-ca.crt Jun 11 18:31:56.972020 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:31:56.971966 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls podName:a17b02f2-2e41-4dbd-bfcd-abd2dc81b123 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:12.971955288 +0000 UTC m=+254.534151870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-k4ldg" (UID: "a17b02f2-2e41-4dbd-bfcd-abd2dc81b123") : secret "cluster-monitoring-operator-tls" not found Jun 11 18:31:56.974586 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.974559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"image-registry-654f9745b4-vcvhf\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:56.978267 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:56.978242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c2c50f08-6ac9-489a-962b-32c36a29e52e-metrics-certs\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:31:57.101610 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.101582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:57.142535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.142462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:57.228746 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.228650 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654f9745b4-vcvhf"] Jun 11 18:31:57.232509 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:31:57.232460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1482cf_8c82_4360_aef9_26edf1245dac.slice/crio-dea06be162661a5dbac6a764f582478325cea7fdaf119567d69fe287c52b4dfc WatchSource:0}: Error finding container dea06be162661a5dbac6a764f582478325cea7fdaf119567d69fe287c52b4dfc: Status 404 returned error can't find the container with id dea06be162661a5dbac6a764f582478325cea7fdaf119567d69fe287c52b4dfc Jun 11 18:31:57.368845 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.368812 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:57.547875 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.547844 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:57.593058 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.593029 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" event={"ID":"6b1482cf-8c82-4360-aef9-26edf1245dac","Type":"ContainerStarted","Data":"9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881"} Jun 11 18:31:57.593199 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.593074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" event={"ID":"6b1482cf-8c82-4360-aef9-26edf1245dac","Type":"ContainerStarted","Data":"dea06be162661a5dbac6a764f582478325cea7fdaf119567d69fe287c52b4dfc"} Jun 11 18:31:57.593199 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.593103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:31:57.612310 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.612263 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" podStartSLOduration=16.612246041 podStartE2EDuration="16.612246041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:57.610904719 +0000 UTC m=+239.173101319" watchObservedRunningTime="2026-06-11 18:31:57.612246041 +0000 UTC m=+239.174442647" Jun 11 18:31:57.938040 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:57.937949 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:58.141606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:58.141569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:58.737894 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:58.737867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:58.917161 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:58.917135 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:59.137170 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:59.137112 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:59.341917 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:59.341884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:31:59.736283 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:31:59.736248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:00.124758 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:00.124721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:00.534875 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:00.534838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:00.937919 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:00.937835 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:01.142230 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.142192 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:01.346862 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.346829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:01.547999 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.547965 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:01.913683 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.913645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:32:01.913683 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.913690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:32:01.914273 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.914255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c72691ad-a24b-4808-bfd3-0f42ed98b062-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:32:01.916012 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.915995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c72691ad-a24b-4808-bfd3-0f42ed98b062-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2jxsg\" (UID: \"c72691ad-a24b-4808-bfd3-0f42ed98b062\") " pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:32:01.967088 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.967055 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrdf4\"" Jun 11 18:32:01.975389 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:01.975362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2jxsg" Jun 11 18:32:02.100821 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:02.100738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2jxsg"] Jun 11 18:32:02.103293 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:02.103263 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72691ad_a24b_4808_bfd3_0f42ed98b062.slice/crio-3840da660f834d95396c294ed20ed87a39da0667251a50ceeca1a02b8f9ea5fe WatchSource:0}: Error finding container 3840da660f834d95396c294ed20ed87a39da0667251a50ceeca1a02b8f9ea5fe: Status 404 returned error can't find the container with id 3840da660f834d95396c294ed20ed87a39da0667251a50ceeca1a02b8f9ea5fe Jun 11 18:32:02.610581 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:02.610465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jxsg" event={"ID":"c72691ad-a24b-4808-bfd3-0f42ed98b062","Type":"ContainerStarted","Data":"3840da660f834d95396c294ed20ed87a39da0667251a50ceeca1a02b8f9ea5fe"} Jun 11 18:32:04.280444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:04.280407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:04.374003 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:04.373962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:04.429953 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:04.429925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:04.563405 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:04.563317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:04.738425 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:04.738397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:04.796561 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:04.796524 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:05.201872 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.201839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:05.293146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.293109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:05.380658 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.380633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:05.481895 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.481811 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:05.619928 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.619896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jxsg" event={"ID":"c72691ad-a24b-4808-bfd3-0f42ed98b062","Type":"ContainerStarted","Data":"cc8bd559aac566fdb2a16fa9dc4a1b9ca22471870ca37b05fc7c7e3af9e22c37"} Jun 11 18:32:05.748164 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.748066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:05.950748 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:05.950717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:06.161567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:06.161534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:06.624982 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:06.624943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jxsg" event={"ID":"c72691ad-a24b-4808-bfd3-0f42ed98b062","Type":"ContainerStarted","Data":"6dc362dfa4abe276c6442090889d8a67e91d8a6d2fb6f4e275554add8bc90aea"} Jun 11 18:32:07.570067 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:07.570046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:07.628041 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:07.628001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:08.635307 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:08.635263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2jxsg" event={"ID":"c72691ad-a24b-4808-bfd3-0f42ed98b062","Type":"ContainerStarted","Data":"5f83b1645faa38b3310f09e7da3f19023f5407394622e7e8c8514f708034ce68"} Jun 11 18:32:08.652940 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:08.652880 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2jxsg" podStartSLOduration=17.300170377 podStartE2EDuration="22.652867064s" totalImagesPullingTime="5.352696687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:31:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:08.651673261 +0000 UTC m=+250.213869892" watchObservedRunningTime="2026-06-11 18:32:08.652867064 +0000 UTC m=+250.215063667" Jun 11 18:32:09.721459 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.721423 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654f9745b4-vcvhf"] Jun 11 18:32:09.744115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.744089 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6846986bdf-k8mt6"] Jun 11 18:32:09.746020 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.746004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.774343 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.774318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6846986bdf-k8mt6"] Jun 11 18:32:09.872398 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.872365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:09.876559 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-registry-tls\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876639 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d5e5cc9-e1b1-4852-b051-dce24807001f-registry-certificates\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876639 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d5e5cc9-e1b1-4852-b051-dce24807001f-installation-pull-secrets\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876717 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkpmp\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-kube-api-access-bkpmp\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876717 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d5e5cc9-e1b1-4852-b051-dce24807001f-trusted-ca\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876786 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d5e5cc9-e1b1-4852-b051-dce24807001f-image-registry-private-configuration\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876786 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d5e5cc9-e1b1-4852-b051-dce24807001f-ca-trust-extracted\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.876866 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.876838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-bound-sa-token\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.973064 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.972954 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:09.977389 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-bound-sa-token\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977458 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-registry-tls\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977508 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d5e5cc9-e1b1-4852-b051-dce24807001f-registry-certificates\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977556 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d5e5cc9-e1b1-4852-b051-dce24807001f-installation-pull-secrets\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977598 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkpmp\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-kube-api-access-bkpmp\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977598 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977592 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d5e5cc9-e1b1-4852-b051-dce24807001f-trusted-ca\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977693 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d5e5cc9-e1b1-4852-b051-dce24807001f-image-registry-private-configuration\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.977835 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.977788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d5e5cc9-e1b1-4852-b051-dce24807001f-ca-trust-extracted\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.978213 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.978191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d5e5cc9-e1b1-4852-b051-dce24807001f-ca-trust-extracted\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.978460 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.978435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d5e5cc9-e1b1-4852-b051-dce24807001f-registry-certificates\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.978556 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.978461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d5e5cc9-e1b1-4852-b051-dce24807001f-trusted-ca\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.980013 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.979984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d5e5cc9-e1b1-4852-b051-dce24807001f-image-registry-private-configuration\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.980013 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.979992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-registry-tls\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.980183 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.980143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d5e5cc9-e1b1-4852-b051-dce24807001f-installation-pull-secrets\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.985075 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.985048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-bound-sa-token\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:09.985686 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:09.985664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkpmp\" (UniqueName: \"kubernetes.io/projected/3d5e5cc9-e1b1-4852-b051-dce24807001f-kube-api-access-bkpmp\") pod \"image-registry-6846986bdf-k8mt6\" (UID: \"3d5e5cc9-e1b1-4852-b051-dce24807001f\") " pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:10.054426 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.054396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:10.178966 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.178932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6846986bdf-k8mt6"] Jun 11 18:32:10.181941 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:10.181914 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5e5cc9_e1b1_4852_b051_dce24807001f.slice/crio-b4a8f3d706dacf433c06b7c69588a58edb9851f5ddbcea615045b7142bf7765a WatchSource:0}: Error finding container b4a8f3d706dacf433c06b7c69588a58edb9851f5ddbcea615045b7142bf7765a: Status 404 returned error can't find the container with id b4a8f3d706dacf433c06b7c69588a58edb9851f5ddbcea615045b7142bf7765a Jun 11 18:32:10.646361 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.646322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" event={"ID":"3d5e5cc9-e1b1-4852-b051-dce24807001f","Type":"ContainerStarted","Data":"ef04d4a5bb374033b346a281d773217018f012bfa853e444cd6570fd284440de"} Jun 11 18:32:10.646549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.646415 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" event={"ID":"3d5e5cc9-e1b1-4852-b051-dce24807001f","Type":"ContainerStarted","Data":"b4a8f3d706dacf433c06b7c69588a58edb9851f5ddbcea615045b7142bf7765a"} Jun 11 18:32:10.646549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.646474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:10.665379 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.665320 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podStartSLOduration=1.66530494 podStartE2EDuration="1.66530494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:10.664829668 +0000 UTC m=+252.227026273" watchObservedRunningTime="2026-06-11 18:32:10.66530494 +0000 UTC m=+252.227501543" Jun 11 18:32:10.683241 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.683217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:32:10.685470 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.685442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81e97285-de0c-40d4-8a68-fa7c2408b535-metrics-certs\") pod \"network-metrics-daemon-8hpjf\" (UID: \"81e97285-de0c-40d4-8a68-fa7c2408b535\") " pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:32:10.976319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.976239 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7h7l\"" Jun 11 18:32:10.985086 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:10.985061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hpjf" Jun 11 18:32:11.107300 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:11.107268 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hpjf"] Jun 11 18:32:11.109992 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:11.109965 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e97285_de0c_40d4_8a68_fa7c2408b535.slice/crio-b3ea4286ef4fcd8d7dd70c8b52cf8340eb2ac28a24e8acd4a043f45bdfb771c7 WatchSource:0}: Error finding container b3ea4286ef4fcd8d7dd70c8b52cf8340eb2ac28a24e8acd4a043f45bdfb771c7: Status 404 returned error can't find the container with id b3ea4286ef4fcd8d7dd70c8b52cf8340eb2ac28a24e8acd4a043f45bdfb771c7 Jun 11 18:32:11.455007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:11.454979 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:11.556116 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:11.556081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:11.651573 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:11.651536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hpjf" event={"ID":"81e97285-de0c-40d4-8a68-fa7c2408b535","Type":"ContainerStarted","Data":"b3ea4286ef4fcd8d7dd70c8b52cf8340eb2ac28a24e8acd4a043f45bdfb771c7"} Jun 11 18:32:12.656214 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:12.656181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hpjf" event={"ID":"81e97285-de0c-40d4-8a68-fa7c2408b535","Type":"ContainerStarted","Data":"ed6fe9adcc463b250d2904884f748dfc5593fc41c5d2daf4a72042ad1ffd793d"} Jun 11 18:32:12.656653 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:12.656233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hpjf" event={"ID":"81e97285-de0c-40d4-8a68-fa7c2408b535","Type":"ContainerStarted","Data":"8e310fafdae4d03f061c9aa55a3e9553c4a63b95a420247be15deb4990a1c0b0"} Jun 11 18:32:12.672215 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:12.672168 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8hpjf" podStartSLOduration=253.59252921 podStartE2EDuration="4m14.672153308s" totalImagesPullingTime="1.079624098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:12.670867116 +0000 UTC m=+254.233063735" watchObservedRunningTime="2026-06-11 18:32:12.672153308 +0000 UTC m=+254.234349934" Jun 11 18:32:12.757697 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:12.757666 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:12.815559 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:12.815532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:13.003147 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.003125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:13.003295 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.003171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:32:13.003784 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.003763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c50f08-6ac9-489a-962b-32c36a29e52e-service-ca-bundle\") pod \"router-default-64f64c5d4-fwz5h\" (UID: \"c2c50f08-6ac9-489a-962b-32c36a29e52e\") " pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:13.005433 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.005416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a17b02f2-2e41-4dbd-bfcd-abd2dc81b123-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-k4ldg\" (UID: \"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:32:13.014892 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.014874 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tk5hf\"" Jun 11 18:32:13.022773 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.022758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:13.145888 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.145858 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f64c5d4-fwz5h"] Jun 11 18:32:13.148589 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:13.148560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c50f08_6ac9_489a_962b_32c36a29e52e.slice/crio-f5e06310b4159e5a68d32c886f1b178cbce89fe4cffc7bcfd1d429adda8a56c7 WatchSource:0}: Error finding container f5e06310b4159e5a68d32c886f1b178cbce89fe4cffc7bcfd1d429adda8a56c7: Status 404 returned error can't find the container with id f5e06310b4159e5a68d32c886f1b178cbce89fe4cffc7bcfd1d429adda8a56c7 Jun 11 18:32:13.298983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.298901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xs6ct\"" Jun 11 18:32:13.306858 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.306835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" Jun 11 18:32:13.433555 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.433529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg"] Jun 11 18:32:13.434118 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.434093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:13.435967 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:13.435941 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17b02f2_2e41_4dbd_bfcd_abd2dc81b123.slice/crio-a09ffabeb351e065a0df836605e46d516534f56fda662dfdcbb67baf07f041b6 WatchSource:0}: Error finding container a09ffabeb351e065a0df836605e46d516534f56fda662dfdcbb67baf07f041b6: Status 404 returned error can't find the container with id a09ffabeb351e065a0df836605e46d516534f56fda662dfdcbb67baf07f041b6 Jun 11 18:32:13.531638 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.531609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:13.660679 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.660592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" event={"ID":"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123","Type":"ContainerStarted","Data":"a09ffabeb351e065a0df836605e46d516534f56fda662dfdcbb67baf07f041b6"} Jun 11 18:32:13.662163 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.662139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" event={"ID":"c2c50f08-6ac9-489a-962b-32c36a29e52e","Type":"ContainerStarted","Data":"2fad8f700697073d15a941a27597b658eac8aa68c931df8d5139c92ef6b1b83d"} Jun 11 18:32:13.662298 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.662178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" event={"ID":"c2c50f08-6ac9-489a-962b-32c36a29e52e","Type":"ContainerStarted","Data":"f5e06310b4159e5a68d32c886f1b178cbce89fe4cffc7bcfd1d429adda8a56c7"} Jun 11 18:32:13.681376 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:13.681323 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" podStartSLOduration=32.681309619 podStartE2EDuration="32.681309619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:13.680996163 +0000 UTC m=+255.243192766" watchObservedRunningTime="2026-06-11 18:32:13.681309619 +0000 UTC m=+255.243506201" Jun 11 18:32:14.023989 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:14.023959 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:14.026557 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:14.026535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:14.669876 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:14.669847 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:14.674772 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:14.674746 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64f64c5d4-fwz5h" Jun 11 18:32:15.683502 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:15.683456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:15.751282 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:15.751248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:15.818112 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:15.818075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:16.050317 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.050288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:16.150097 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.150074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:16.508579 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.508531 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:16.612312 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.612279 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:16.677923 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.677888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" event={"ID":"a17b02f2-2e41-4dbd-bfcd-abd2dc81b123","Type":"ContainerStarted","Data":"fbd7d0a983a33835fd942519122eedba561905adbe59a77bc65f559bf62ccf23"} Jun 11 18:32:16.679091 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.679069 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:16.698373 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.698329 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-k4ldg" podStartSLOduration=33.03704181 podStartE2EDuration="35.698315868s" totalImagesPullingTime="2.661274058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:16.696881506 +0000 UTC m=+258.259078111" watchObservedRunningTime="2026-06-11 18:32:16.698315868 +0000 UTC m=+258.260512472" Jun 11 18:32:16.846698 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:16.846609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:18.579249 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.579216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:18.679631 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.679593 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:18.707063 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.707032 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv"] Jun 11 18:32:18.712313 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.712297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.715911 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.715879 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 18:32:18.715911 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.715891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 18:32:18.716107 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.715891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pt5hc\"" Jun 11 18:32:18.716107 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.715935 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 18:32:18.720157 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.720136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv"] Jun 11 18:32:18.743932 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.743905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.744069 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.743936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.744069 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.743963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqp2v\" (UniqueName: \"kubernetes.io/projected/e8e8130c-aa8b-4e69-8423-27110ec8b562-kube-api-access-bqp2v\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.744069 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.744042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e8130c-aa8b-4e69-8423-27110ec8b562-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.777070 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.777045 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:18.844423 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.844338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.844423 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.844379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.844662 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.844424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqp2v\" (UniqueName: \"kubernetes.io/projected/e8e8130c-aa8b-4e69-8423-27110ec8b562-kube-api-access-bqp2v\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.844662 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.844469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e8130c-aa8b-4e69-8423-27110ec8b562-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.844662 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:32:18.844479 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 18:32:18.844662 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:32:18.844554 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-tls podName:e8e8130c-aa8b-4e69-8423-27110ec8b562 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:19.344538229 +0000 UTC m=+260.906734811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-49xdv" (UID: "e8e8130c-aa8b-4e69-8423-27110ec8b562") : secret "prometheus-operator-tls" not found Jun 11 18:32:18.845187 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.845165 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8e8130c-aa8b-4e69-8423-27110ec8b562-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.846898 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.846878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:18.853313 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:18.853293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqp2v\" (UniqueName: \"kubernetes.io/projected/e8e8130c-aa8b-4e69-8423-27110ec8b562-kube-api-access-bqp2v\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:19.069653 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.069622 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:19.347728 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.347698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:19.350012 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.349985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8e8130c-aa8b-4e69-8423-27110ec8b562-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-49xdv\" (UID: \"e8e8130c-aa8b-4e69-8423-27110ec8b562\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:19.621440 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.621352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" Jun 11 18:32:19.727571 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.727537 2576 patch_prober.go:28] interesting pod/image-registry-654f9745b4-vcvhf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:19.727719 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.727596 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:19.752462 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:19.752429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv"] Jun 11 18:32:19.755521 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:19.755483 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e8130c_aa8b_4e69_8423_27110ec8b562.slice/crio-a13cca03ee03135dcbb12e5bee1c6a66a7e6dbc391f96a0da11ec747993aafa6 WatchSource:0}: Error finding container a13cca03ee03135dcbb12e5bee1c6a66a7e6dbc391f96a0da11ec747993aafa6: Status 404 returned error can't find the container with id a13cca03ee03135dcbb12e5bee1c6a66a7e6dbc391f96a0da11ec747993aafa6 Jun 11 18:32:20.694179 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:20.694138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" event={"ID":"e8e8130c-aa8b-4e69-8423-27110ec8b562","Type":"ContainerStarted","Data":"a13cca03ee03135dcbb12e5bee1c6a66a7e6dbc391f96a0da11ec747993aafa6"} Jun 11 18:32:20.789573 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:20.789527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:20.844595 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:20.844559 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:21.195205 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:21.195171 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:21.699581 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:21.699548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" event={"ID":"e8e8130c-aa8b-4e69-8423-27110ec8b562","Type":"ContainerStarted","Data":"6cd0084ade1287e7596cfd5adc4c1c5ab838e95ae5b9bdda7f2370cef1046d78"} Jun 11 18:32:21.699931 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:21.699600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" event={"ID":"e8e8130c-aa8b-4e69-8423-27110ec8b562","Type":"ContainerStarted","Data":"43061daf54d7a07e9c05d254418164851c4a97719aa2a28c7dea84bf64d6428d"} Jun 11 18:32:21.715654 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:21.715600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-49xdv" podStartSLOduration=2.551973068 podStartE2EDuration="3.715581897s" totalImagesPullingTime="1.163608829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:21.715118019 +0000 UTC m=+263.277314623" watchObservedRunningTime="2026-06-11 18:32:21.715581897 +0000 UTC m=+263.277778500" Jun 11 18:32:23.637734 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:23.637698 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:23.868043 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:23.867991 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:23.953106 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:23.953001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.082148 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.082119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.185815 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.185781 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.196535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.196501 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-krz2j"] Jun 11 18:32:24.200162 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.200144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.202542 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.202520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 18:32:24.202640 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.202547 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w5qd2\"" Jun 11 18:32:24.202685 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.202663 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 18:32:24.202725 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.202690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 18:32:24.281581 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.281554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.285639 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-textfile\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285728 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44b40c-9116-4876-82ba-88642c25f42a-metrics-client-ca\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285728 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285798 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-sys\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285798 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms5cz\" (UniqueName: \"kubernetes.io/projected/3c44b40c-9116-4876-82ba-88642c25f42a-kube-api-access-ms5cz\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285870 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-tls\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285870 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-accelerators-collector-config\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285870 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-wtmp\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.285963 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.285905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-root\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.378801 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.378767 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.386908 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.386880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-sys\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387002 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.386919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms5cz\" (UniqueName: \"kubernetes.io/projected/3c44b40c-9116-4876-82ba-88642c25f42a-kube-api-access-ms5cz\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387002 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.386973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-tls\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387002 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.386987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-sys\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.386998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-accelerators-collector-config\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-wtmp\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-root\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-textfile\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44b40c-9116-4876-82ba-88642c25f42a-metrics-client-ca\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387400 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387400 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-root\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387400 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-wtmp\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387584 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-textfile\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387662 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387647 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-accelerators-collector-config\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.387707 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.387687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c44b40c-9116-4876-82ba-88642c25f42a-metrics-client-ca\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.389362 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.389345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.389472 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.389455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c44b40c-9116-4876-82ba-88642c25f42a-node-exporter-tls\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.394704 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.394684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms5cz\" (UniqueName: \"kubernetes.io/projected/3c44b40c-9116-4876-82ba-88642c25f42a-kube-api-access-ms5cz\") pod \"node-exporter-krz2j\" (UID: \"3c44b40c-9116-4876-82ba-88642c25f42a\") " pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.482095 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.482021 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.509175 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.509145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krz2j" Jun 11 18:32:24.520194 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:24.520168 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c44b40c_9116_4876_82ba_88642c25f42a.slice/crio-93e85ee3b7b2fc7e8225ff9bd9303494859f0d7d2c485e9839b9d464da1d4f00 WatchSource:0}: Error finding container 93e85ee3b7b2fc7e8225ff9bd9303494859f0d7d2c485e9839b9d464da1d4f00: Status 404 returned error can't find the container with id 93e85ee3b7b2fc7e8225ff9bd9303494859f0d7d2c485e9839b9d464da1d4f00 Jun 11 18:32:24.579596 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.579566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.656075 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.656046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:24.710255 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.710220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krz2j" event={"ID":"3c44b40c-9116-4876-82ba-88642c25f42a","Type":"ContainerStarted","Data":"93e85ee3b7b2fc7e8225ff9bd9303494859f0d7d2c485e9839b9d464da1d4f00"} Jun 11 18:32:24.965090 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:24.965059 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:25.134435 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:25.134369 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:25.218766 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:25.218681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:25.560521 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:25.560474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:25.715446 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:25.715416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krz2j" event={"ID":"3c44b40c-9116-4876-82ba-88642c25f42a","Type":"ContainerStarted","Data":"f67624f06471a7073ba4065a90a862cb3bb5daa784bcb7ae03b4d1775676e1e1"} Jun 11 18:32:26.137733 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.137693 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-99dd59f7-grw52"] Jun 11 18:32:26.141151 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.141128 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.146101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.146073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 18:32:26.146351 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.146331 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 18:32:26.146452 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.146371 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wbdtl\"" Jun 11 18:32:26.146847 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.146827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 18:32:26.147089 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.147058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-l8hngbagfqf8\"" Jun 11 18:32:26.147146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.147102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 18:32:26.147682 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.147664 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 18:32:26.162385 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.162359 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99dd59f7-grw52"] Jun 11 18:32:26.204232 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204365 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204365 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204365 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-metrics-client-ca\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204365 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204525 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-grpc-tls\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204525 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-tls\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.204525 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.204470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbkng\" (UniqueName: \"kubernetes.io/projected/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-kube-api-access-fbkng\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.304979 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.304942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-tls\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305152 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.304988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbkng\" (UniqueName: \"kubernetes.io/projected/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-kube-api-access-fbkng\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305152 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305152 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305152 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305152 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-metrics-client-ca\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305386 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-grpc-tls\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.305989 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.305951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-metrics-client-ca\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.307756 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.307729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.307905 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.307884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.307993 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.307951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-tls\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.308237 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.308216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.308332 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.308313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.308467 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.308447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-secret-grpc-tls\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.313932 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.313912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbkng\" (UniqueName: \"kubernetes.io/projected/800a4a2b-239a-4ec5-9aa1-dd86c2027dda-kube-api-access-fbkng\") pod \"thanos-querier-99dd59f7-grw52\" (UID: \"800a4a2b-239a-4ec5-9aa1-dd86c2027dda\") " pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.449743 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.449657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:26.575649 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.575625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-99dd59f7-grw52"] Jun 11 18:32:26.577668 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:26.577639 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800a4a2b_239a_4ec5_9aa1_dd86c2027dda.slice/crio-6dd71c8f934ef8dccf6c7b0ba144f9f2d2fd988cd688e4b6046ae512fc095ddc WatchSource:0}: Error finding container 6dd71c8f934ef8dccf6c7b0ba144f9f2d2fd988cd688e4b6046ae512fc095ddc: Status 404 returned error can't find the container with id 6dd71c8f934ef8dccf6c7b0ba144f9f2d2fd988cd688e4b6046ae512fc095ddc Jun 11 18:32:26.720128 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.720049 2576 generic.go:356] "Generic (PLEG): container finished" podID="3c44b40c-9116-4876-82ba-88642c25f42a" containerID="f67624f06471a7073ba4065a90a862cb3bb5daa784bcb7ae03b4d1775676e1e1" exitCode=0 Jun 11 18:32:26.720549 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.720134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krz2j" event={"ID":"3c44b40c-9116-4876-82ba-88642c25f42a","Type":"ContainerDied","Data":"f67624f06471a7073ba4065a90a862cb3bb5daa784bcb7ae03b4d1775676e1e1"} Jun 11 18:32:26.721366 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:26.721346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"6dd71c8f934ef8dccf6c7b0ba144f9f2d2fd988cd688e4b6046ae512fc095ddc"} Jun 11 18:32:27.109046 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.109015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:27.209314 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.209266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:27.546558 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.546523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:27.697814 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.697775 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:27.728293 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.728261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krz2j" event={"ID":"3c44b40c-9116-4876-82ba-88642c25f42a","Type":"ContainerStarted","Data":"202a59e7346b0bf76680d7da1b19f88460063d81542ffa3c242903340c853a67"} Jun 11 18:32:27.728736 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.728319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krz2j" event={"ID":"3c44b40c-9116-4876-82ba-88642c25f42a","Type":"ContainerStarted","Data":"22f85340ed00bd8b7ee32f3dfe859371dc0007f92ef1f70066151cbffe5fdeb0"} Jun 11 18:32:27.748428 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.748374 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-krz2j" podStartSLOduration=2.557941623 podStartE2EDuration="3.748357364s" totalImagesPullingTime="1.125710901s" totalInitContainerRuntime="64.70484ms" isStatefulPod=true podCreationTimestamp="2026-06-11 18:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:27.7463193 +0000 UTC m=+269.308515904" watchObservedRunningTime="2026-06-11 18:32:27.748357364 +0000 UTC m=+269.310553967" Jun 11 18:32:27.974038 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:27.973944 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:28.025195 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.025158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:28.556903 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.556872 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64cc67bd4b-lvdbk"] Jun 11 18:32:28.559659 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.559643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.563695 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.563667 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 18:32:28.563695 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.563690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7m2v6g61qucjm\"" Jun 11 18:32:28.563945 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.563924 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 18:32:28.564064 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.564024 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 18:32:28.564132 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.564085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 18:32:28.564184 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.564135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2d9w5\"" Jun 11 18:32:28.570381 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.570360 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64cc67bd4b-lvdbk"] Jun 11 18:32:28.627240 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pc4h\" (UniqueName: \"kubernetes.io/projected/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-kube-api-access-2pc4h\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.627309 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-secret-metrics-server-tls\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.627358 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-audit-log\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.627395 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.627436 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-secret-metrics-server-client-certs\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.627497 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-client-ca-bundle\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.627548 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.627534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-metrics-server-audit-profiles\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.728730 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-secret-metrics-server-client-certs\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-client-ca-bundle\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-metrics-server-audit-profiles\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pc4h\" (UniqueName: \"kubernetes.io/projected/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-kube-api-access-2pc4h\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-secret-metrics-server-tls\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.728923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-audit-log\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729529 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.729483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-audit-log\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729914 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.729893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-metrics-server-audit-profiles\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.729995 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.729918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.731341 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.731311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-client-ca-bundle\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.731437 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.731420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-secret-metrics-server-tls\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.731512 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.731454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-secret-metrics-server-client-certs\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.733704 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.733604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"009c61503ccd434ddc86a308e03bc32933857bce4a097e7c5c9b3b2999b3f597"} Jun 11 18:32:28.736765 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.736746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pc4h\" (UniqueName: \"kubernetes.io/projected/e4d5c79d-5b54-405d-b7db-9e15b14eb3ca-kube-api-access-2pc4h\") pod \"metrics-server-64cc67bd4b-lvdbk\" (UID: \"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca\") " pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.870376 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.870287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:28.901476 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.901389 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:28.942382 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.942349 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c85bc6d66-tn9dr"] Jun 11 18:32:28.946496 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.946452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:28.948870 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.948847 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 18:32:28.949042 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949021 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 18:32:28.949166 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949143 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 18:32:28.949236 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949204 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 18:32:28.949403 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 18:32:28.949507 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949420 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 18:32:28.949693 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rx75w\"" Jun 11 18:32:28.949789 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.949706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 18:32:28.953769 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.953727 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c85bc6d66-tn9dr"] Jun 11 18:32:28.954925 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.954903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 18:32:28.970822 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:28.970796 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:29.006073 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.006050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64cc67bd4b-lvdbk"] Jun 11 18:32:29.008144 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:29.008120 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d5c79d_5b54_405d_b7db_9e15b14eb3ca.slice/crio-a9d6d156052f99e808f89203638836a401b051e898c084045b673d1410c6d633 WatchSource:0}: Error finding container a9d6d156052f99e808f89203638836a401b051e898c084045b673d1410c6d633: Status 404 returned error can't find the container with id a9d6d156052f99e808f89203638836a401b051e898c084045b673d1410c6d633 Jun 11 18:32:29.033439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzkb7\" (UniqueName: \"kubernetes.io/projected/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-kube-api-access-xzkb7\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.033439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-serving-cert\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.033678 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-config\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.033678 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-oauth-config\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.033678 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-oauth-serving-cert\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.033678 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-trusted-ca-bundle\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.033678 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.033649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-service-ca\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134723 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-trusted-ca-bundle\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134723 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-service-ca\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzkb7\" (UniqueName: \"kubernetes.io/projected/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-kube-api-access-xzkb7\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-serving-cert\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-config\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-oauth-config\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.134952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.134923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-oauth-serving-cert\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.135481 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.135444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-service-ca\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.135641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.135625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-config\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.135641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.135630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-trusted-ca-bundle\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.135740 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.135634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-oauth-serving-cert\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.137397 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.137372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-oauth-config\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.137511 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.137474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-serving-cert\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.142326 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.142308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzkb7\" (UniqueName: \"kubernetes.io/projected/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-kube-api-access-xzkb7\") pod \"console-6c85bc6d66-tn9dr\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.258387 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.258350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:29.388564 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.388529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c85bc6d66-tn9dr"] Jun 11 18:32:29.390943 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:29.390911 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80072ed4_5a1f_4b72_aeca_64c7f8b3b493.slice/crio-afdd842cb2224f320431938724afb3402511219805b808cc7e3e1696a16b0131 WatchSource:0}: Error finding container afdd842cb2224f320431938724afb3402511219805b808cc7e3e1696a16b0131: Status 404 returned error can't find the container with id afdd842cb2224f320431938724afb3402511219805b808cc7e3e1696a16b0131 Jun 11 18:32:29.529040 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.529000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:29.726523 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.726432 2576 patch_prober.go:28] interesting pod/image-registry-654f9745b4-vcvhf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:29.726523 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.726482 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:29.741788 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.741751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"6f845278b1833863e0db2a663d45d4be3f87d8c36b333f38cef466edcebdce24"} Jun 11 18:32:29.742310 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.741838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"56374da6568e452768b679bebd19c8501c9c69aa0c7ade58bb1344491b7d98bd"} Jun 11 18:32:29.743573 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.743540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85bc6d66-tn9dr" event={"ID":"80072ed4-5a1f-4b72-aeca-64c7f8b3b493","Type":"ContainerStarted","Data":"afdd842cb2224f320431938724afb3402511219805b808cc7e3e1696a16b0131"} Jun 11 18:32:29.744938 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:29.744912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" event={"ID":"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca","Type":"ContainerStarted","Data":"a9d6d156052f99e808f89203638836a401b051e898c084045b673d1410c6d633"} Jun 11 18:32:30.062741 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.062644 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:30.062741 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.062702 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:30.414077 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.413948 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:32:30.420353 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.420323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.423279 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.423131 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 18:32:30.423410 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.423384 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 18:32:30.423507 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.423422 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 18:32:30.423507 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.423437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 18:32:30.423691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.423588 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 18:32:30.423691 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.423611 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 18:32:30.424641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.424003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 18:32:30.424641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.424166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 18:32:30.424641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.424168 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 18:32:30.424641 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.424640 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bfm2d4lct5jr6\"" Jun 11 18:32:30.432923 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.432895 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 18:32:30.439243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.439167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g5hm4\"" Jun 11 18:32:30.439974 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.439944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 18:32:30.441937 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.441909 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:32:30.442108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.442090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 18:32:30.444798 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.444731 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:30.445585 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.445544 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 18:32:30.447286 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.447260 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 18:32:30.546437 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546635 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546635 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546635 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546635 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5gzh\" (UniqueName: \"kubernetes.io/projected/9410a766-ec3c-4886-bb10-8bd838b689a8-kube-api-access-c5gzh\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.546869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9410a766-ec3c-4886-bb10-8bd838b689a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-config\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.546997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9410a766-ec3c-4886-bb10-8bd838b689a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.547020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.547041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.547160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.547069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.647970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5gzh\" (UniqueName: \"kubernetes.io/projected/9410a766-ec3c-4886-bb10-8bd838b689a8-kube-api-access-c5gzh\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9410a766-ec3c-4886-bb10-8bd838b689a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-config\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9410a766-ec3c-4886-bb10-8bd838b689a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.649036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.650007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.650007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.650007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.650007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.648745 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.650007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.649191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.650007 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.649790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.651796 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.651356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.653497 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.653456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.653831 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.653807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.654228 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.654182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.654322 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.654260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.655316 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.655272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.655406 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.655368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9410a766-ec3c-4886-bb10-8bd838b689a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.655737 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.655712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9410a766-ec3c-4886-bb10-8bd838b689a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.656365 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.656343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.656865 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.656845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.657824 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.657775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.657918 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.657830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.659024 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.659000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.659390 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.659349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9410a766-ec3c-4886-bb10-8bd838b689a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.660004 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.659969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.664239 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.664182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9410a766-ec3c-4886-bb10-8bd838b689a8-config\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.666075 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.666048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5gzh\" (UniqueName: \"kubernetes.io/projected/9410a766-ec3c-4886-bb10-8bd838b689a8-kube-api-access-c5gzh\") pod \"prometheus-k8s-0\" (UID: \"9410a766-ec3c-4886-bb10-8bd838b689a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.745567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.745532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:30.754201 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.754163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"f9564384d25f2e1b12aa3aebf7c93fa1781e6dc23607f2f1d8a7046bd6fffd9f"} Jun 11 18:32:30.754332 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.754245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"778b5e00a1009c4f8addf0105d661b5914b5ccefb8a1d4ac99906c4bb1dde67d"} Jun 11 18:32:30.754332 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.754284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" event={"ID":"800a4a2b-239a-4ec5-9aa1-dd86c2027dda","Type":"ContainerStarted","Data":"784f4ee304dbea0a592fffcea1cd5bf59d026695c85cd9a14e486d00e8df4d75"} Jun 11 18:32:30.754332 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.754323 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:30.778280 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.777789 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" podStartSLOduration=1.729204293 podStartE2EDuration="4.777765696s" totalImagesPullingTime="3.048561403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:30.776726131 +0000 UTC m=+272.338922736" watchObservedRunningTime="2026-06-11 18:32:30.777765696 +0000 UTC m=+272.339962301" Jun 11 18:32:30.939778 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:30.939622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 18:32:30.943431 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:30.943398 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9410a766_ec3c_4886_bb10_8bd838b689a8.slice/crio-efdc9d4e6fcdbe8ce7aef7c17237346baca55e52d919ea2fbbd3a04701832140 WatchSource:0}: Error finding container efdc9d4e6fcdbe8ce7aef7c17237346baca55e52d919ea2fbbd3a04701832140: Status 404 returned error can't find the container with id efdc9d4e6fcdbe8ce7aef7c17237346baca55e52d919ea2fbbd3a04701832140 Jun 11 18:32:31.657076 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:31.657042 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:31.657236 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:31.657096 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:31.760743 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:31.760703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" event={"ID":"e4d5c79d-5b54-405d-b7db-9e15b14eb3ca","Type":"ContainerStarted","Data":"65611c07b18853d67cef95fbfb9ee22b28248a34946f4c631a2fd03047cc8bbf"} Jun 11 18:32:31.762268 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:31.762239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"efdc9d4e6fcdbe8ce7aef7c17237346baca55e52d919ea2fbbd3a04701832140"} Jun 11 18:32:31.780567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:31.779953 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" podStartSLOduration=1.963130051 podStartE2EDuration="3.779933465s" totalImagesPullingTime="1.816803414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:31.77881024 +0000 UTC m=+273.341006847" watchObservedRunningTime="2026-06-11 18:32:31.779933465 +0000 UTC m=+273.342130070" Jun 11 18:32:32.767665 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:32.767628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85bc6d66-tn9dr" event={"ID":"80072ed4-5a1f-4b72-aeca-64c7f8b3b493","Type":"ContainerStarted","Data":"6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437"} Jun 11 18:32:32.786406 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:32.786359 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c85bc6d66-tn9dr" podStartSLOduration=1.636114757 podStartE2EDuration="4.786343719s" totalImagesPullingTime="3.150228962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:32.784453939 +0000 UTC m=+274.346650545" watchObservedRunningTime="2026-06-11 18:32:32.786343719 +0000 UTC m=+274.348540322" Jun 11 18:32:34.740243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:34.740129 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerName="registry" containerID="cri-o://9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881" gracePeriod=30 Jun 11 18:32:34.778422 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:34.778395 2576 generic.go:356] "Generic (PLEG): container finished" podID="9410a766-ec3c-4886-bb10-8bd838b689a8" containerID="79518755f58ac4f305cfb78cca37482aa16f0a0a328abf94fb5fbb0b11cb6fd2" exitCode=0 Jun 11 18:32:34.778593 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:34.778446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerDied","Data":"79518755f58ac4f305cfb78cca37482aa16f0a0a328abf94fb5fbb0b11cb6fd2"} Jun 11 18:32:34.977031 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:34.977004 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:32:35.087845 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.087813 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-image-registry-private-configuration\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.087845 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.087851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-installation-pull-secrets\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.087910 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.087949 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-trusted-ca\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.088006 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grntj\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-kube-api-access-grntj\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.088050 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-certificates\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.088081 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-bound-sa-token\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088325 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.088107 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1482cf-8c82-4360-aef9-26edf1245dac-ca-trust-extracted\") pod \"6b1482cf-8c82-4360-aef9-26edf1245dac\" (UID: \"6b1482cf-8c82-4360-aef9-26edf1245dac\") " Jun 11 18:32:35.088694 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.088620 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:32:35.088694 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.088653 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:32:35.090262 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.090239 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:32:35.090418 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.090393 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:32:35.090535 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.090454 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:32:35.090587 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.090570 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-kube-api-access-grntj" (OuterVolumeSpecName: "kube-api-access-grntj") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "kube-api-access-grntj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:32:35.090632 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.090590 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:32:35.096632 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.096609 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b1482cf-8c82-4360-aef9-26edf1245dac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b1482cf-8c82-4360-aef9-26edf1245dac" (UID: "6b1482cf-8c82-4360-aef9-26edf1245dac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:32:35.188960 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.188917 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grntj\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-kube-api-access-grntj\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.188960 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.188957 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-certificates\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.189167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.188973 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-bound-sa-token\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.189167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.188985 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b1482cf-8c82-4360-aef9-26edf1245dac-ca-trust-extracted\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.189167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.188999 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-image-registry-private-configuration\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.189167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.189013 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b1482cf-8c82-4360-aef9-26edf1245dac-installation-pull-secrets\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.189167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.189027 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b1482cf-8c82-4360-aef9-26edf1245dac-registry-tls\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.189167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.189039 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b1482cf-8c82-4360-aef9-26edf1245dac-trusted-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:32:35.784759 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.784727 2576 generic.go:356] "Generic (PLEG): container finished" podID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerID="9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881" exitCode=0 Jun 11 18:32:35.785201 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.784775 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" Jun 11 18:32:35.785201 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.784819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" event={"ID":"6b1482cf-8c82-4360-aef9-26edf1245dac","Type":"ContainerDied","Data":"9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881"} Jun 11 18:32:35.785201 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.784869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654f9745b4-vcvhf" event={"ID":"6b1482cf-8c82-4360-aef9-26edf1245dac","Type":"ContainerDied","Data":"dea06be162661a5dbac6a764f582478325cea7fdaf119567d69fe287c52b4dfc"} Jun 11 18:32:35.785201 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.784911 2576 scope.go:117] "RemoveContainer" containerID="9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881" Jun 11 18:32:35.795279 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.795252 2576 scope.go:117] "RemoveContainer" containerID="9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881" Jun 11 18:32:35.795642 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:32:35.795613 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881\": container with ID starting with 9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881 not found: ID does not exist" containerID="9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881" Jun 11 18:32:35.795720 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.795655 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881"} err="failed to get container status \"9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881\": rpc error: code = NotFound desc = could not find container \"9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881\": container with ID starting with 9751de3e53413b6a1b8e6de97ede2431659d5963751bea74bf1a4bd9e80ac881 not found: ID does not exist" Jun 11 18:32:35.807589 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.807459 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654f9745b4-vcvhf"] Jun 11 18:32:35.810948 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:35.810921 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-654f9745b4-vcvhf"] Jun 11 18:32:36.769057 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:36.769029 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-99dd59f7-grw52" Jun 11 18:32:36.879108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:36.879067 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" path="/var/lib/kubelet/pods/6b1482cf-8c82-4360-aef9-26edf1245dac/volumes" Jun 11 18:32:38.801957 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.801916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"17015a10d0c5fcee19d9807199188bf5b54766d51e5b26015f3c956a3dc05613"} Jun 11 18:32:38.802439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.801992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"ff093717ee569102c467f6dc3752bc9c6b0c77e29ff49924c25e76c84a1d4ee0"} Jun 11 18:32:38.802439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.802036 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"4ebd93e8d18bf64579c6af6e813fba9671517537f531059dd97c4291ded57e50"} Jun 11 18:32:38.802439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.802079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"4512f7e08421c6da73ada1bdfa78fb6fd397f8aa49b975c588b29b8cb33dfd62"} Jun 11 18:32:38.802439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.802126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"38669f6b0694d2a35985d86efff8a93b8fb0d93ab306341f0216ac3cfb792661"} Jun 11 18:32:38.802439 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.802163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9410a766-ec3c-4886-bb10-8bd838b689a8","Type":"ContainerStarted","Data":"4d0304fa2a562810486aa5d7443211e765632264c4aa096bb02693e013c4c436"} Jun 11 18:32:38.830741 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:38.830677 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.347659901 podStartE2EDuration="8.830654198s" totalImagesPullingTime="6.464114142s" totalInitContainerRuntime="18.880155ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:38.828161316 +0000 UTC m=+280.390357989" watchObservedRunningTime="2026-06-11 18:32:38.830654198 +0000 UTC m=+280.392850814" Jun 11 18:32:39.259519 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:39.259467 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:39.259671 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:39.259561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:32:39.261064 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:39.261038 2576 patch_prober.go:28] interesting pod/console-6c85bc6d66-tn9dr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 18:32:39.261172 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:39.261083 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c85bc6d66-tn9dr" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 18:32:40.059458 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:40.059423 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:40.059828 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:40.059475 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:40.746648 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:40.746595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:32:41.655871 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:41.655839 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:41.656267 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:41.655888 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:44.115327 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:44.111458 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:44.161907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:44.161875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:44.378663 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:32:44.378553 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7krc7" podUID="9fa2dbd4-57d8-4551-af23-631af026e3f0" Jun 11 18:32:44.823842 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:44.823812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7krc7" Jun 11 18:32:44.946763 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:44.946728 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:44.996885 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:44.996854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:47.302826 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:47.302780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:32:47.305077 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:47.305050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fa2dbd4-57d8-4551-af23-631af026e3f0-metrics-tls\") pod \"dns-default-7krc7\" (UID: \"9fa2dbd4-57d8-4551-af23-631af026e3f0\") " pod="openshift-dns/dns-default-7krc7" Jun 11 18:32:47.526723 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:47.526696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cszq9\"" Jun 11 18:32:47.534747 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:47.534708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7krc7" Jun 11 18:32:47.680060 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:47.680004 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7krc7"] Jun 11 18:32:47.682278 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:32:47.682247 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa2dbd4_57d8_4551_af23_631af026e3f0.slice/crio-1e772ec2320ca656f161e007f787ece32aa64b54fff6066d3a36456d1b01f6c8 WatchSource:0}: Error finding container 1e772ec2320ca656f161e007f787ece32aa64b54fff6066d3a36456d1b01f6c8: Status 404 returned error can't find the container with id 1e772ec2320ca656f161e007f787ece32aa64b54fff6066d3a36456d1b01f6c8 Jun 11 18:32:47.837107 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:47.837071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7krc7" event={"ID":"9fa2dbd4-57d8-4551-af23-631af026e3f0","Type":"ContainerStarted","Data":"1e772ec2320ca656f161e007f787ece32aa64b54fff6066d3a36456d1b01f6c8"} Jun 11 18:32:48.870443 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:48.870409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:48.870955 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:48.870514 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:32:49.259545 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:49.259395 2576 patch_prober.go:28] interesting pod/console-6c85bc6d66-tn9dr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 18:32:49.259713 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:49.259580 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c85bc6d66-tn9dr" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 18:32:50.059994 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.059962 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:50.060462 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.060049 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:50.060462 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.060101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:32:50.060703 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.060680 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"ef04d4a5bb374033b346a281d773217018f012bfa853e444cd6570fd284440de"} pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 18:32:50.064746 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.064714 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:32:50.064878 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.064780 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:32:50.851736 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.851698 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7krc7" event={"ID":"9fa2dbd4-57d8-4551-af23-631af026e3f0","Type":"ContainerStarted","Data":"d7a6bb832318b794ef31dcf670221a34646df1701c3187134e00aadddaeb2e4e"} Jun 11 18:32:50.851927 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.851754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7krc7" event={"ID":"9fa2dbd4-57d8-4551-af23-631af026e3f0","Type":"ContainerStarted","Data":"294d2b790e316df448f80d3e1b0294e5628c1e414b5c1a15b5407c8af9371c11"} Jun 11 18:32:50.851927 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.851829 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7krc7" Jun 11 18:32:50.868917 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:50.868861 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7krc7" podStartSLOduration=251.090868495 podStartE2EDuration="4m13.868848338s" totalImagesPullingTime="2.777979843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:50.868173805 +0000 UTC m=+292.430370409" watchObservedRunningTime="2026-06-11 18:32:50.868848338 +0000 UTC m=+292.431044942" Jun 11 18:32:54.621674 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:54.621639 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:54.681261 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:54.681229 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:32:58.831869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:58.831846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:32:58.832523 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:58.832504 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:32:58.839093 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:58.839074 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 18:32:59.259387 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:59.259357 2576 patch_prober.go:28] interesting pod/console-6c85bc6d66-tn9dr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 18:32:59.261640 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:32:59.259409 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c85bc6d66-tn9dr" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 18:33:00.064871 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:00.064838 2576 patch_prober.go:28] interesting pod/image-registry-6846986bdf-k8mt6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:33:00.065319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:00.064894 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:33:00.857885 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:00.857848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7krc7" Jun 11 18:33:00.893259 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:00.893212 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0917e79-f652-4d10-acc5-c28f3a83068e" containerID="53fe859738c53a28f5a6b4df02a77674332f8c08feb075f9aeca322c2f2f2726" exitCode=0 Jun 11 18:33:00.893426 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:00.893266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" event={"ID":"c0917e79-f652-4d10-acc5-c28f3a83068e","Type":"ContainerDied","Data":"53fe859738c53a28f5a6b4df02a77674332f8c08feb075f9aeca322c2f2f2726"} Jun 11 18:33:00.893667 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:00.893643 2576 scope.go:117] "RemoveContainer" containerID="53fe859738c53a28f5a6b4df02a77674332f8c08feb075f9aeca322c2f2f2726" Jun 11 18:33:01.899263 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:01.899227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-cntmr" event={"ID":"c0917e79-f652-4d10-acc5-c28f3a83068e","Type":"ContainerStarted","Data":"6af5d07c669f1520c08b86a1a5b65ccc34b26489481d1fbfe0a1a9a7572d1de9"} Jun 11 18:33:04.262613 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:04.262579 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:04.911699 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:04.911611 2576 generic.go:356] "Generic (PLEG): container finished" podID="40d3dc8c-e2d0-413a-882c-b1951061a249" containerID="3e34b306b71c89ddfa01c423a4acd6e2128eeb2f46f668225846e04757b83ac3" exitCode=255 Jun 11 18:33:04.911839 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:04.911688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" event={"ID":"40d3dc8c-e2d0-413a-882c-b1951061a249","Type":"ContainerDied","Data":"3e34b306b71c89ddfa01c423a4acd6e2128eeb2f46f668225846e04757b83ac3"} Jun 11 18:33:04.911839 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:04.911741 2576 scope.go:117] "RemoveContainer" containerID="d94b5b920902cf8cd1eae5c0c8395e4b5947b419fc7f91036c978ea7f41c60ba" Jun 11 18:33:04.917893 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:04.917873 2576 scope.go:117] "RemoveContainer" containerID="3e34b306b71c89ddfa01c423a4acd6e2128eeb2f46f668225846e04757b83ac3" Jun 11 18:33:04.918111 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:33:04.918093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs_open-cluster-management-agent-addon(40d3dc8c-e2d0-413a-882c-b1951061a249)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" podUID="40d3dc8c-e2d0-413a-882c-b1951061a249" Jun 11 18:33:05.719502 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:05.719455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:07.171617 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:07.171583 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c85bc6d66-tn9dr"] Jun 11 18:33:07.284645 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:07.284612 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:07.343175 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:07.343143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:07.399874 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:07.399839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:07.640966 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:07.640931 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:07.704023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:07.703992 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:08.858501 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:08.858452 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:08.878619 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:08.878596 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:33:08.882429 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:08.882403 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64cc67bd4b-lvdbk" Jun 11 18:33:08.958378 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:08.958347 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:09.060423 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:09.060392 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:09.115299 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:09.115223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:09.956442 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:09.956409 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-k4ldg_a17b02f2-2e41-4dbd-bfcd-abd2dc81b123/cluster-monitoring-operator/0.log" Jun 11 18:33:10.064829 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:10.064805 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:33:10.189071 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:10.189040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:10.241350 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:10.241268 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:10.754315 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:10.754286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64cc67bd4b-lvdbk_e4d5c79d-5b54-405d-b7db-9e15b14eb3ca/metrics-server/0.log" Jun 11 18:33:11.270270 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:11.270234 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" Jun 11 18:33:11.270676 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:11.270604 2576 scope.go:117] "RemoveContainer" containerID="3e34b306b71c89ddfa01c423a4acd6e2128eeb2f46f668225846e04757b83ac3" Jun 11 18:33:11.270791 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:33:11.270773 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs_open-cluster-management-agent-addon(40d3dc8c-e2d0-413a-882c-b1951061a249)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" podUID="40d3dc8c-e2d0-413a-882c-b1951061a249" Jun 11 18:33:12.354592 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:12.354562 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krz2j_3c44b40c-9116-4876-82ba-88642c25f42a/init-textfile/0.log" Jun 11 18:33:12.556142 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:12.556109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krz2j_3c44b40c-9116-4876-82ba-88642c25f42a/node-exporter/0.log" Jun 11 18:33:12.754645 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:12.754620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krz2j_3c44b40c-9116-4876-82ba-88642c25f42a/kube-rbac-proxy/0.log" Jun 11 18:33:13.430812 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:13.430783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:13.494306 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:13.494281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:13.557848 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:13.557825 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/init-config-reloader/0.log" Jun 11 18:33:13.755686 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:13.755664 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/prometheus/0.log" Jun 11 18:33:13.955527 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:13.955483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/config-reloader/0.log" Jun 11 18:33:14.155146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:14.155071 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/thanos-sidecar/0.log" Jun 11 18:33:14.361599 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:14.361573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/kube-rbac-proxy-web/0.log" Jun 11 18:33:14.555217 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:14.555194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/kube-rbac-proxy/0.log" Jun 11 18:33:14.755346 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:14.755315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/kube-rbac-proxy-thanos/0.log" Jun 11 18:33:14.956239 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:14.956165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-49xdv_e8e8130c-aa8b-4e69-8423-27110ec8b562/prometheus-operator/0.log" Jun 11 18:33:15.082222 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:15.082177 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" podUID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerName="registry" containerID="cri-o://ef04d4a5bb374033b346a281d773217018f012bfa853e444cd6570fd284440de" gracePeriod=30 Jun 11 18:33:15.154937 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:15.154911 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-49xdv_e8e8130c-aa8b-4e69-8423-27110ec8b562/kube-rbac-proxy/0.log" Jun 11 18:33:16.154894 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.154868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/thanos-query/0.log" Jun 11 18:33:16.355518 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.355477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy-web/0.log" Jun 11 18:33:16.557537 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.557505 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy/0.log" Jun 11 18:33:16.755304 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.755272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/prom-label-proxy/0.log" Jun 11 18:33:16.955418 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.955322 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy-rules/0.log" Jun 11 18:33:16.962838 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.962804 2576 generic.go:356] "Generic (PLEG): container finished" podID="3d5e5cc9-e1b1-4852-b051-dce24807001f" containerID="ef04d4a5bb374033b346a281d773217018f012bfa853e444cd6570fd284440de" exitCode=0 Jun 11 18:33:16.962969 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.962851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" event={"ID":"3d5e5cc9-e1b1-4852-b051-dce24807001f","Type":"ContainerDied","Data":"ef04d4a5bb374033b346a281d773217018f012bfa853e444cd6570fd284440de"} Jun 11 18:33:16.962969 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.962901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" event={"ID":"3d5e5cc9-e1b1-4852-b051-dce24807001f","Type":"ContainerStarted","Data":"d5a4d026a976f42b7c311ae90499beb855d29eb84652b490963c4eb1d0fa78d2"} Jun 11 18:33:16.962969 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:16.962956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:33:17.156070 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:17.156039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy-metrics/0.log" Jun 11 18:33:17.441862 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:17.441833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:17.505101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:17.505068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:17.870976 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:17.870951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:17.923532 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:17.923503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:18.155789 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:18.155706 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c85bc6d66-tn9dr_80072ed4-5a1f-4b72-aeca-64c7f8b3b493/console/0.log" Jun 11 18:33:18.954863 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:18.954834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7krc7_9fa2dbd4-57d8-4551-af23-631af026e3f0/dns/0.log" Jun 11 18:33:19.155113 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:19.155081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7krc7_9fa2dbd4-57d8-4551-af23-631af026e3f0/kube-rbac-proxy/0.log" Jun 11 18:33:20.155414 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:20.155388 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gk72q_3e0e60f3-65ad-4766-bc3a-119af36da44e/dns-node-resolver/0.log" Jun 11 18:33:20.555409 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:20.555381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6846986bdf-k8mt6_3d5e5cc9-e1b1-4852-b051-dce24807001f/registry/1.log" Jun 11 18:33:20.754686 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:20.754657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wgjq_f19f85d6-05a8-4de9-bf42-ba230417e665/node-ca/0.log" Jun 11 18:33:20.917802 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:20.917718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:21.023761 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:21.023714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:21.125907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:21.125873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:21.377554 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:21.377529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f64c5d4-fwz5h_c2c50f08-6ac9-489a-962b-32c36a29e52e/router/0.log" Jun 11 18:33:21.564247 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:21.564217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4r6jq_ad96837b-3531-45bf-8a01-7847f58e80fd/serve-healthcheck-canary/0.log" Jun 11 18:33:21.874299 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:21.874270 2576 scope.go:117] "RemoveContainer" containerID="3e34b306b71c89ddfa01c423a4acd6e2128eeb2f46f668225846e04757b83ac3" Jun 11 18:33:21.982799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:21.982771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b86d8ccb-7hwbs" event={"ID":"40d3dc8c-e2d0-413a-882c-b1951061a249","Type":"ContainerStarted","Data":"1c05809a895bcb10a31dae241b93634107684368cbdfd516202c7a6c5cd450d4"} Jun 11 18:33:22.427694 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:22.427654 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:22.527079 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:22.527052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:23.602172 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:23.602143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:28.439989 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:28.439952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:28.542271 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:28.542234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:30.746425 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:30.746386 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:33:30.762786 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:30.762757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:33:31.037583 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:31.037557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 18:33:31.507074 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:31.507049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:31.607863 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:31.607829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:32.191340 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.191299 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c85bc6d66-tn9dr" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" containerID="cri-o://6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437" gracePeriod=15 Jun 11 18:33:32.436226 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.436199 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:33:32.580420 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580381 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-serving-cert\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580420 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580422 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-config\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580449 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-oauth-serving-cert\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-oauth-config\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580622 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzkb7\" (UniqueName: \"kubernetes.io/projected/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-kube-api-access-xzkb7\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580665 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-trusted-ca-bundle\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-service-ca\") pod \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\" (UID: \"80072ed4-5a1f-4b72-aeca-64c7f8b3b493\") " Jun 11 18:33:32.580952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580806 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-config" (OuterVolumeSpecName: "console-config") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:32.580952 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.580913 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:32.581104 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.581079 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:32.581104 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.581094 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-config\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:32.581202 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.581113 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-oauth-serving-cert\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:32.581202 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.581116 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-service-ca" (OuterVolumeSpecName: "service-ca") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:32.582956 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.582933 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:32.583065 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.582951 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:32.583065 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.582986 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-kube-api-access-xzkb7" (OuterVolumeSpecName: "kube-api-access-xzkb7") pod "80072ed4-5a1f-4b72-aeca-64c7f8b3b493" (UID: "80072ed4-5a1f-4b72-aeca-64c7f8b3b493"). InnerVolumeSpecName "kube-api-access-xzkb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:33:32.682037 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.682001 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzkb7\" (UniqueName: \"kubernetes.io/projected/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-kube-api-access-xzkb7\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:32.682037 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.682031 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-trusted-ca-bundle\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:32.682037 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.682041 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-service-ca\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:32.682037 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.682049 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-serving-cert\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:32.682301 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:32.682058 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80072ed4-5a1f-4b72-aeca-64c7f8b3b493-console-oauth-config\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:33:33.030925 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.030887 2576 generic.go:356] "Generic (PLEG): container finished" podID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerID="6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437" exitCode=0 Jun 11 18:33:33.031085 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.030944 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c85bc6d66-tn9dr" Jun 11 18:33:33.031085 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.030968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85bc6d66-tn9dr" event={"ID":"80072ed4-5a1f-4b72-aeca-64c7f8b3b493","Type":"ContainerDied","Data":"6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437"} Jun 11 18:33:33.031085 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.031024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c85bc6d66-tn9dr" event={"ID":"80072ed4-5a1f-4b72-aeca-64c7f8b3b493","Type":"ContainerDied","Data":"afdd842cb2224f320431938724afb3402511219805b808cc7e3e1696a16b0131"} Jun 11 18:33:33.031085 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.031049 2576 scope.go:117] "RemoveContainer" containerID="6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437" Jun 11 18:33:33.039269 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.039240 2576 scope.go:117] "RemoveContainer" containerID="6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437" Jun 11 18:33:33.039552 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:33:33.039525 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437\": container with ID starting with 6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437 not found: ID does not exist" containerID="6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437" Jun 11 18:33:33.039663 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.039565 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437"} err="failed to get container status \"6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437\": rpc error: code = NotFound desc = could not find container \"6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437\": container with ID starting with 6b20d400358805603794f233230ed20a1558824082b7120727df76b9ac847437 not found: ID does not exist" Jun 11 18:33:33.049743 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.049723 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c85bc6d66-tn9dr"] Jun 11 18:33:33.054180 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:33.054159 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c85bc6d66-tn9dr"] Jun 11 18:33:34.878302 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:34.878268 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" path="/var/lib/kubelet/pods/80072ed4-5a1f-4b72-aeca-64c7f8b3b493/volumes" Jun 11 18:33:37.971205 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:37.971178 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6846986bdf-k8mt6" Jun 11 18:33:38.246461 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:38.246377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:38.307444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:38.307414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:40.283907 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:40.283871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:40.387168 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:40.387138 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:43.444023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:43.443938 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:43.506288 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:43.506253 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:52.641688 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:52.641650 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:52.715821 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:52.715783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:58.435936 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:58.435906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:58.537232 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:58.537204 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:33:58.605956 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:33:58.605921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:04.534942 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:04.534910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:04.634557 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:04.634528 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:15.272701 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:15.272669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:15.374991 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:15.374958 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:15.442669 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:15.442642 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:36.578162 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:36.578124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:36.679349 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:36.679312 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:37.974352 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:37.974325 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:34:38.066356 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:34:38.066322 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:04.480437 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:04.480404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:05.844547 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:05.844514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:08.076159 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:08.076125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:08.178886 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:08.178855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:11.298615 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:11.298577 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:11.502539 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:11.502473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:11.605078 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:11.605000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:11.727196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:11.727164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:14.747958 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:14.747877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:15.138108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:15.138072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:20.374739 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:20.374708 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:20.474964 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:20.474933 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:22.344581 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:22.344551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:23.947502 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:23.947456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:24.047854 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:24.047824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:31.017574 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:31.017536 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:31.219387 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:31.219356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:32.738555 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:32.738521 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:47.151244 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.151209 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:47.223372 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223339 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps"] Jun 11 18:35:47.223695 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223682 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerName="registry" Jun 11 18:35:47.223740 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223697 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerName="registry" Jun 11 18:35:47.223740 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223708 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" Jun 11 18:35:47.223740 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223717 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" Jun 11 18:35:47.223828 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223779 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80072ed4-5a1f-4b72-aeca-64c7f8b3b493" containerName="console" Jun 11 18:35:47.223828 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.223790 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1482cf-8c82-4360-aef9-26edf1245dac" containerName="registry" Jun 11 18:35:47.226617 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.226599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.232278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.232247 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 18:35:47.233455 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.233435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xhg9p\"" Jun 11 18:35:47.234554 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.234533 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 18:35:47.234554 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.234542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 18:35:47.234838 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.234819 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 18:35:47.234925 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.234909 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:35:47.269820 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.269790 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps"] Jun 11 18:35:47.313793 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.313765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43c8bec3-e657-4b40-9edc-de43d81101b3-cert\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.313957 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.313802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43c8bec3-e657-4b40-9edc-de43d81101b3-metrics-cert\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.313957 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.313853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzsq4\" (UniqueName: \"kubernetes.io/projected/43c8bec3-e657-4b40-9edc-de43d81101b3-kube-api-access-mzsq4\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.313957 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.313879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43c8bec3-e657-4b40-9edc-de43d81101b3-manager-config\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.335223 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.335191 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:47.415223 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.415137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzsq4\" (UniqueName: \"kubernetes.io/projected/43c8bec3-e657-4b40-9edc-de43d81101b3-kube-api-access-mzsq4\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.415223 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.415191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43c8bec3-e657-4b40-9edc-de43d81101b3-manager-config\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.415455 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.415236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43c8bec3-e657-4b40-9edc-de43d81101b3-cert\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.415455 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.415263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43c8bec3-e657-4b40-9edc-de43d81101b3-metrics-cert\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.415981 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.415958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/43c8bec3-e657-4b40-9edc-de43d81101b3-manager-config\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.417718 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.417697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43c8bec3-e657-4b40-9edc-de43d81101b3-metrics-cert\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.417821 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.417804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43c8bec3-e657-4b40-9edc-de43d81101b3-cert\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.484252 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.484222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzsq4\" (UniqueName: \"kubernetes.io/projected/43c8bec3-e657-4b40-9edc-de43d81101b3-kube-api-access-mzsq4\") pod \"lws-controller-manager-6d68fdb559-pprps\" (UID: \"43c8bec3-e657-4b40-9edc-de43d81101b3\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.535392 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.535355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:47.681406 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.681320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps"] Jun 11 18:35:47.684263 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:35:47.684237 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c8bec3_e657_4b40_9edc_de43d81101b3.slice/crio-ba12c6ae9d8919c99bff23858c2265147a8efd30b1f3a4f00a99483247da74f7 WatchSource:0}: Error finding container ba12c6ae9d8919c99bff23858c2265147a8efd30b1f3a4f00a99483247da74f7: Status 404 returned error can't find the container with id ba12c6ae9d8919c99bff23858c2265147a8efd30b1f3a4f00a99483247da74f7 Jun 11 18:35:47.686023 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:47.686006 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:35:48.517325 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:48.517291 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:48.552283 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:48.552248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" event={"ID":"43c8bec3-e657-4b40-9edc-de43d81101b3","Type":"ContainerStarted","Data":"ba12c6ae9d8919c99bff23858c2265147a8efd30b1f3a4f00a99483247da74f7"} Jun 11 18:35:48.612978 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:48.612867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:49.315587 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.315556 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:49.582236 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.582161 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:49.687720 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.687686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:49.738832 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.738801 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt"] Jun 11 18:35:49.745955 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.745930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.749102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.749075 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 18:35:49.749277 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.749253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 18:35:49.749404 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.749315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sgm5f\"" Jun 11 18:35:49.749776 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.749597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 18:35:49.749776 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.749723 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 18:35:49.757886 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.757861 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt"] Jun 11 18:35:49.837148 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.837064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlrpp\" (UniqueName: \"kubernetes.io/projected/4885c174-859c-4191-87e5-f6982202b288-kube-api-access-jlrpp\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.837148 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.837131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4885c174-859c-4191-87e5-f6982202b288-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.837364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.837153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4885c174-859c-4191-87e5-f6982202b288-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.837364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.837170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4885c174-859c-4191-87e5-f6982202b288-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.837364 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.837257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4885c174-859c-4191-87e5-f6982202b288-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.857072 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.857038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:49.938104 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.938067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4885c174-859c-4191-87e5-f6982202b288-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.938293 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.938144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlrpp\" (UniqueName: \"kubernetes.io/projected/4885c174-859c-4191-87e5-f6982202b288-kube-api-access-jlrpp\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.938293 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.938184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4885c174-859c-4191-87e5-f6982202b288-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.938293 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.938211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4885c174-859c-4191-87e5-f6982202b288-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.938293 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.938237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4885c174-859c-4191-87e5-f6982202b288-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.938634 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.938607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4885c174-859c-4191-87e5-f6982202b288-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.940811 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.940786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4885c174-859c-4191-87e5-f6982202b288-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.940940 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.940884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4885c174-859c-4191-87e5-f6982202b288-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.941088 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.941069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4885c174-859c-4191-87e5-f6982202b288-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.948029 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.948006 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlrpp\" (UniqueName: \"kubernetes.io/projected/4885c174-859c-4191-87e5-f6982202b288-kube-api-access-jlrpp\") pod \"opendatahub-operator-controller-manager-699bfcf455-5wfwt\" (UID: \"4885c174-859c-4191-87e5-f6982202b288\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:49.958871 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:49.958840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:50.057161 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.057131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:50.058779 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.058752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:50.165101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.165009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:50.257307 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.257255 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:50.376961 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.376932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:35:50.515937 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.515914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt"] Jun 11 18:35:50.519269 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:35:50.519247 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4885c174_859c_4191_87e5_f6982202b288.slice/crio-153202c2848e814172f1f097319a516df3ddb74806b6d3b0a071dca6c4424fc3 WatchSource:0}: Error finding container 153202c2848e814172f1f097319a516df3ddb74806b6d3b0a071dca6c4424fc3: Status 404 returned error can't find the container with id 153202c2848e814172f1f097319a516df3ddb74806b6d3b0a071dca6c4424fc3 Jun 11 18:35:50.561537 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.561479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" event={"ID":"4885c174-859c-4191-87e5-f6982202b288","Type":"ContainerStarted","Data":"153202c2848e814172f1f097319a516df3ddb74806b6d3b0a071dca6c4424fc3"} Jun 11 18:35:50.563559 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.563534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" event={"ID":"43c8bec3-e657-4b40-9edc-de43d81101b3","Type":"ContainerStarted","Data":"db7b7e81cc0221a05407b0310ec1e64ac8fea397e05423f211899c60d7c8cd4f"} Jun 11 18:35:50.563680 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.563649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:35:50.579822 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:50.579757 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" podStartSLOduration=0.815385818 podStartE2EDuration="3.579735071s" totalImagesPullingTime="2.764349253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:50.579415772 +0000 UTC m=+472.141612375" watchObservedRunningTime="2026-06-11 18:35:50.579735071 +0000 UTC m=+472.141931693" Jun 11 18:35:53.579697 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:53.579665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" event={"ID":"4885c174-859c-4191-87e5-f6982202b288","Type":"ContainerStarted","Data":"9f0dab3469697ac1de4ef4d418f18a3bc7598d988cdad7ccda387e79a1e907d3"} Jun 11 18:35:54.588513 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:54.588462 2576 generic.go:356] "Generic (PLEG): container finished" podID="4885c174-859c-4191-87e5-f6982202b288" containerID="9f0dab3469697ac1de4ef4d418f18a3bc7598d988cdad7ccda387e79a1e907d3" exitCode=0 Jun 11 18:35:54.588988 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:54.588532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" event={"ID":"4885c174-859c-4191-87e5-f6982202b288","Type":"ContainerDied","Data":"9f0dab3469697ac1de4ef4d418f18a3bc7598d988cdad7ccda387e79a1e907d3"} Jun 11 18:35:55.594345 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:55.594307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" event={"ID":"4885c174-859c-4191-87e5-f6982202b288","Type":"ContainerStarted","Data":"216f2d013ea1b45ca6bd0d48f264a83fe7b3c16ddd87c5e153c34342fa36ce0b"} Jun 11 18:35:55.594762 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:55.594432 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:35:55.615164 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:35:55.615111 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" podStartSLOduration=2.260889162 podStartE2EDuration="6.61509412s" totalImagesPullingTime="3.39480234s" totalInitContainerRuntime="959.402618ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:55.613329899 +0000 UTC m=+477.175526519" watchObservedRunningTime="2026-06-11 18:35:55.61509412 +0000 UTC m=+477.177290723" Jun 11 18:36:01.571167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:01.571134 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-pprps" Jun 11 18:36:03.830425 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:03.830391 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:06.600756 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:06.600729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-5wfwt" Jun 11 18:36:08.880802 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:08.880775 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:09.026607 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:09.026570 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:14.451189 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:14.451150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:14.551048 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:14.551008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:14.651799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:14.651743 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:14.876570 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:14.876462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:14.948222 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:14.948189 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:15.006810 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:15.006773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:15.141606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:15.141515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:15.349309 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:15.349277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:15.632950 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:15.632914 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:25.663894 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:25.663861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:25.772040 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:25.772006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:25.873715 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:25.873684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:26.100456 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:26.100422 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:26.219355 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:26.219325 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:27.064002 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:27.063968 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:27.258920 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:27.258886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:27.337017 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:27.336927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:28.672916 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:28.672883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:28.769951 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:28.769918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:28.923296 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:28.923199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:29.943903 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:29.943870 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:30.066334 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:30.066301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:30.540511 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:30.540459 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:30.698504 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:30.698453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:31.174583 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:31.174551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:41.196531 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:41.196467 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:41.287809 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:41.287776 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:46.044296 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:46.044216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:46.137799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:46.137766 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:46.578041 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:46.578008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:49.870250 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:49.870219 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.040408 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.040375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.163747 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.163667 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9"] Jun 11 18:36:50.166957 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.166936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.169469 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.169441 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 18:36:50.169606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.169561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fdwx7\"" Jun 11 18:36:50.179961 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.179935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9"] Jun 11 18:36:50.203278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.203226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.258600 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258780 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258780 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258780 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfqf\" (UniqueName: \"kubernetes.io/projected/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-kube-api-access-6rfqf\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258780 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.258983 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.258899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.323518 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.323460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.359528 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359612 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359612 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359701 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359701 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359801 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfqf\" (UniqueName: \"kubernetes.io/projected/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-kube-api-access-6rfqf\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359849 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359903 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359961 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.359961 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.360060 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.359998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.360060 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.360039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.360171 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.360074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.360299 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.360278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.362098 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.362069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.362296 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.362279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.368079 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.368053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.368523 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.368502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfqf\" (UniqueName: \"kubernetes.io/projected/f2e2c992-2eb9-4d46-abe5-4eebb50054fa-kube-api-access-6rfqf\") pod \"data-science-gateway-data-science-gateway-class-74759f97954whs9\" (UID: \"f2e2c992-2eb9-4d46-abe5-4eebb50054fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.424759 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.424694 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.478423 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.478386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:50.611028 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.611002 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9"] Jun 11 18:36:50.613283 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:36:50.613256 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e2c992_2eb9_4d46_abe5_4eebb50054fa.slice/crio-fdabba763e128c336726c9e6b7324a1cf3064e0f6f4c2ba883933cab19e91670 WatchSource:0}: Error finding container fdabba763e128c336726c9e6b7324a1cf3064e0f6f4c2ba883933cab19e91670: Status 404 returned error can't find the container with id fdabba763e128c336726c9e6b7324a1cf3064e0f6f4c2ba883933cab19e91670 Jun 11 18:36:50.824675 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:50.824640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" event={"ID":"f2e2c992-2eb9-4d46-abe5-4eebb50054fa","Type":"ContainerStarted","Data":"fdabba763e128c336726c9e6b7324a1cf3064e0f6f4c2ba883933cab19e91670"} Jun 11 18:36:54.779556 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:54.779512 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:36:54.779799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:54.779596 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:36:54.779799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:54.779631 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:36:54.843300 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:54.843269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" event={"ID":"f2e2c992-2eb9-4d46-abe5-4eebb50054fa","Type":"ContainerStarted","Data":"bd3fe02343422750038f2005a36401d86b110602c34d24670db6ea6f6fd5f922"} Jun 11 18:36:54.866059 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:54.866003 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" podStartSLOduration=0.702053378 podStartE2EDuration="4.865987415s" totalImagesPullingTime="4.163934037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:54.865105781 +0000 UTC m=+536.427302408" watchObservedRunningTime="2026-06-11 18:36:54.865987415 +0000 UTC m=+536.428184018" Jun 11 18:36:55.239450 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.239366 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5cc9d4d789-h65r8"] Jun 11 18:36:55.243470 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.243445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.246171 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.246148 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mtn5v\"" Jun 11 18:36:55.246561 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.246509 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 18:36:55.252469 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.252439 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc9d4d789-h65r8"] Jun 11 18:36:55.277350 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.277315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:55.302419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.302390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6552\" (UniqueName: \"kubernetes.io/projected/48780944-0ec3-437f-8371-51011660fa0b-kube-api-access-k6552\") pod \"dashboard-redirect-5cc9d4d789-h65r8\" (UID: \"48780944-0ec3-437f-8371-51011660fa0b\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.302613 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.302428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48780944-0ec3-437f-8371-51011660fa0b-redirect-config\") pod \"dashboard-redirect-5cc9d4d789-h65r8\" (UID: \"48780944-0ec3-437f-8371-51011660fa0b\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.403812 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.403772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6552\" (UniqueName: \"kubernetes.io/projected/48780944-0ec3-437f-8371-51011660fa0b-kube-api-access-k6552\") pod \"dashboard-redirect-5cc9d4d789-h65r8\" (UID: \"48780944-0ec3-437f-8371-51011660fa0b\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.404011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.403825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48780944-0ec3-437f-8371-51011660fa0b-redirect-config\") pod \"dashboard-redirect-5cc9d4d789-h65r8\" (UID: \"48780944-0ec3-437f-8371-51011660fa0b\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.404542 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.404524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48780944-0ec3-437f-8371-51011660fa0b-redirect-config\") pod \"dashboard-redirect-5cc9d4d789-h65r8\" (UID: \"48780944-0ec3-437f-8371-51011660fa0b\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.413282 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.413260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6552\" (UniqueName: \"kubernetes.io/projected/48780944-0ec3-437f-8371-51011660fa0b-kube-api-access-k6552\") pod \"dashboard-redirect-5cc9d4d789-h65r8\" (UID: \"48780944-0ec3-437f-8371-51011660fa0b\") " pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.479128 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.479091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:55.483881 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.483857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:55.558232 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.558198 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" Jun 11 18:36:55.687554 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.687444 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc9d4d789-h65r8"] Jun 11 18:36:55.690231 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:36:55.690206 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48780944_0ec3_437f_8371_51011660fa0b.slice/crio-4b849074849ea836fc9b74aa2fe9487e2cb5cad2584b59b96d217d92822a586e WatchSource:0}: Error finding container 4b849074849ea836fc9b74aa2fe9487e2cb5cad2584b59b96d217d92822a586e: Status 404 returned error can't find the container with id 4b849074849ea836fc9b74aa2fe9487e2cb5cad2584b59b96d217d92822a586e Jun 11 18:36:55.848378 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.848295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" event={"ID":"48780944-0ec3-437f-8371-51011660fa0b","Type":"ContainerStarted","Data":"4b849074849ea836fc9b74aa2fe9487e2cb5cad2584b59b96d217d92822a586e"} Jun 11 18:36:55.848787 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.848595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:55.849471 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:55.849453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97954whs9" Jun 11 18:36:58.862684 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:58.862645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" event={"ID":"48780944-0ec3-437f-8371-51011660fa0b","Type":"ContainerStarted","Data":"fcff7d0d57e00c6f0a570672707f08dd526d48021526ab8d7b6a112227af149b"} Jun 11 18:36:58.879950 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:36:58.879906 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5cc9d4d789-h65r8" podStartSLOduration=1.77232761 podStartE2EDuration="3.879890855s" totalImagesPullingTime="2.107563245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:58.878662529 +0000 UTC m=+540.440859145" watchObservedRunningTime="2026-06-11 18:36:58.879890855 +0000 UTC m=+540.442087473" Jun 11 18:37:05.177939 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:05.177909 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:10.443785 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.443755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:10.558448 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.558418 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:10.607066 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.607030 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c89tm"] Jun 11 18:37:10.610157 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.610139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:10.612909 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.612889 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:37:10.613561 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.613540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:37:10.613687 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.613546 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gpptt\"" Jun 11 18:37:10.625577 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.625551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c89tm"] Jun 11 18:37:10.690708 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.690677 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:10.740073 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.739980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxtj9\" (UniqueName: \"kubernetes.io/projected/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8-kube-api-access-gxtj9\") pod \"kuadrant-operator-catalog-c89tm\" (UID: \"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8\") " pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:10.846285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.841994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxtj9\" (UniqueName: \"kubernetes.io/projected/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8-kube-api-access-gxtj9\") pod \"kuadrant-operator-catalog-c89tm\" (UID: \"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8\") " pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:10.851542 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.851514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxtj9\" (UniqueName: \"kubernetes.io/projected/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8-kube-api-access-gxtj9\") pod \"kuadrant-operator-catalog-c89tm\" (UID: \"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8\") " pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:10.919571 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.919538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:10.932102 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:10.932075 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c89tm"] Jun 11 18:37:11.056930 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.056905 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c89tm"] Jun 11 18:37:11.058365 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:37:11.058340 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ff449a_62e6_402b_8b1a_e1d4f9f1ecb8.slice/crio-7346343c1fc4678a997b257f1dbafa976e5d993b0317f119b7550b551b4e6bbd WatchSource:0}: Error finding container 7346343c1fc4678a997b257f1dbafa976e5d993b0317f119b7550b551b4e6bbd: Status 404 returned error can't find the container with id 7346343c1fc4678a997b257f1dbafa976e5d993b0317f119b7550b551b4e6bbd Jun 11 18:37:11.141431 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.141399 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rfzsv"] Jun 11 18:37:11.144721 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.144696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:11.159900 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.159876 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rfzsv"] Jun 11 18:37:11.245781 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.245743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgj7f\" (UniqueName: \"kubernetes.io/projected/ef836258-a584-456c-8fe0-34e79fa0e173-kube-api-access-mgj7f\") pod \"kuadrant-operator-catalog-rfzsv\" (UID: \"ef836258-a584-456c-8fe0-34e79fa0e173\") " pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:11.346829 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.346733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgj7f\" (UniqueName: \"kubernetes.io/projected/ef836258-a584-456c-8fe0-34e79fa0e173-kube-api-access-mgj7f\") pod \"kuadrant-operator-catalog-rfzsv\" (UID: \"ef836258-a584-456c-8fe0-34e79fa0e173\") " pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:11.355942 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.355918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgj7f\" (UniqueName: \"kubernetes.io/projected/ef836258-a584-456c-8fe0-34e79fa0e173-kube-api-access-mgj7f\") pod \"kuadrant-operator-catalog-rfzsv\" (UID: \"ef836258-a584-456c-8fe0-34e79fa0e173\") " pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:11.391323 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.391297 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:11.453835 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.453803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:11.573195 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.573150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:11.579605 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.579561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rfzsv"] Jun 11 18:37:11.582208 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:37:11.582181 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef836258_a584_456c_8fe0_34e79fa0e173.slice/crio-921ae6df837a5d1b1be2868657f40bfc21ac1a6477df047bcd42add8c1b95468 WatchSource:0}: Error finding container 921ae6df837a5d1b1be2868657f40bfc21ac1a6477df047bcd42add8c1b95468: Status 404 returned error can't find the container with id 921ae6df837a5d1b1be2868657f40bfc21ac1a6477df047bcd42add8c1b95468 Jun 11 18:37:11.920636 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.920599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" event={"ID":"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8","Type":"ContainerStarted","Data":"7346343c1fc4678a997b257f1dbafa976e5d993b0317f119b7550b551b4e6bbd"} Jun 11 18:37:11.921922 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:11.921896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" event={"ID":"ef836258-a584-456c-8fe0-34e79fa0e173","Type":"ContainerStarted","Data":"921ae6df837a5d1b1be2868657f40bfc21ac1a6477df047bcd42add8c1b95468"} Jun 11 18:37:13.932690 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:13.932657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" event={"ID":"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8","Type":"ContainerStarted","Data":"8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff"} Jun 11 18:37:13.933112 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:13.932710 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" podUID="e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" containerName="registry-server" containerID="cri-o://8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff" gracePeriod=2 Jun 11 18:37:13.934277 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:13.934250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" event={"ID":"ef836258-a584-456c-8fe0-34e79fa0e173","Type":"ContainerStarted","Data":"27d7af328d8f45948a4912e49b809c6f8fb5347b41a0880b88dfae36ea877d96"} Jun 11 18:37:13.947667 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:13.947623 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" podStartSLOduration=1.554425441 podStartE2EDuration="3.94760578s" totalImagesPullingTime="2.393180339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:13.947018301 +0000 UTC m=+555.509214907" watchObservedRunningTime="2026-06-11 18:37:13.94760578 +0000 UTC m=+555.509802385" Jun 11 18:37:13.962407 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:13.962359 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" podStartSLOduration=1.089778701 podStartE2EDuration="2.962343577s" totalImagesPullingTime="1.872564876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:13.961069485 +0000 UTC m=+555.523266109" watchObservedRunningTime="2026-06-11 18:37:13.962343577 +0000 UTC m=+555.524540182" Jun 11 18:37:14.175011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.174985 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:14.272760 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.272715 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxtj9\" (UniqueName: \"kubernetes.io/projected/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8-kube-api-access-gxtj9\") pod \"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8\" (UID: \"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8\") " Jun 11 18:37:14.274874 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.274851 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8-kube-api-access-gxtj9" (OuterVolumeSpecName: "kube-api-access-gxtj9") pod "e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" (UID: "e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8"). InnerVolumeSpecName "kube-api-access-gxtj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:37:14.373855 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.373815 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxtj9\" (UniqueName: \"kubernetes.io/projected/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8-kube-api-access-gxtj9\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:37:14.939583 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.939547 2576 generic.go:356] "Generic (PLEG): container finished" podID="e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" containerID="8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff" exitCode=0 Jun 11 18:37:14.940011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.939592 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" Jun 11 18:37:14.940011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.939626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" event={"ID":"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8","Type":"ContainerDied","Data":"8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff"} Jun 11 18:37:14.940011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.939670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c89tm" event={"ID":"e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8","Type":"ContainerDied","Data":"7346343c1fc4678a997b257f1dbafa976e5d993b0317f119b7550b551b4e6bbd"} Jun 11 18:37:14.940011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.939690 2576 scope.go:117] "RemoveContainer" containerID="8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff" Jun 11 18:37:14.948666 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.948646 2576 scope.go:117] "RemoveContainer" containerID="8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff" Jun 11 18:37:14.948904 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:37:14.948888 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff\": container with ID starting with 8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff not found: ID does not exist" containerID="8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff" Jun 11 18:37:14.948949 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.948910 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff"} err="failed to get container status \"8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff\": rpc error: code = NotFound desc = could not find container \"8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff\": container with ID starting with 8ad4b097f10b1f2d9ef83d2cbc9db9912c2d273446b24db90dfa61578653f8ff not found: ID does not exist" Jun 11 18:37:14.955111 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.955087 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c89tm"] Jun 11 18:37:14.957881 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:14.957862 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c89tm"] Jun 11 18:37:16.878811 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:16.878775 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" path="/var/lib/kubelet/pods/e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8/volumes" Jun 11 18:37:21.454210 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:21.454158 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:21.454734 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:21.454435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:21.476830 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:21.476798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:21.959570 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:21.959538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:21.994177 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:21.994149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rfzsv" Jun 11 18:37:35.111477 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:35.111439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:37.334689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.334639 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd"] Jun 11 18:37:37.335072 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.335013 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" containerName="registry-server" Jun 11 18:37:37.335072 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.335028 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" containerName="registry-server" Jun 11 18:37:37.335146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.335075 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ff449a-62e6-402b-8b1a-e1d4f9f1ecb8" containerName="registry-server" Jun 11 18:37:37.343376 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.343353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:37.346146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.346121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 18:37:37.346146 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.346133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7bzj6\"" Jun 11 18:37:37.350700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.350681 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd"] Jun 11 18:37:37.372852 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.372819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48cz\" (UniqueName: \"kubernetes.io/projected/dbced3ca-ca37-40af-a3e3-e2caa56db63e-kube-api-access-s48cz\") pod \"dns-operator-controller-manager-864dd78c4c-dsqrd\" (UID: \"dbced3ca-ca37-40af-a3e3-e2caa56db63e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:37.473621 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.473588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s48cz\" (UniqueName: \"kubernetes.io/projected/dbced3ca-ca37-40af-a3e3-e2caa56db63e-kube-api-access-s48cz\") pod \"dns-operator-controller-manager-864dd78c4c-dsqrd\" (UID: \"dbced3ca-ca37-40af-a3e3-e2caa56db63e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:37.483645 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.483620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48cz\" (UniqueName: \"kubernetes.io/projected/dbced3ca-ca37-40af-a3e3-e2caa56db63e-kube-api-access-s48cz\") pod \"dns-operator-controller-manager-864dd78c4c-dsqrd\" (UID: \"dbced3ca-ca37-40af-a3e3-e2caa56db63e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:37.653661 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.653567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:37.782767 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:37.782733 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd"] Jun 11 18:37:37.786350 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:37:37.786314 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbced3ca_ca37_40af_a3e3_e2caa56db63e.slice/crio-420f1fdda87d656031070bfeb95ce6bf8ce117ac958ac37ea8ca49c5a706f85d WatchSource:0}: Error finding container 420f1fdda87d656031070bfeb95ce6bf8ce117ac958ac37ea8ca49c5a706f85d: Status 404 returned error can't find the container with id 420f1fdda87d656031070bfeb95ce6bf8ce117ac958ac37ea8ca49c5a706f85d Jun 11 18:37:38.041068 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:38.041032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" event={"ID":"dbced3ca-ca37-40af-a3e3-e2caa56db63e","Type":"ContainerStarted","Data":"420f1fdda87d656031070bfeb95ce6bf8ce117ac958ac37ea8ca49c5a706f85d"} Jun 11 18:37:38.902581 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:38.902549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:40.997144 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:40.997109 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j"] Jun 11 18:37:40.999374 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:40.999357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:41.002977 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.002947 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9thmf\"" Jun 11 18:37:41.022724 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.022696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j"] Jun 11 18:37:41.057505 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.057457 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" event={"ID":"dbced3ca-ca37-40af-a3e3-e2caa56db63e","Type":"ContainerStarted","Data":"3e58db0d6ceaa7a7f9c1c54ad9c672f7e12954577a55b0a928589e02e4f52a0e"} Jun 11 18:37:41.057671 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.057548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:41.103966 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.103907 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" podStartSLOduration=1.7399881050000001 podStartE2EDuration="4.10388643s" totalImagesPullingTime="2.363898325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:41.099648867 +0000 UTC m=+582.661845472" watchObservedRunningTime="2026-06-11 18:37:41.10388643 +0000 UTC m=+582.666083036" Jun 11 18:37:41.105451 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.105429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbcg\" (UniqueName: \"kubernetes.io/projected/2953ea2e-607f-440e-9d04-9c82da42b872-kube-api-access-chbcg\") pod \"limitador-operator-controller-manager-859d7b78bd-p8k6j\" (UID: \"2953ea2e-607f-440e-9d04-9c82da42b872\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:41.206208 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.206155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbcg\" (UniqueName: \"kubernetes.io/projected/2953ea2e-607f-440e-9d04-9c82da42b872-kube-api-access-chbcg\") pod \"limitador-operator-controller-manager-859d7b78bd-p8k6j\" (UID: \"2953ea2e-607f-440e-9d04-9c82da42b872\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:41.218683 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.218649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbcg\" (UniqueName: \"kubernetes.io/projected/2953ea2e-607f-440e-9d04-9c82da42b872-kube-api-access-chbcg\") pod \"limitador-operator-controller-manager-859d7b78bd-p8k6j\" (UID: \"2953ea2e-607f-440e-9d04-9c82da42b872\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:41.311664 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.311629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:41.441683 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.441659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j"] Jun 11 18:37:41.443787 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:37:41.443754 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2953ea2e_607f_440e_9d04_9c82da42b872.slice/crio-796ad81d18dda4ed7ddf3ccbefe0511a301bd6dc208d0c6769342e1b12e43920 WatchSource:0}: Error finding container 796ad81d18dda4ed7ddf3ccbefe0511a301bd6dc208d0c6769342e1b12e43920: Status 404 returned error can't find the container with id 796ad81d18dda4ed7ddf3ccbefe0511a301bd6dc208d0c6769342e1b12e43920 Jun 11 18:37:41.497822 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.497789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:41.791180 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.791148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:41.889919 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.889886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:41.987249 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:41.987214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:42.064905 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:42.064817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" event={"ID":"2953ea2e-607f-440e-9d04-9c82da42b872","Type":"ContainerStarted","Data":"796ad81d18dda4ed7ddf3ccbefe0511a301bd6dc208d0c6769342e1b12e43920"} Jun 11 18:37:42.091302 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:42.091270 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:42.195564 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:42.195518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:42.579513 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:42.579461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:42.673945 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:42.673920 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:43.503427 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:43.503390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:44.076224 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:44.076144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" event={"ID":"2953ea2e-607f-440e-9d04-9c82da42b872","Type":"ContainerStarted","Data":"b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2"} Jun 11 18:37:44.076417 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:44.076270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:44.093924 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:44.093876 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" podStartSLOduration=1.76514545 podStartE2EDuration="4.09386088s" totalImagesPullingTime="2.32871543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:44.09224082 +0000 UTC m=+585.654437425" watchObservedRunningTime="2026-06-11 18:37:44.09386088 +0000 UTC m=+585.656057484" Jun 11 18:37:44.536598 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:44.536569 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:45.707668 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.707630 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nns9n"] Jun 11 18:37:45.709803 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.709788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:37:45.712262 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.712240 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-486ms\"" Jun 11 18:37:45.724289 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.724260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nns9n"] Jun 11 18:37:45.747609 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.747583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmds2\" (UniqueName: \"kubernetes.io/projected/40475f44-de0d-4b46-9836-8202a43579b8-kube-api-access-xmds2\") pod \"authorino-operator-75cc8d5cb7-nns9n\" (UID: \"40475f44-de0d-4b46-9836-8202a43579b8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:37:45.848234 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.848190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmds2\" (UniqueName: \"kubernetes.io/projected/40475f44-de0d-4b46-9836-8202a43579b8-kube-api-access-xmds2\") pod \"authorino-operator-75cc8d5cb7-nns9n\" (UID: \"40475f44-de0d-4b46-9836-8202a43579b8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:37:45.864179 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:45.864147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmds2\" (UniqueName: \"kubernetes.io/projected/40475f44-de0d-4b46-9836-8202a43579b8-kube-api-access-xmds2\") pod \"authorino-operator-75cc8d5cb7-nns9n\" (UID: \"40475f44-de0d-4b46-9836-8202a43579b8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:37:46.020239 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:46.020203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:37:46.158051 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:46.158023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nns9n"] Jun 11 18:37:46.160455 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:37:46.160425 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40475f44_de0d_4b46_9836_8202a43579b8.slice/crio-81104fc5dba96a01aea147134d117031e0eec8d209b39a6cea0ea61333acba25 WatchSource:0}: Error finding container 81104fc5dba96a01aea147134d117031e0eec8d209b39a6cea0ea61333acba25: Status 404 returned error can't find the container with id 81104fc5dba96a01aea147134d117031e0eec8d209b39a6cea0ea61333acba25 Jun 11 18:37:46.902970 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:46.902931 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.041451 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:47.041413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:47.099595 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:47.099551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" event={"ID":"40475f44-de0d-4b46-9836-8202a43579b8","Type":"ContainerStarted","Data":"81104fc5dba96a01aea147134d117031e0eec8d209b39a6cea0ea61333acba25"} Jun 11 18:37:47.199436 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:47.199354 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:48.254040 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:48.254000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:49.110499 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:49.110464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" event={"ID":"40475f44-de0d-4b46-9836-8202a43579b8","Type":"ContainerStarted","Data":"e9c2aa349df2fc361d35704d731f9344a0a5453ae665c3e95019a7b3cc9db027"} Jun 11 18:37:49.110700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:49.110628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:37:49.129642 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:49.129585 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" podStartSLOduration=1.967434117 podStartE2EDuration="4.129570808s" totalImagesPullingTime="2.162136691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:49.128309022 +0000 UTC m=+590.690505626" watchObservedRunningTime="2026-06-11 18:37:49.129570808 +0000 UTC m=+590.691767412" Jun 11 18:37:49.779731 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:49.779698 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:51.366639 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:51.366605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:52.067632 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:52.067604 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dsqrd" Jun 11 18:37:53.069328 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:53.069294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:53.164435 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:53.164403 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:53.264908 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:53.264878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:53.365319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:53.365240 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:54.594856 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:54.594826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:54.699031 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:54.698969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:54.796611 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:54.796581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:55.083800 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:55.083772 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:37:58.097733 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:58.097695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.198881 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:58.198849 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:37:58.865385 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:58.865362 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:37:58.866163 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:37:58.866143 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:38:00.117550 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:00.117516 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nns9n" Jun 11 18:38:01.939919 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:01.939882 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:02.036294 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:02.036263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:02.694292 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:02.694262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:02.794798 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:02.794760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:03.090606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:03.090574 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:03.190286 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:03.190253 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:04.278978 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:04.278945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:04.375259 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:04.375231 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:06.872039 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:06.872006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:08.303864 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:08.303825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:12.643359 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.643266 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j"] Jun 11 18:38:12.643818 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.643536 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" podUID="2953ea2e-607f-440e-9d04-9c82da42b872" containerName="manager" containerID="cri-o://b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2" gracePeriod=2 Jun 11 18:38:12.649533 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.649477 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j"] Jun 11 18:38:12.678519 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.678469 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp"] Jun 11 18:38:12.679039 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.679020 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2953ea2e-607f-440e-9d04-9c82da42b872" containerName="manager" Jun 11 18:38:12.679082 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.679044 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2953ea2e-607f-440e-9d04-9c82da42b872" containerName="manager" Jun 11 18:38:12.679158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.679145 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2953ea2e-607f-440e-9d04-9c82da42b872" containerName="manager" Jun 11 18:38:12.681559 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.681537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:12.706054 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.706019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp"] Jun 11 18:38:12.736086 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:38:12.736053 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p8k6j\" is forbidden: User \"system:node:ip-10-0-128-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-178.ec2.internal' and this object" podUID="2953ea2e-607f-440e-9d04-9c82da42b872" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:38:12.782251 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.780328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86jc4\" (UniqueName: \"kubernetes.io/projected/1047a9cc-02fe-49da-a8a5-3d46b1dac3eb-kube-api-access-86jc4\") pod \"limitador-operator-controller-manager-859d7b78bd-zfvdp\" (UID: \"1047a9cc-02fe-49da-a8a5-3d46b1dac3eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:12.881632 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.881597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86jc4\" (UniqueName: \"kubernetes.io/projected/1047a9cc-02fe-49da-a8a5-3d46b1dac3eb-kube-api-access-86jc4\") pod \"limitador-operator-controller-manager-859d7b78bd-zfvdp\" (UID: \"1047a9cc-02fe-49da-a8a5-3d46b1dac3eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:12.888823 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.888800 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:38:12.895652 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.895609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86jc4\" (UniqueName: \"kubernetes.io/projected/1047a9cc-02fe-49da-a8a5-3d46b1dac3eb-kube-api-access-86jc4\") pod \"limitador-operator-controller-manager-859d7b78bd-zfvdp\" (UID: \"1047a9cc-02fe-49da-a8a5-3d46b1dac3eb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:12.982668 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.982630 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chbcg\" (UniqueName: \"kubernetes.io/projected/2953ea2e-607f-440e-9d04-9c82da42b872-kube-api-access-chbcg\") pod \"2953ea2e-607f-440e-9d04-9c82da42b872\" (UID: \"2953ea2e-607f-440e-9d04-9c82da42b872\") " Jun 11 18:38:12.984649 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:12.984627 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2953ea2e-607f-440e-9d04-9c82da42b872-kube-api-access-chbcg" (OuterVolumeSpecName: "kube-api-access-chbcg") pod "2953ea2e-607f-440e-9d04-9c82da42b872" (UID: "2953ea2e-607f-440e-9d04-9c82da42b872"). InnerVolumeSpecName "kube-api-access-chbcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:13.034928 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.034897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:13.084349 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.084313 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chbcg\" (UniqueName: \"kubernetes.io/projected/2953ea2e-607f-440e-9d04-9c82da42b872-kube-api-access-chbcg\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:38:13.166187 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.166160 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp"] Jun 11 18:38:13.168526 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:38:13.168479 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1047a9cc_02fe_49da_a8a5_3d46b1dac3eb.slice/crio-bc21fa965e9ee59a474dced1f5a0ecd8e15d49208402a92a46d70753bf1708c3 WatchSource:0}: Error finding container bc21fa965e9ee59a474dced1f5a0ecd8e15d49208402a92a46d70753bf1708c3: Status 404 returned error can't find the container with id bc21fa965e9ee59a474dced1f5a0ecd8e15d49208402a92a46d70753bf1708c3 Jun 11 18:38:13.227149 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.227120 2576 generic.go:356] "Generic (PLEG): container finished" podID="2953ea2e-607f-440e-9d04-9c82da42b872" containerID="b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2" exitCode=0 Jun 11 18:38:13.227282 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.227180 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p8k6j" Jun 11 18:38:13.227282 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.227214 2576 scope.go:117] "RemoveContainer" containerID="b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2" Jun 11 18:38:13.229035 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.229014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" event={"ID":"1047a9cc-02fe-49da-a8a5-3d46b1dac3eb","Type":"ContainerStarted","Data":"bc21fa965e9ee59a474dced1f5a0ecd8e15d49208402a92a46d70753bf1708c3"} Jun 11 18:38:13.229166 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.229073 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:13.237021 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.236992 2576 scope.go:117] "RemoveContainer" containerID="b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2" Jun 11 18:38:13.238260 ip-10-0-128-178 kubenswrapper[2576]: E0611 18:38:13.238229 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2\": container with ID starting with b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2 not found: ID does not exist" containerID="b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2" Jun 11 18:38:13.238371 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.238268 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2"} err="failed to get container status \"b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2\": rpc error: code = NotFound desc = could not find container \"b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2\": container with ID starting with b7493f43b5460d03d77310d2d0ed8d6d319a1bf157368d08f2c89865b9a559f2 not found: ID does not exist" Jun 11 18:38:13.257809 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.257758 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" podStartSLOduration=1.257744077 podStartE2EDuration="1.257744077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:13.255245988 +0000 UTC m=+614.817442592" watchObservedRunningTime="2026-06-11 18:38:13.257744077 +0000 UTC m=+614.819940681" Jun 11 18:38:13.572798 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.572755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:13.671200 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:13.671129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:14.236238 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:14.236206 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" event={"ID":"1047a9cc-02fe-49da-a8a5-3d46b1dac3eb","Type":"ContainerStarted","Data":"0bc9fda2d277988aa507c5b80f9868e008157ebc0871ebe367d78bbd1e10828f"} Jun 11 18:38:14.879226 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:14.879195 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2953ea2e-607f-440e-9d04-9c82da42b872" path="/var/lib/kubelet/pods/2953ea2e-607f-440e-9d04-9c82da42b872/volumes" Jun 11 18:38:16.719897 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:16.719861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:16.823328 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:16.823287 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:21.176611 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:21.176572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:21.233967 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:21.233936 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:22.139715 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:22.139683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:22.303260 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:22.303223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:25.104711 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:25.104676 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:25.200472 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:25.200438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:25.242306 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:25.242279 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfvdp" Jun 11 18:38:41.458451 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.458420 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9"] Jun 11 18:38:41.467839 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.467815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.470440 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.470414 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-84rkq\"" Jun 11 18:38:41.473237 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.473214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9"] Jun 11 18:38:41.481128 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.481102 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:41.533036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.532997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533036 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b97a12-e14f-46d4-a607-f0928e053c1c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqtp\" (UniqueName: \"kubernetes.io/projected/72b97a12-e14f-46d4-a607-f0928e053c1c-kube-api-access-jdqtp\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.533542 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.533296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.580229 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.580199 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:41.634283 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634283 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634567 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b97a12-e14f-46d4-a607-f0928e053c1c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634875 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634875 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.634875 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqtp\" (UniqueName: \"kubernetes.io/projected/72b97a12-e14f-46d4-a607-f0928e053c1c-kube-api-access-jdqtp\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.635031 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.635031 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.634989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.635138 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.635090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.635360 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.635339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72b97a12-e14f-46d4-a607-f0928e053c1c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.636839 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.636817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.636934 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.636902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.642642 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.642612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72b97a12-e14f-46d4-a607-f0928e053c1c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.642836 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.642816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqtp\" (UniqueName: \"kubernetes.io/projected/72b97a12-e14f-46d4-a607-f0928e053c1c-kube-api-access-jdqtp\") pod \"maas-default-gateway-openshift-default-687ff6996-lhqv9\" (UID: \"72b97a12-e14f-46d4-a607-f0928e053c1c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.781607 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.781578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:41.919742 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.919718 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9"] Jun 11 18:38:41.923630 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:38:41.923586 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b97a12_e14f_46d4_a607_f0928e053c1c.slice/crio-65f4623684c98a2079302aa3c520cb2945e92f211fcd6b42008aee45c8e90a2d WatchSource:0}: Error finding container 65f4623684c98a2079302aa3c520cb2945e92f211fcd6b42008aee45c8e90a2d: Status 404 returned error can't find the container with id 65f4623684c98a2079302aa3c520cb2945e92f211fcd6b42008aee45c8e90a2d Jun 11 18:38:41.925761 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.925723 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:38:41.925858 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.925796 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:38:41.925858 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:41.925825 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:38:42.365322 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:42.365289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" event={"ID":"72b97a12-e14f-46d4-a607-f0928e053c1c","Type":"ContainerStarted","Data":"c150a50e2a31121492965ee99c7bf555b7a86cbb6bc755b78b7452bc1814b2c7"} Jun 11 18:38:42.365529 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:42.365339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" event={"ID":"72b97a12-e14f-46d4-a607-f0928e053c1c","Type":"ContainerStarted","Data":"65f4623684c98a2079302aa3c520cb2945e92f211fcd6b42008aee45c8e90a2d"} Jun 11 18:38:42.384888 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:42.384826 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" podStartSLOduration=1.384802305 podStartE2EDuration="1.384802305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:42.382096623 +0000 UTC m=+643.944293228" watchObservedRunningTime="2026-06-11 18:38:42.384802305 +0000 UTC m=+643.946998910" Jun 11 18:38:42.782176 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:42.782140 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:42.787325 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:42.787294 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:43.370243 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:43.370212 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:43.371362 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:43.371342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:38:56.964651 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:56.964616 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:57.071419 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:57.071383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:57.127964 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:57.127930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:57.916624 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:57.916587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:38:58.016209 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:38:58.016180 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:15.181889 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:15.181855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:25.089615 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:25.089573 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:25.188718 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:25.188685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:25.316253 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:25.316216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:34.271171 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.271143 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-7tzfz"] Jun 11 18:39:34.273452 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.273430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" Jun 11 18:39:34.276021 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.275996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-k6g26\"" Jun 11 18:39:34.276185 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.276166 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 18:39:34.277042 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.277023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 18:39:34.285423 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.285403 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-7tzfz"] Jun 11 18:39:34.406608 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.406571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp7kr\" (UniqueName: \"kubernetes.io/projected/215c6d19-72a6-4426-9af8-425be6d4d0bc-kube-api-access-pp7kr\") pod \"keycloak-operator-d67dbbb48-7tzfz\" (UID: \"215c6d19-72a6-4426-9af8-425be6d4d0bc\") " pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" Jun 11 18:39:34.507971 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.507932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp7kr\" (UniqueName: \"kubernetes.io/projected/215c6d19-72a6-4426-9af8-425be6d4d0bc-kube-api-access-pp7kr\") pod \"keycloak-operator-d67dbbb48-7tzfz\" (UID: \"215c6d19-72a6-4426-9af8-425be6d4d0bc\") " pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" Jun 11 18:39:34.518529 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.518477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp7kr\" (UniqueName: \"kubernetes.io/projected/215c6d19-72a6-4426-9af8-425be6d4d0bc-kube-api-access-pp7kr\") pod \"keycloak-operator-d67dbbb48-7tzfz\" (UID: \"215c6d19-72a6-4426-9af8-425be6d4d0bc\") " pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" Jun 11 18:39:34.584306 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.584233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" Jun 11 18:39:34.718432 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:34.718407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-7tzfz"] Jun 11 18:39:34.721335 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:39:34.721309 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215c6d19_72a6_4426_9af8_425be6d4d0bc.slice/crio-ac82944eb87d37388fbc90ce55886313d74e28b6f5142aef83466623c1dc7267 WatchSource:0}: Error finding container ac82944eb87d37388fbc90ce55886313d74e28b6f5142aef83466623c1dc7267: Status 404 returned error can't find the container with id ac82944eb87d37388fbc90ce55886313d74e28b6f5142aef83466623c1dc7267 Jun 11 18:39:35.622003 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:35.621967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" event={"ID":"215c6d19-72a6-4426-9af8-425be6d4d0bc","Type":"ContainerStarted","Data":"ac82944eb87d37388fbc90ce55886313d74e28b6f5142aef83466623c1dc7267"} Jun 11 18:39:40.650863 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:40.650828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" event={"ID":"215c6d19-72a6-4426-9af8-425be6d4d0bc","Type":"ContainerStarted","Data":"a0195eaa8321d4569da2ab35449074553d5b331606c602d2ed639960316c936b"} Jun 11 18:39:40.669696 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:40.669643 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-7tzfz" podStartSLOduration=0.915595772 podStartE2EDuration="6.669625804s" totalImagesPullingTime="5.754030032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:40.668200464 +0000 UTC m=+702.230397069" watchObservedRunningTime="2026-06-11 18:39:40.669625804 +0000 UTC m=+702.231822469" Jun 11 18:39:49.567568 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:49.567451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:39:49.667698 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:39:49.667665 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:20.083503 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:20.083456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:20.318879 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:20.318839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:25.894870 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:25.894835 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:26.042206 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:26.042178 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:26.145011 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:26.144935 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:29.272740 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:29.272702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:29.361792 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:29.361753 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:40:59.979782 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:40:59.979752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:00.223933 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:00.223901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:00.577734 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:00.577702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:00.670958 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:00.670928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:09.062784 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:09.062753 2576 generic.go:356] "Generic (PLEG): container finished" podID="72b97a12-e14f-46d4-a607-f0928e053c1c" containerID="c150a50e2a31121492965ee99c7bf555b7a86cbb6bc755b78b7452bc1814b2c7" exitCode=0 Jun 11 18:41:09.063194 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:09.062822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" event={"ID":"72b97a12-e14f-46d4-a607-f0928e053c1c","Type":"ContainerDied","Data":"c150a50e2a31121492965ee99c7bf555b7a86cbb6bc755b78b7452bc1814b2c7"} Jun 11 18:41:09.063236 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:09.063217 2576 scope.go:117] "RemoveContainer" containerID="c150a50e2a31121492965ee99c7bf555b7a86cbb6bc755b78b7452bc1814b2c7" Jun 11 18:41:09.064176 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:09.064152 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:41:09.064267 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:09.064221 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:41:09.064267 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:09.064254 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 18:41:10.069374 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:10.069343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" event={"ID":"72b97a12-e14f-46d4-a607-f0928e053c1c","Type":"ContainerStarted","Data":"0cf9073015742981194382e464d1d35d809484c0be5341a3857ad063cdc12bdd"} Jun 11 18:41:10.782847 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:10.782814 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:41:10.784083 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:10.784048 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lhqv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jun 11 18:41:10.784210 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:10.784113 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" podUID="72b97a12-e14f-46d4-a607-f0928e053c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jun 11 18:41:11.438963 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:11.438932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:11.620979 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:11.620926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:11.708808 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:11.708733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:41:11.782628 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:11.782596 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lhqv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jun 11 18:41:11.782799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:11.782649 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" podUID="72b97a12-e14f-46d4-a607-f0928e053c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jun 11 18:41:12.782273 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:12.782180 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lhqv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jun 11 18:41:12.782273 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:12.782235 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" podUID="72b97a12-e14f-46d4-a607-f0928e053c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jun 11 18:41:13.370744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:13.370707 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:41:13.782874 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:13.782834 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-lhqv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jun 11 18:41:13.783279 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:13.782895 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" podUID="72b97a12-e14f-46d4-a607-f0928e053c1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jun 11 18:41:14.786575 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:14.786543 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:41:14.787522 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:41:14.787501 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-lhqv9" Jun 11 18:42:01.527372 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:01.527327 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:01.640306 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:01.640273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:09.224028 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:09.223995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:12.843830 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:12.843794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:14.487001 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:14.486969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:14.588285 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:14.588247 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:22.970657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:22.970614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:28.414037 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:28.413999 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:34.310363 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:34.310330 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:37.449660 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:37.449625 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:37.550782 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:37.550743 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:38.848669 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:38.848632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:54.136096 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:54.136057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:42:58.894642 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:58.894616 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:42:58.896918 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:42:58.896893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:43:31.025210 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:43:31.025175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:49.645009 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:43:49.644977 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:54.268717 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:43:54.268685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:54.364649 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:43:54.364608 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:55.411347 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:43:55.411318 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:43:55.504915 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:43:55.504873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:00.147106 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.147068 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686725-7skg7"] Jun 11 18:45:00.150651 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.150626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:00.152998 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.152938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-j9x9s\"" Jun 11 18:45:00.160668 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.160640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686725-7skg7"] Jun 11 18:45:00.258338 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.258309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5bnh\" (UniqueName: \"kubernetes.io/projected/15400edc-7be1-406b-9459-959768c7d117-kube-api-access-z5bnh\") pod \"maas-api-key-cleanup-29686725-7skg7\" (UID: \"15400edc-7be1-406b-9459-959768c7d117\") " pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:00.358861 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.358818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5bnh\" (UniqueName: \"kubernetes.io/projected/15400edc-7be1-406b-9459-959768c7d117-kube-api-access-z5bnh\") pod \"maas-api-key-cleanup-29686725-7skg7\" (UID: \"15400edc-7be1-406b-9459-959768c7d117\") " pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:00.367014 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.366989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5bnh\" (UniqueName: \"kubernetes.io/projected/15400edc-7be1-406b-9459-959768c7d117-kube-api-access-z5bnh\") pod \"maas-api-key-cleanup-29686725-7skg7\" (UID: \"15400edc-7be1-406b-9459-959768c7d117\") " pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:00.462807 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.462714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:00.599278 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.599250 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686725-7skg7"] Jun 11 18:45:00.601664 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:45:00.601638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15400edc_7be1_406b_9459_959768c7d117.slice/crio-1d10c092ca6edf6dcdbbbfdea13f13adf123fc0b60196485a94f562f368baaee WatchSource:0}: Error finding container 1d10c092ca6edf6dcdbbbfdea13f13adf123fc0b60196485a94f562f368baaee: Status 404 returned error can't find the container with id 1d10c092ca6edf6dcdbbbfdea13f13adf123fc0b60196485a94f562f368baaee Jun 11 18:45:00.603937 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:00.603921 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:45:01.134206 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:01.134171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" event={"ID":"15400edc-7be1-406b-9459-959768c7d117","Type":"ContainerStarted","Data":"1d10c092ca6edf6dcdbbbfdea13f13adf123fc0b60196485a94f562f368baaee"} Jun 11 18:45:05.154956 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:05.154850 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" event={"ID":"15400edc-7be1-406b-9459-959768c7d117","Type":"ContainerStarted","Data":"226f3d359e82ada8f48be21f864d969a876a8eb168877ff274446897c278203f"} Jun 11 18:45:05.170967 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:05.170916 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" podStartSLOduration=1.241234471 podStartE2EDuration="5.170900666s" totalImagesPullingTime="3.929666195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:45:05.170069881 +0000 UTC m=+1026.732266506" watchObservedRunningTime="2026-06-11 18:45:05.170900666 +0000 UTC m=+1026.733097282" Jun 11 18:45:06.161274 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:06.161237 2576 generic.go:356] "Generic (PLEG): container finished" podID="15400edc-7be1-406b-9459-959768c7d117" containerID="226f3d359e82ada8f48be21f864d969a876a8eb168877ff274446897c278203f" exitCode=0 Jun 11 18:45:06.161683 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:06.161300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" event={"ID":"15400edc-7be1-406b-9459-959768c7d117","Type":"ContainerDied","Data":"226f3d359e82ada8f48be21f864d969a876a8eb168877ff274446897c278203f"} Jun 11 18:45:07.303800 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:07.303775 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:07.434536 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:07.434423 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5bnh\" (UniqueName: \"kubernetes.io/projected/15400edc-7be1-406b-9459-959768c7d117-kube-api-access-z5bnh\") pod \"15400edc-7be1-406b-9459-959768c7d117\" (UID: \"15400edc-7be1-406b-9459-959768c7d117\") " Jun 11 18:45:07.436624 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:07.436600 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15400edc-7be1-406b-9459-959768c7d117-kube-api-access-z5bnh" (OuterVolumeSpecName: "kube-api-access-z5bnh") pod "15400edc-7be1-406b-9459-959768c7d117" (UID: "15400edc-7be1-406b-9459-959768c7d117"). InnerVolumeSpecName "kube-api-access-z5bnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:45:07.535635 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:07.535593 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5bnh\" (UniqueName: \"kubernetes.io/projected/15400edc-7be1-406b-9459-959768c7d117-kube-api-access-z5bnh\") on node \"ip-10-0-128-178.ec2.internal\" DevicePath \"\"" Jun 11 18:45:08.171515 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:08.171472 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" Jun 11 18:45:08.171515 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:08.171474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686725-7skg7" event={"ID":"15400edc-7be1-406b-9459-959768c7d117","Type":"ContainerDied","Data":"1d10c092ca6edf6dcdbbbfdea13f13adf123fc0b60196485a94f562f368baaee"} Jun 11 18:45:08.171782 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:08.171536 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d10c092ca6edf6dcdbbbfdea13f13adf123fc0b60196485a94f562f368baaee" Jun 11 18:45:17.094021 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:17.093976 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:17.195200 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:17.195157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:22.239683 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:22.239630 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:23.713613 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.713564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:23.819204 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.819169 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7478944844-nqxdw"] Jun 11 18:45:23.819613 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.819597 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15400edc-7be1-406b-9459-959768c7d117" containerName="cleanup" Jun 11 18:45:23.819666 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.819615 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="15400edc-7be1-406b-9459-959768c7d117" containerName="cleanup" Jun 11 18:45:23.819703 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.819690 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="15400edc-7be1-406b-9459-959768c7d117" containerName="cleanup" Jun 11 18:45:23.824675 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.824656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:23.827981 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.827950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 18:45:23.828101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.828022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 18:45:23.828101 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.827958 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4rckp\"" Jun 11 18:45:23.830635 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.830611 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7478944844-nqxdw"] Jun 11 18:45:23.982547 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.982425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/815c8be6-61c1-4d14-a430-226cbdfd6649-webhook-cert\") pod \"maas-controller-7478944844-nqxdw\" (UID: \"815c8be6-61c1-4d14-a430-226cbdfd6649\") " pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:23.982547 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:23.982517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnnm\" (UniqueName: \"kubernetes.io/projected/815c8be6-61c1-4d14-a430-226cbdfd6649-kube-api-access-lgnnm\") pod \"maas-controller-7478944844-nqxdw\" (UID: \"815c8be6-61c1-4d14-a430-226cbdfd6649\") " pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:24.084020 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:24.083988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/815c8be6-61c1-4d14-a430-226cbdfd6649-webhook-cert\") pod \"maas-controller-7478944844-nqxdw\" (UID: \"815c8be6-61c1-4d14-a430-226cbdfd6649\") " pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:24.084192 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:24.084040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnnm\" (UniqueName: \"kubernetes.io/projected/815c8be6-61c1-4d14-a430-226cbdfd6649-kube-api-access-lgnnm\") pod \"maas-controller-7478944844-nqxdw\" (UID: \"815c8be6-61c1-4d14-a430-226cbdfd6649\") " pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:24.086428 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:24.086408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/815c8be6-61c1-4d14-a430-226cbdfd6649-webhook-cert\") pod \"maas-controller-7478944844-nqxdw\" (UID: \"815c8be6-61c1-4d14-a430-226cbdfd6649\") " pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:24.092557 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:24.092537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnnm\" (UniqueName: \"kubernetes.io/projected/815c8be6-61c1-4d14-a430-226cbdfd6649-kube-api-access-lgnnm\") pod \"maas-controller-7478944844-nqxdw\" (UID: \"815c8be6-61c1-4d14-a430-226cbdfd6649\") " pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:24.137593 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:24.137561 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:24.276570 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:24.276542 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7478944844-nqxdw"] Jun 11 18:45:24.278960 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:45:24.278932 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815c8be6_61c1_4d14_a430_226cbdfd6649.slice/crio-fe0cc7b6cfb84694c4cc214838e701344fadacb25204094b0e9202fa82abee67 WatchSource:0}: Error finding container fe0cc7b6cfb84694c4cc214838e701344fadacb25204094b0e9202fa82abee67: Status 404 returned error can't find the container with id fe0cc7b6cfb84694c4cc214838e701344fadacb25204094b0e9202fa82abee67 Jun 11 18:45:25.258440 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:25.258404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7478944844-nqxdw" event={"ID":"815c8be6-61c1-4d14-a430-226cbdfd6649","Type":"ContainerStarted","Data":"fe0cc7b6cfb84694c4cc214838e701344fadacb25204094b0e9202fa82abee67"} Jun 11 18:45:27.269583 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:27.269546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7478944844-nqxdw" event={"ID":"815c8be6-61c1-4d14-a430-226cbdfd6649","Type":"ContainerStarted","Data":"c27b413f740e67380efeb50cf198062cf9039bd2e31bfc2b19f983fba56aedd9"} Jun 11 18:45:27.269973 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:27.269653 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:27.288138 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:27.288069 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7478944844-nqxdw" podStartSLOduration=1.7959649930000001 podStartE2EDuration="4.288049532s" totalImagesPullingTime="2.492084539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:45:27.284608846 +0000 UTC m=+1048.846805472" watchObservedRunningTime="2026-06-11 18:45:27.288049532 +0000 UTC m=+1048.850246136" Jun 11 18:45:38.280454 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:38.280419 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7478944844-nqxdw" Jun 11 18:45:44.408974 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:44.408887 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:44.508885 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:44.508854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:45:47.702657 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:45:47.702620 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:23.227389 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:23.227356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:23.313044 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:23.312973 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:47.195019 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:47.194982 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:52.797324 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:52.797290 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:52.903833 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:52.903793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:52.996927 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:52.996894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:53.143413 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:53.143333 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:46:53.244367 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:46:53.244336 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:09.768906 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:09.768864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:09.876797 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:09.876763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:09.976852 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:09.976819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:15.790348 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:15.790267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:15.853547 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:15.853509 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:23.954207 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:23.954162 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:24.047095 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:24.047066 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:24.147382 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:24.147347 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:24.247030 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:24.246943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:40.657297 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:40.657264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:40.777287 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:40.777255 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:40.886500 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:40.886433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:40.952108 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:40.952023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:46.681327 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:46.681267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:46.781160 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:46.781124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:47:58.931716 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:58.931685 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:47:58.934531 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:58.934505 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xkzp6_f43e5b98-7fb5-4094-950f-f705d3553b90/ovn-acl-logging/0.log" Jun 11 18:47:59.816790 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:47:59.816757 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc9d4d789-h65r8_48780944-0ec3-437f-8371-51011660fa0b/nginx/0.log" Jun 11 18:48:00.161632 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:00.161556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686725-7skg7_15400edc-7be1-406b-9459-959768c7d117/cleanup/0.log" Jun 11 18:48:00.271617 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:00.271589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7478944844-nqxdw_815c8be6-61c1-4d14-a430-226cbdfd6649/manager/0.log" Jun 11 18:48:00.616606 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:00.616577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-5wfwt_4885c174-859c-4191-87e5-f6982202b288/copy-manifests/0.log" Jun 11 18:48:00.623751 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:00.623725 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-5wfwt_4885c174-859c-4191-87e5-f6982202b288/manager/0.log" Jun 11 18:48:02.351482 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:02.351456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nns9n_40475f44-de0d-4b46-9836-8202a43579b8/manager/0.log" Jun 11 18:48:02.463794 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:02.463761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dsqrd_dbced3ca-ca37-40af-a3e3-e2caa56db63e/manager/0.log" Jun 11 18:48:02.681178 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:02.681107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rfzsv_ef836258-a584-456c-8fe0-34e79fa0e173/registry-server/0.log" Jun 11 18:48:03.051068 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:03.051034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zfvdp_1047a9cc-02fe-49da-a8a5-3d46b1dac3eb/manager/0.log" Jun 11 18:48:03.395994 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:03.395917 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97954whs9_f2e2c992-2eb9-4d46-abe5-4eebb50054fa/istio-proxy/0.log" Jun 11 18:48:03.838152 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:03.838123 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/1.log" Jun 11 18:48:04.181949 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:04.181878 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f64c5d4-fwz5h_c2c50f08-6ac9-489a-962b-32c36a29e52e/router/0.log" Jun 11 18:48:08.832199 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.832165 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mx5g9/must-gather-g6n9k"] Jun 11 18:48:08.835700 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.835678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:08.838422 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.838400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mx5g9\"/\"openshift-service-ca.crt\"" Jun 11 18:48:08.839320 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.839297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mx5g9\"/\"default-dockercfg-xxwwp\"" Jun 11 18:48:08.839429 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.839358 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mx5g9\"/\"kube-root-ca.crt\"" Jun 11 18:48:08.840115 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.840095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:48:08.852909 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.852889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/must-gather-g6n9k"] Jun 11 18:48:08.912480 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.912446 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" limit=1024 Jun 11 18:48:08.999802 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.999768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/309543d1-4dc2-455d-94b3-f631ddbd470a-must-gather-output\") pod \"must-gather-g6n9k\" (UID: \"309543d1-4dc2-455d-94b3-f631ddbd470a\") " pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:08.999973 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:08.999832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d252n\" (UniqueName: \"kubernetes.io/projected/309543d1-4dc2-455d-94b3-f631ddbd470a-kube-api-access-d252n\") pod \"must-gather-g6n9k\" (UID: \"309543d1-4dc2-455d-94b3-f631ddbd470a\") " pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:09.100460 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:09.100376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/309543d1-4dc2-455d-94b3-f631ddbd470a-must-gather-output\") pod \"must-gather-g6n9k\" (UID: \"309543d1-4dc2-455d-94b3-f631ddbd470a\") " pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:09.100625 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:09.100529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d252n\" (UniqueName: \"kubernetes.io/projected/309543d1-4dc2-455d-94b3-f631ddbd470a-kube-api-access-d252n\") pod \"must-gather-g6n9k\" (UID: \"309543d1-4dc2-455d-94b3-f631ddbd470a\") " pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:09.100721 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:09.100705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/309543d1-4dc2-455d-94b3-f631ddbd470a-must-gather-output\") pod \"must-gather-g6n9k\" (UID: \"309543d1-4dc2-455d-94b3-f631ddbd470a\") " pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:09.108791 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:09.108768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d252n\" (UniqueName: \"kubernetes.io/projected/309543d1-4dc2-455d-94b3-f631ddbd470a-kube-api-access-d252n\") pod \"must-gather-g6n9k\" (UID: \"309543d1-4dc2-455d-94b3-f631ddbd470a\") " pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:09.145444 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:09.145412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/must-gather-g6n9k" Jun 11 18:48:09.287336 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:09.287310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/must-gather-g6n9k"] Jun 11 18:48:09.289407 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:48:09.289381 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod309543d1_4dc2_455d_94b3_f631ddbd470a.slice/crio-5f5599ad518e682da0db1a7f809db2e7ecec1bca368c384775de6c181598f46a WatchSource:0}: Error finding container 5f5599ad518e682da0db1a7f809db2e7ecec1bca368c384775de6c181598f46a: Status 404 returned error can't find the container with id 5f5599ad518e682da0db1a7f809db2e7ecec1bca368c384775de6c181598f46a Jun 11 18:48:10.051878 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:10.051840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/must-gather-g6n9k" event={"ID":"309543d1-4dc2-455d-94b3-f631ddbd470a","Type":"ContainerStarted","Data":"cfc6404084ed199941d6259d83c76afd8e0f62760b0c28c7618a255299797c79"} Jun 11 18:48:10.052242 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:10.051903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/must-gather-g6n9k" event={"ID":"309543d1-4dc2-455d-94b3-f631ddbd470a","Type":"ContainerStarted","Data":"5f5599ad518e682da0db1a7f809db2e7ecec1bca368c384775de6c181598f46a"} Jun 11 18:48:11.071773 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:11.071725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/must-gather-g6n9k" event={"ID":"309543d1-4dc2-455d-94b3-f631ddbd470a","Type":"ContainerStarted","Data":"015dff50258b9a43d6c00fe9d666e841c7407a2a0a032144392b8241a0a8b10f"} Jun 11 18:48:11.089178 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:11.089099 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mx5g9/must-gather-g6n9k" podStartSLOduration=2.437254819 podStartE2EDuration="3.089076102s" totalImagesPullingTime="651.821283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:48:11.088764654 +0000 UTC m=+1212.650961260" watchObservedRunningTime="2026-06-11 18:48:11.089076102 +0000 UTC m=+1212.651272699" Jun 11 18:48:11.544564 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:11.544481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8jxc4_0c78d645-9ac8-4c4a-8030-501aa1b7dffc/global-pull-secret-syncer/0.log" Jun 11 18:48:11.672319 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:11.672286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2g66n_dc7b581b-f379-4d02-8a13-69f7b2307575/konnectivity-agent/0.log" Jun 11 18:48:11.742799 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:11.742767 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-178.ec2.internal_53d466c74d7f99aaa0cbb6d6a61f99f9/haproxy/0.log" Jun 11 18:48:17.050254 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:17.050219 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nns9n_40475f44-de0d-4b46-9836-8202a43579b8/manager/0.log" Jun 11 18:48:17.078232 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:17.078169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dsqrd_dbced3ca-ca37-40af-a3e3-e2caa56db63e/manager/0.log" Jun 11 18:48:17.145178 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:17.145130 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rfzsv_ef836258-a584-456c-8fe0-34e79fa0e173/registry-server/0.log" Jun 11 18:48:17.272029 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:17.271983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zfvdp_1047a9cc-02fe-49da-a8a5-3d46b1dac3eb/manager/0.log" Jun 11 18:48:19.247833 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.247804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-k4ldg_a17b02f2-2e41-4dbd-bfcd-abd2dc81b123/cluster-monitoring-operator/0.log" Jun 11 18:48:19.363511 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.363456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64cc67bd4b-lvdbk_e4d5c79d-5b54-405d-b7db-9e15b14eb3ca/metrics-server/0.log" Jun 11 18:48:19.597085 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.597051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krz2j_3c44b40c-9116-4876-82ba-88642c25f42a/node-exporter/0.log" Jun 11 18:48:19.618349 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.618298 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krz2j_3c44b40c-9116-4876-82ba-88642c25f42a/kube-rbac-proxy/0.log" Jun 11 18:48:19.639318 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.639290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krz2j_3c44b40c-9116-4876-82ba-88642c25f42a/init-textfile/0.log" Jun 11 18:48:19.760374 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.760345 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/prometheus/0.log" Jun 11 18:48:19.782251 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.782221 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/config-reloader/0.log" Jun 11 18:48:19.811650 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.811592 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/thanos-sidecar/0.log" Jun 11 18:48:19.836192 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.836152 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/kube-rbac-proxy-web/0.log" Jun 11 18:48:19.860257 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.860107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/kube-rbac-proxy/0.log" Jun 11 18:48:19.883538 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.883473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/kube-rbac-proxy-thanos/0.log" Jun 11 18:48:19.909888 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.909837 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9410a766-ec3c-4886-bb10-8bd838b689a8/init-config-reloader/0.log" Jun 11 18:48:19.950705 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.950667 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-49xdv_e8e8130c-aa8b-4e69-8423-27110ec8b562/prometheus-operator/0.log" Jun 11 18:48:19.968706 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:19.968679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-49xdv_e8e8130c-aa8b-4e69-8423-27110ec8b562/kube-rbac-proxy/0.log" Jun 11 18:48:20.118349 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:20.118266 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/thanos-query/0.log" Jun 11 18:48:20.140730 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:20.140703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy-web/0.log" Jun 11 18:48:20.163746 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:20.163721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy/0.log" Jun 11 18:48:20.185593 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:20.185564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/prom-label-proxy/0.log" Jun 11 18:48:20.207718 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:20.207692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy-rules/0.log" Jun 11 18:48:20.228048 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:20.228022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-99dd59f7-grw52_800a4a2b-239a-4ec5-9aa1-dd86c2027dda/kube-rbac-proxy-metrics/0.log" Jun 11 18:48:22.636039 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.635998 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb"] Jun 11 18:48:22.640583 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.640554 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.647388 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.647359 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb"] Jun 11 18:48:22.738165 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.738123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-podres\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.738505 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.738469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-proc\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.738682 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.738662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqk2d\" (UniqueName: \"kubernetes.io/projected/23576d54-52c5-46fb-9919-1110888c5fab-kube-api-access-tqk2d\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.738802 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.738787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-sys\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.738986 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.738972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-lib-modules\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.839937 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.839898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-proc\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.839937 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.839939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqk2d\" (UniqueName: \"kubernetes.io/projected/23576d54-52c5-46fb-9919-1110888c5fab-kube-api-access-tqk2d\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.839958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-sys\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.840014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-lib-modules\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.840043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-podres\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.840053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-proc\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.840111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-sys\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840196 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.840184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-podres\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.840434 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.840208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23576d54-52c5-46fb-9919-1110888c5fab-lib-modules\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.849207 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.849175 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqk2d\" (UniqueName: \"kubernetes.io/projected/23576d54-52c5-46fb-9919-1110888c5fab-kube-api-access-tqk2d\") pod \"perf-node-gather-daemonset-gpdqb\" (UID: \"23576d54-52c5-46fb-9919-1110888c5fab\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:22.954001 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:22.953669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:23.132548 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:23.132513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb"] Jun 11 18:48:23.136566 ip-10-0-128-178 kubenswrapper[2576]: W0611 18:48:23.136533 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod23576d54_52c5_46fb_9919_1110888c5fab.slice/crio-e55f073e57190e99174258fb3986643e8ae9fd6b8abd3bf78ecfae4b88a513f9 WatchSource:0}: Error finding container e55f073e57190e99174258fb3986643e8ae9fd6b8abd3bf78ecfae4b88a513f9: Status 404 returned error can't find the container with id e55f073e57190e99174258fb3986643e8ae9fd6b8abd3bf78ecfae4b88a513f9 Jun 11 18:48:23.170643 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:23.170610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" event={"ID":"23576d54-52c5-46fb-9919-1110888c5fab","Type":"ContainerStarted","Data":"e55f073e57190e99174258fb3986643e8ae9fd6b8abd3bf78ecfae4b88a513f9"} Jun 11 18:48:23.376869 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:23.376832 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-4dwlj_35d8faf4-d392-4412-9908-31fb5429e97e/volume-data-source-validator/0.log" Jun 11 18:48:24.181154 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:24.181110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" event={"ID":"23576d54-52c5-46fb-9919-1110888c5fab","Type":"ContainerStarted","Data":"bce78df239d0e934f846f1f3d7d535e4a626b82a272d0e26b56a4a47578c2f96"} Jun 11 18:48:24.181681 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:24.181200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:24.201538 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:24.201469 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" podStartSLOduration=2.201446377 podStartE2EDuration="2.201446377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:48:24.199787532 +0000 UTC m=+1225.761984137" watchObservedRunningTime="2026-06-11 18:48:24.201446377 +0000 UTC m=+1225.763642962" Jun 11 18:48:24.525195 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:24.525164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7krc7_9fa2dbd4-57d8-4551-af23-631af026e3f0/dns/0.log" Jun 11 18:48:24.547468 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:24.547442 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7krc7_9fa2dbd4-57d8-4551-af23-631af026e3f0/kube-rbac-proxy/0.log" Jun 11 18:48:24.664393 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:24.664360 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gk72q_3e0e60f3-65ad-4766-bc3a-119af36da44e/dns-node-resolver/0.log" Jun 11 18:48:25.192158 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:25.192130 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6846986bdf-k8mt6_3d5e5cc9-e1b1-4852-b051-dce24807001f/registry/0.log" Jun 11 18:48:25.197689 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:25.197658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6846986bdf-k8mt6_3d5e5cc9-e1b1-4852-b051-dce24807001f/registry/1.log" Jun 11 18:48:25.216002 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:25.215980 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5wgjq_f19f85d6-05a8-4de9-bf42-ba230417e665/node-ca/0.log" Jun 11 18:48:26.169944 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:26.169913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97954whs9_f2e2c992-2eb9-4d46-abe5-4eebb50054fa/istio-proxy/0.log" Jun 11 18:48:26.286402 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:26.286373 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/0.log" Jun 11 18:48:26.297987 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:26.297959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/1.log" Jun 11 18:48:26.373506 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:26.373470 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f64c5d4-fwz5h_c2c50f08-6ac9-489a-962b-32c36a29e52e/router/0.log" Jun 11 18:48:26.962881 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:26.962853 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4r6jq_ad96837b-3531-45bf-8a01-7847f58e80fd/serve-healthcheck-canary/0.log" Jun 11 18:48:27.563057 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:27.563025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jxsg_c72691ad-a24b-4808-bfd3-0f42ed98b062/kube-rbac-proxy/0.log" Jun 11 18:48:27.583557 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:27.583532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jxsg_c72691ad-a24b-4808-bfd3-0f42ed98b062/exporter/0.log" Jun 11 18:48:27.604785 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:27.604753 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2jxsg_c72691ad-a24b-4808-bfd3-0f42ed98b062/extractor/0.log" Jun 11 18:48:29.886359 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:29.886329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc9d4d789-h65r8_48780944-0ec3-437f-8371-51011660fa0b/nginx/0.log" Jun 11 18:48:29.983802 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:29.983776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686725-7skg7_15400edc-7be1-406b-9459-959768c7d117/cleanup/0.log" Jun 11 18:48:30.018005 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:30.017973 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7478944844-nqxdw_815c8be6-61c1-4d14-a430-226cbdfd6649/manager/0.log" Jun 11 18:48:30.109647 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:30.109622 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-5wfwt_4885c174-859c-4191-87e5-f6982202b288/manager/0.log" Jun 11 18:48:30.130855 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:30.130824 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-5wfwt_4885c174-859c-4191-87e5-f6982202b288/copy-manifests/0.log" Jun 11 18:48:30.199477 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:30.199395 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-gpdqb" Jun 11 18:48:31.990795 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:31.990738 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d68fdb559-pprps_43c8bec3-e657-4b40-9edc-de43d81101b3/manager/0.log" Jun 11 18:48:36.882370 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:36.881501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97954whs9_f2e2c992-2eb9-4d46-abe5-4eebb50054fa/istio-proxy/0.log" Jun 11 18:48:36.973037 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:36.972970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/0.log" Jun 11 18:48:36.983503 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:36.983473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/1.log" Jun 11 18:48:37.040744 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:37.040718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f64c5d4-fwz5h_c2c50f08-6ac9-489a-962b-32c36a29e52e/router/0.log" Jun 11 18:48:37.884704 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:37.884670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-cntmr_c0917e79-f652-4d10-acc5-c28f3a83068e/kube-storage-version-migrator-operator/0.log" Jun 11 18:48:37.885298 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:37.885279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-cntmr_c0917e79-f652-4d10-acc5-c28f3a83068e/kube-storage-version-migrator-operator/1.log" Jun 11 18:48:38.217405 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:38.217319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97954whs9_f2e2c992-2eb9-4d46-abe5-4eebb50054fa/istio-proxy/0.log" Jun 11 18:48:38.311345 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:38.311317 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/0.log" Jun 11 18:48:38.323803 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:38.323747 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/1.log" Jun 11 18:48:38.382003 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:38.381974 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f64c5d4-fwz5h_c2c50f08-6ac9-489a-962b-32c36a29e52e/router/0.log" Jun 11 18:48:39.319774 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.319748 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/kube-multus-additional-cni-plugins/0.log" Jun 11 18:48:39.341042 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.341015 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/egress-router-binary-copy/0.log" Jun 11 18:48:39.361864 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.361840 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/cni-plugins/0.log" Jun 11 18:48:39.382363 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.382322 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/bond-cni-plugin/0.log" Jun 11 18:48:39.402396 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.402371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/routeoverride-cni/0.log" Jun 11 18:48:39.423084 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.423055 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/whereabouts-cni-bincopy/0.log" Jun 11 18:48:39.443511 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.443467 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlgj4_37349a6b-2cc5-494d-a734-0efa01e7aa61/whereabouts-cni/0.log" Jun 11 18:48:39.540819 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.540785 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z25c4_604c7605-88f9-43d0-b9d3-3cb68fc1b71b/kube-multus/0.log" Jun 11 18:48:39.610885 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.610807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8hpjf_81e97285-de0c-40d4-8a68-fa7c2408b535/network-metrics-daemon/0.log" Jun 11 18:48:39.630609 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.630577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8hpjf_81e97285-de0c-40d4-8a68-fa7c2408b535/kube-rbac-proxy/0.log" Jun 11 18:48:39.948651 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:39.948548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97954whs9_f2e2c992-2eb9-4d46-abe5-4eebb50054fa/istio-proxy/0.log" Jun 11 18:48:40.047467 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:40.047426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/0.log" Jun 11 18:48:40.059228 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:40.059176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-lhqv9_72b97a12-e14f-46d4-a607-f0928e053c1c/istio-proxy/1.log" Jun 11 18:48:40.114167 ip-10-0-128-178 kubenswrapper[2576]: I0611 18:48:40.114118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f64c5d4-fwz5h_c2c50f08-6ac9-489a-962b-32c36a29e52e/router/0.log"