Jun 08 20:52:40.094877 ip-10-0-135-176 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 20:52:40.094889 ip-10-0-135-176 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 20:52:40.094896 ip-10-0-135-176 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 20:52:40.095182 ip-10-0-135-176 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 20:52:50.333491 ip-10-0-135-176 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 20:52:50.333511 ip-10-0-135-176 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3691630c1e0843a482e6406ebaa07105 -- Jun 08 20:55:16.100684 ip-10-0-135-176 systemd[1]: Starting Kubernetes Kubelet... Jun 08 20:55:16.578314 ip-10-0-135-176 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 20:55:16.578314 ip-10-0-135-176 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 20:55:16.578314 ip-10-0-135-176 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 20:55:16.578314 ip-10-0-135-176 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 20:55:16.578314 ip-10-0-135-176 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 20:55:16.579422 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.579322 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 20:55:16.585047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585015 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 20:55:16.585047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585046 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585051 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585057 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585061 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585065 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585068 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585071 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585074 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585077 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585080 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585082 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585085 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585088 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585100 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585104 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585106 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585109 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585112 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585114 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585117 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 20:55:16.585134 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585120 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585123 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585127 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585130 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585133 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585136 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585159 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585162 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585165 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585167 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585170 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585173 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585175 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585177 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585180 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585182 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585185 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585187 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585190 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 20:55:16.585641 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585192 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585195 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585197 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585199 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585203 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585205 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585208 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585211 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585214 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585216 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585218 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585221 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585224 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585226 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585228 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585233 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585236 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585239 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 20:55:16.586144 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585242 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585247 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585250 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585253 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585256 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585259 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585261 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585264 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585267 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585269 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585272 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585274 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585277 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585279 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585281 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585284 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585287 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585289 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585308 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585311 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 20:55:16.586610 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585313 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585316 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585319 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585322 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585325 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585328 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585330 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585333 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585335 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585339 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585341 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585344 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585347 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585349 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585352 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585354 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585357 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585360 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585362 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585365 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 20:55:16.587097 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.585368 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586154 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586162 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586165 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586168 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586171 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586174 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586177 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586180 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586183 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586185 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586188 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586191 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586193 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586196 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586199 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586202 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586205 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586207 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586210 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 20:55:16.587658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586213 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586218 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586222 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586225 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586227 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586230 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586233 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586236 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586238 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586241 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586244 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586246 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586249 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586251 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586254 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586256 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586259 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586261 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586264 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586267 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 20:55:16.588172 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586269 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586272 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586274 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586277 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586279 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586283 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586286 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586289 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586308 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586311 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586314 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586317 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586320 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586323 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586326 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586328 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586331 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586334 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586336 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586339 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 20:55:16.588730 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586342 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586344 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586347 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586349 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586352 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586354 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586357 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586360 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586362 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586368 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586371 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586373 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586377 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586380 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586383 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586386 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586389 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586391 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586394 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 20:55:16.589227 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586397 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586400 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586403 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586406 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586408 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586411 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586414 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586416 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586419 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586422 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586424 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586427 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586430 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586433 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586436 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586438 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586440 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586443 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586446 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586450 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 20:55:16.589718 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586454 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586859 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586867 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586870 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586872 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586875 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586878 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586881 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586883 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586886 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586889 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586893 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586897 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586902 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586905 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586908 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586911 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586914 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586916 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 20:55:16.590220 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586919 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586922 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586924 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586927 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586929 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586932 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586935 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586937 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586940 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586942 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586945 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586949 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586952 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586956 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586959 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586963 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586966 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586968 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586971 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 20:55:16.590714 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586973 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586976 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586978 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586981 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586986 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586988 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586991 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586994 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586996 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.586999 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587001 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587004 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587007 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587010 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587012 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587015 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587018 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587020 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587022 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587025 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 08 20:55:16.591205 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587027 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587030 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587032 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587035 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587037 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587039 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587042 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587044 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587048 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587051 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587053 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587056 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587058 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587060 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587063 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587065 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587069 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587072 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587075 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587078 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 20:55:16.591745 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587081 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587083 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587086 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587089 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587091 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587093 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587096 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587098 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587101 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587104 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587106 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587109 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587112 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587114 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587117 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587119 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587122 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587124 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587126 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587129 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 20:55:16.592267 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587133 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587136 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587223 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587237 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587245 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587250 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587254 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587257 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587262 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587267 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587270 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587273 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587276 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587279 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587282 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587286 2554 flags.go:64] FLAG: --cgroup-root="" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587289 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587306 2554 flags.go:64] FLAG: --client-ca-file="" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587309 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587312 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587317 2554 flags.go:64] FLAG: --cluster-domain="" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587320 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587323 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587326 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 20:55:16.592833 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587329 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587333 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587336 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587339 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587342 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587346 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587348 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587351 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587356 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587359 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587364 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587367 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587369 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587372 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587375 2554 flags.go:64] FLAG: --enable-server="true" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587378 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587382 2554 flags.go:64] FLAG: --event-burst="100" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587386 2554 flags.go:64] FLAG: --event-qps="50" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587389 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587392 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587395 2554 flags.go:64] FLAG: --eviction-hard="" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587399 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587401 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587404 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587408 2554 flags.go:64] FLAG: --eviction-soft="" Jun 08 20:55:16.593443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587411 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587414 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587416 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587419 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587422 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587424 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587427 2554 flags.go:64] FLAG: --feature-gates="" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587431 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587434 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587437 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587440 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587443 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587446 2554 flags.go:64] FLAG: --help="false" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587449 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587452 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587458 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587461 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587465 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587468 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587471 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587474 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587477 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587480 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 20:55:16.594048 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587483 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587486 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587489 2554 flags.go:64] FLAG: --kube-reserved="" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587492 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587495 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587498 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587500 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587503 2554 flags.go:64] FLAG: --lock-file="" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587506 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587509 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587512 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587518 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587521 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587523 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587526 2554 flags.go:64] FLAG: --logging-format="text" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587529 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587532 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587535 2554 flags.go:64] FLAG: --manifest-url="" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587537 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587542 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587544 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587548 2554 flags.go:64] FLAG: --max-pods="110" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587551 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587554 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587558 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 20:55:16.594679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587562 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587565 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587568 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587571 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587578 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587581 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587584 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587587 2554 flags.go:64] FLAG: --pod-cidr="" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587590 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587596 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587599 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587602 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587605 2554 flags.go:64] FLAG: --port="10250" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587607 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587610 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c6bcb1d56927be2f" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587613 2554 flags.go:64] FLAG: --qos-reserved="" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587616 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587620 2554 flags.go:64] FLAG: --register-node="true" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587623 2554 flags.go:64] FLAG: --register-with-taints="" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587626 2554 flags.go:64] FLAG: --registry-burst="10" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587629 2554 flags.go:64] FLAG: --registry-qps="5" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587632 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587634 2554 flags.go:64] FLAG: --reserved-memory="" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587638 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587641 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 20:55:16.595347 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587644 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587646 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587649 2554 flags.go:64] FLAG: --runonce="false" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587652 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587655 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587658 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587663 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587666 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587669 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587672 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587676 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587679 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587682 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587684 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587687 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587692 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587695 2554 flags.go:64] FLAG: --system-cgroups="" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587698 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587703 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587706 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587709 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587714 2554 flags.go:64] FLAG: --tls-min-version="" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587717 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587719 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587722 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 20:55:16.596010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587725 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587728 2554 flags.go:64] FLAG: --v="2" Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587733 2554 flags.go:64] FLAG: --version="false" Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587737 2554 flags.go:64] FLAG: --vmodule="" Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587741 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.587744 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587864 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587868 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587872 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587876 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587879 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587882 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587885 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587889 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587891 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587894 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587897 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587899 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587902 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587904 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587907 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 20:55:16.596675 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587909 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587914 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587917 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587920 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587922 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587925 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587927 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587929 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587932 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587935 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587937 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587940 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587943 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587946 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587949 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587953 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587957 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587960 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587962 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 20:55:16.597200 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587965 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587967 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587970 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587972 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587975 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587978 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587980 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587983 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587985 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587988 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587991 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587993 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587996 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.587998 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588002 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588004 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588007 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588009 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588011 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 20:55:16.598043 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588015 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588019 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588022 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588024 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588027 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588030 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588032 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588036 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588038 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588040 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588043 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588045 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588048 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588050 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588052 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588055 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588057 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588060 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588062 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588065 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 20:55:16.598664 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588068 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588070 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588072 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588075 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588077 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588080 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588082 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588086 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588088 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588090 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588093 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588096 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588098 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588101 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588103 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588106 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588108 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588111 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588113 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588116 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 20:55:16.599166 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588119 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588122 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588124 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588126 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588129 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.588131 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.588901 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.596591 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.596614 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.596629 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.596635 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596699 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596705 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596708 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596711 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 20:55:16.599700 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596714 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596717 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596720 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596723 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596726 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596728 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596731 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596734 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596736 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596739 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596742 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596744 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596747 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596749 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596752 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596754 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596757 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596760 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596763 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596765 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 20:55:16.600095 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596767 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596770 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596772 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596775 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596777 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596780 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596783 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596786 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596788 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596791 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596793 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596796 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596798 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596801 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596803 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596806 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596809 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596811 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596813 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 20:55:16.600717 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596816 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596819 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596822 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596824 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596827 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596829 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596831 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596835 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596840 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596843 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596845 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596849 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596852 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596854 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596857 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596859 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596861 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596864 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596867 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 20:55:16.601264 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596870 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596873 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596875 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596878 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596881 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596883 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596885 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596888 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596890 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596894 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596898 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596900 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596903 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596907 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596910 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596913 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596916 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596918 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596920 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 20:55:16.601755 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596923 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596925 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596928 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596931 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596933 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596937 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596940 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596943 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596945 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596948 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596950 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596953 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596957 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596960 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596962 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596964 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596967 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 20:55:16.602274 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.596970 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.596975 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597513 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597797 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597803 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597808 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597814 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597818 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597830 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597836 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597840 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597844 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597848 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597852 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 20:55:16.602726 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597857 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597861 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597866 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597870 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597874 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597878 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597886 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597890 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597896 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597902 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597908 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597912 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597916 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597921 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597925 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597932 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597938 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597943 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 20:55:16.603086 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597948 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597958 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597962 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597967 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597972 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597976 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597981 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597985 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597989 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597994 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.597999 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598003 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598007 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598011 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598020 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598024 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598029 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598033 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598037 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 20:55:16.603565 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598043 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598049 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598055 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598061 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598066 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598071 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598075 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598084 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598089 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598094 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598099 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598104 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598109 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598114 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598118 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598123 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598127 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598132 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598137 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598147 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 20:55:16.604038 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598151 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598156 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598160 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598164 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598170 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598175 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598180 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598184 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598188 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598193 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598197 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598205 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598209 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598213 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598217 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598222 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598226 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598231 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598236 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598240 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 20:55:16.604562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598245 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598249 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598254 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598258 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598266 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598277 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598322 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598331 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598336 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:16.598342 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.598354 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.598706 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.602119 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.603781 2554 server.go:1019] "Starting client certificate rotation" Jun 08 20:55:16.605047 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.603906 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 20:55:16.605425 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.603975 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 20:55:16.606922 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.606902 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 20:55:16.609575 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.609550 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 20:55:16.624623 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.624598 2554 log.go:25] "Validated CRI v1 runtime API" Jun 08 20:55:16.627913 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.627887 2554 log.go:25] "Validated CRI v1 image API" Jun 08 20:55:16.628753 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.628739 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 20:55:16.631673 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.631645 2554 fs.go:135] Filesystem UUIDs: map[6a0877bc-2f84-4a01-abbd-4b98d95deedb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f1d7edb3-6bf7-4fe4-bbbe-0750a1a96bd3:/dev/nvme0n1p3] Jun 08 20:55:16.631798 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.631669 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 20:55:16.636709 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.636678 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 20:55:16.637523 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.637382 2554 manager.go:216] Machine: {Timestamp:2026-06-08 20:55:16.63572895 +0000 UTC m=+0.399570268 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096480 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c8ca6a37ad5528293cffcb9002959 SystemUUID:ec2c8ca6-a37a-d552-8293-cffcb9002959 BootID:3691630c-1e08-43a4-82e6-406ebaa07105 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:ac:13:b4:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:ac:13:b4:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:ff:65:73:f7:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 20:55:16.637523 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.637523 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 20:55:16.637694 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.637665 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 20:55:16.642083 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.642032 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 20:55:16.642239 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.642085 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-176.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 20:55:16.643005 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.642988 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 20:55:16.643005 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.643006 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 20:55:16.643076 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.643016 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 20:55:16.643877 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.643858 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 20:55:16.645143 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.645125 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 20:55:16.649376 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649352 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 08 20:55:16.649512 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649502 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 20:55:16.649550 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649535 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 08 20:55:16.649550 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649546 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 20:55:16.649623 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649558 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 20:55:16.649623 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649570 2554 kubelet.go:398] "Adding apiserver pod source" Jun 08 20:55:16.649623 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.649582 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 20:55:16.650080 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.650065 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 20:55:16.650123 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.650093 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 20:55:16.663529 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.663496 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 20:55:16.665969 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.665445 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 20:55:16.665969 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.665488 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 20:55:16.665969 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.665607 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 20:55:16.665969 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.665608 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 20:55:16.666494 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666480 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 20:55:16.666543 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666498 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 20:55:16.666543 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666509 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 20:55:16.666543 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666518 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 20:55:16.666543 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666529 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 20:55:16.666543 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666534 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 20:55:16.666543 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666543 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 20:55:16.666704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666549 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 20:55:16.666704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666558 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 20:55:16.666704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666566 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 20:55:16.666704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666578 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 20:55:16.666704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.666586 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 20:55:16.667444 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.667433 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 20:55:16.667444 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.667444 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 20:55:16.671240 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.671217 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-176.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 20:55:16.671390 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.671359 2554 server.go:1268] "Started kubelet" Jun 08 20:55:16.671479 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.671444 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 20:55:16.672281 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.671893 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 20:55:16.672413 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.672333 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 20:55:16.672529 ip-10-0-135-176 systemd[1]: Started Kubernetes Kubelet. Jun 08 20:55:16.673051 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.672574 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 08 20:55:16.674433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.674414 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 20:55:16.678491 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.677317 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-176.ec2.internal.18b73683a42ca494 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-176.ec2.internal,UID:ip-10-0-135-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-176.ec2.internal,},FirstTimestamp:2026-06-08 20:55:16.671325332 +0000 UTC m=+0.435166659,LastTimestamp:2026-06-08 20:55:16.671325332 +0000 UTC m=+0.435166659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-176.ec2.internal,}" Jun 08 20:55:16.684714 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.684683 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zz45" Jun 08 20:55:16.685049 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.685030 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 20:55:16.687280 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.687256 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 20:55:16.687280 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.687256 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zz45" Jun 08 20:55:16.687467 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.687286 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 20:55:16.687629 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.687592 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:16.688115 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.688056 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 20:55:16.688115 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.688073 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 20:55:16.688278 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.688262 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 20:55:16.688403 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.688387 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 08 20:55:16.688403 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.688403 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 08 20:55:16.689338 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689317 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 20:55:16.689338 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689339 2554 factory.go:55] Registering systemd factory Jun 08 20:55:16.689479 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689348 2554 factory.go:223] Registration of the systemd container factory successfully Jun 08 20:55:16.689679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689616 2554 factory.go:153] Registering CRI-O factory Jun 08 20:55:16.689679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689637 2554 factory.go:223] Registration of the crio container factory successfully Jun 08 20:55:16.689679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689669 2554 factory.go:103] Registering Raw factory Jun 08 20:55:16.689679 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.689683 2554 manager.go:1196] Started watching for new ooms in manager Jun 08 20:55:16.690116 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.690097 2554 manager.go:349] Starting recovery of all containers Jun 08 20:55:16.690116 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.690105 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 20:55:16.690258 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.690128 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 20:55:16.698325 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.698010 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 20:55:16.701838 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.701812 2554 manager.go:354] Recovery completed Jun 08 20:55:16.707809 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.707785 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.710138 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710111 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.710237 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710152 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.710237 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710164 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.710781 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710766 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 20:55:16.710781 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710780 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 20:55:16.710883 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710787 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.710883 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.710797 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 08 20:55:16.711634 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.711616 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.711688 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.711650 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.711688 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.711664 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.712898 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.712884 2554 policy_none.go:49] "None policy: Start" Jun 08 20:55:16.712947 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.712902 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 20:55:16.712947 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.712913 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 20:55:16.714594 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.714577 2554 policy_none.go:47] "Start" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.765594 2554 manager.go:337] "Starting Device Plugin manager" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.765638 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.765651 2554 server.go:87] "Starting device plugin registration server" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.765971 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.765981 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.766084 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.766184 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.766193 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.768071 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.768131 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.779891 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.779937 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.779961 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 20:55:16.781248 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.780002 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 20:55:16.782681 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.782660 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 20:55:16.866952 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.866838 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.868064 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.868046 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.868156 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.868080 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.868156 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.868091 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.868156 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.868117 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.875246 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.875221 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.875338 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.875261 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-176.ec2.internal\": node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:16.880272 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.880241 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal"] Jun 08 20:55:16.880363 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.880352 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.881524 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.881504 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.881622 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.881536 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.881622 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.881546 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.884015 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.883999 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.884114 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.884102 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.884166 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.884133 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.884926 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.884909 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.885013 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.884946 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.885013 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.884957 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.885013 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.884911 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.885102 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.885025 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.885102 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.885041 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.887276 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.887254 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.887341 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.887306 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 20:55:16.889465 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.889444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9c5582db71cca6a5029e095ab8772af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal\" (UID: \"e9c5582db71cca6a5029e095ab8772af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.889567 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.889478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9c5582db71cca6a5029e095ab8772af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal\" (UID: \"e9c5582db71cca6a5029e095ab8772af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.889567 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.889507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e42e4eb741c319d6e7c4d1ea6b9bf3e8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-176.ec2.internal\" (UID: \"e42e4eb741c319d6e7c4d1ea6b9bf3e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.893077 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.893049 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientMemory" Jun 08 20:55:16.893216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.893091 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 20:55:16.893216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.893102 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeHasSufficientPID" Jun 08 20:55:16.901036 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.901010 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-176.ec2.internal\" not found" node="ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.906534 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.906508 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:16.907715 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:16.907690 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-176.ec2.internal\" not found" node="ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.990684 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.990643 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9c5582db71cca6a5029e095ab8772af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal\" (UID: \"e9c5582db71cca6a5029e095ab8772af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.990684 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.990604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9c5582db71cca6a5029e095ab8772af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal\" (UID: \"e9c5582db71cca6a5029e095ab8772af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.990913 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.990716 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9c5582db71cca6a5029e095ab8772af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal\" (UID: \"e9c5582db71cca6a5029e095ab8772af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.990913 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.990765 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9c5582db71cca6a5029e095ab8772af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal\" (UID: \"e9c5582db71cca6a5029e095ab8772af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.990913 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.990794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e42e4eb741c319d6e7c4d1ea6b9bf3e8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-176.ec2.internal\" (UID: \"e42e4eb741c319d6e7c4d1ea6b9bf3e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" Jun 08 20:55:16.990913 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:16.990819 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e42e4eb741c319d6e7c4d1ea6b9bf3e8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-176.ec2.internal\" (UID: \"e42e4eb741c319d6e7c4d1ea6b9bf3e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" Jun 08 20:55:17.007661 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.007623 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.108761 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.108723 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.208579 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.208488 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:17.209593 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.209571 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.213718 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.213700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" Jun 08 20:55:17.309829 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.309785 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.410471 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.410434 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.511116 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.511027 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.602717 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.602675 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 20:55:17.603380 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.602880 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 20:55:17.612031 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.612001 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.692022 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.691973 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 20:50:16 +0000 UTC" deadline="2028-02-09 12:42:41.454432539 +0000 UTC" Jun 08 20:55:17.692022 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.692009 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14655h47m23.762427736s" Jun 08 20:55:17.712478 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:17.712436 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-176.ec2.internal\" not found" Jun 08 20:55:17.778938 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.778847 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 20:55:17.788423 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.788388 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" Jun 08 20:55:17.802639 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.802609 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 20:55:17.804583 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.804563 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" Jun 08 20:55:17.811597 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.811578 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 20:55:17.862924 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.862900 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 20:55:17.873919 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:17.873870 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42e4eb741c319d6e7c4d1ea6b9bf3e8.slice/crio-1838c358c38110fce0335c7672c3a53e18fcf4422ce8ccb61e299caab6daae17 WatchSource:0}: Error finding container 1838c358c38110fce0335c7672c3a53e18fcf4422ce8ccb61e299caab6daae17: Status 404 returned error can't find the container with id 1838c358c38110fce0335c7672c3a53e18fcf4422ce8ccb61e299caab6daae17 Jun 08 20:55:17.874414 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:17.874381 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c5582db71cca6a5029e095ab8772af.slice/crio-eb56d18a8d3647ff459fc8a482ae045951dd69a9e2a0848a8c473a4aa4afbd42 WatchSource:0}: Error finding container eb56d18a8d3647ff459fc8a482ae045951dd69a9e2a0848a8c473a4aa4afbd42: Status 404 returned error can't find the container with id eb56d18a8d3647ff459fc8a482ae045951dd69a9e2a0848a8c473a4aa4afbd42 Jun 08 20:55:17.880947 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:17.880931 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 20:55:18.087797 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.087708 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 20:55:18.650734 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.650694 2554 apiserver.go:52] "Watching apiserver" Jun 08 20:55:18.669711 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.669675 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 20:55:18.670260 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.670235 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-hdncs","openshift-network-operator/iptables-alerter-56hbd","openshift-ovn-kubernetes/ovnkube-node-9lqcd","kube-system/global-pull-secret-syncer-kpp5z","kube-system/konnectivity-agent-m6bnc","kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal","openshift-cluster-node-tuning-operator/tuned-c5msw","openshift-dns/node-resolver-tcsbt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal","openshift-multus/multus-5tzcw","openshift-multus/network-metrics-daemon-frhgs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p","openshift-image-registry/node-ca-tlvw2","openshift-multus/multus-additional-cni-plugins-jpnpk"] Jun 08 20:55:18.672974 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.672938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.675287 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.675253 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.675981 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.675959 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 20:55:18.675981 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.675995 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wwr62\"" Jun 08 20:55:18.676201 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.676187 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 20:55:18.678216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.678191 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.678451 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.678434 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 20:55:18.678784 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.678767 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfdvt\"" Jun 08 20:55:18.679010 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.678994 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.679326 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.679308 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.680059 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.680041 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.682256 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.681809 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 20:55:18.682256 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.682025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.682256 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.682096 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:18.682636 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.682614 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 20:55:18.682709 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.682614 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 20:55:18.682762 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.682699 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.682840 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.682823 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 20:55:18.683409 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.683391 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.683514 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.683414 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6gqlp\"" Jun 08 20:55:18.683514 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.683463 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.683645 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.683608 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mqkwg\"" Jun 08 20:55:18.683645 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.683615 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.684443 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.684378 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:18.684532 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.684515 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:18.687115 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.687084 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.687850 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.687835 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 20:55:18.689427 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.689404 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.689526 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.689513 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.689694 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.689679 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hw2b6\"" Jun 08 20:55:18.689941 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.689927 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.692380 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.692621 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.692843 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.693034 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xvlkk\"" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.693226 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.693741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:18.693885 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.693842 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:18.696972 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.696949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.699505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.699479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.700043 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-kubelet\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700126 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700126 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2453927-0895-42dc-b314-284c1221f9d6-dbus\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.700221 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700124 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d381a5f4-7df6-4200-8659-e6e42ec1232e-cni-binary-copy\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700221 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-daemon-config\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700221 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700184 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m5lf\" (UniqueName: \"kubernetes.io/projected/d381a5f4-7df6-4200-8659-e6e42ec1232e-kube-api-access-6m5lf\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700221 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3862e89-7fcb-4319-b18b-15340574aa27-konnectivity-ca\") pod \"konnectivity-agent-m6bnc\" (UID: \"b3862e89-7fcb-4319-b18b-15340574aa27\") " pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphc2\" (UniqueName: \"kubernetes.io/projected/e97709c8-4d49-4a31-8846-721ab0966d30-kube-api-access-hphc2\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700276 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-cni-netd\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700322 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-etc-kubernetes\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700363 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-kubelet\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700387 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-slash\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-ovn\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700433 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-node-log\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-run-ovn-kubernetes\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-cni-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-conf-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700519 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-multus-certs\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4504bb35-e317-4eea-adbc-6d6d41fdb215-host\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-systemd-units\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97709c8-4d49-4a31-8846-721ab0966d30-tmp\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd9f35b9-cbda-4437-ba6b-387ed48084cf-hosts-file\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9pv\" (UniqueName: \"kubernetes.io/projected/cd9f35b9-cbda-4437-ba6b-387ed48084cf-kube-api-access-pk9pv\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700681 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-cnibin\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-run-netns\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-ovnkube-config\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-sys\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9f35b9-cbda-4437-ba6b-387ed48084cf-tmp-dir\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-socket-dir-parent\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-netns\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.700834 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-hostroot\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4504bb35-e317-4eea-adbc-6d6d41fdb215-serviceca\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-os-release\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-env-overrides\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.700984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-modprobe-d\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysctl-d\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701019 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-etc-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701085 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-run\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-lib-modules\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-ovnkube-script-lib\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701146 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-host\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701170 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-cni-bin\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35984130-d201-4a4c-a7da-68430945eb38-ovn-node-metrics-cert\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-cni-multus\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3862e89-7fcb-4319-b18b-15340574aa27-agent-certs\") pod \"konnectivity-agent-m6bnc\" (UID: \"b3862e89-7fcb-4319-b18b-15340574aa27\") " pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701273 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-log-socket\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.701721 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-var-lib-kubelet\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701340 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-var-lib-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701390 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcgz\" (UniqueName: \"kubernetes.io/projected/35984130-d201-4a4c-a7da-68430945eb38-kube-api-access-jzcgz\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-kubernetes\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysctl-conf\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-system-cni-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701463 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-k8s-cni-cncf-io\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-systemd\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701515 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e97709c8-4d49-4a31-8846-721ab0966d30-etc-tuned\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvfxm\" (UniqueName: \"kubernetes.io/projected/4504bb35-e317-4eea-adbc-6d6d41fdb215-kube-api-access-jvfxm\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701595 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2453927-0895-42dc-b314-284c1221f9d6-kubelet-config\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701619 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysconfig\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-systemd\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.702505 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.701679 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-cni-bin\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.703183 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.702704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.705819 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.703559 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 20:55:18.705819 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.704799 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.705819 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.705756 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.706201 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.706183 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hzkc\"" Jun 08 20:55:18.707102 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.707079 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 20:55:18.707444 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.707424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zqwns\"" Jun 08 20:55:18.707878 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.707859 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 20:55:18.709581 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.709560 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 20:55:18.712942 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.712918 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 20:55:18.713329 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.713282 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 20:55:18.713652 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.713626 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 20:55:18.713652 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.713634 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ttxf8\"" Jun 08 20:55:18.722244 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.722212 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-shj2x" Jun 08 20:55:18.725853 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.725752 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 20:55:18.730965 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.730938 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-shj2x" Jun 08 20:55:18.786943 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.786376 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" event={"ID":"e42e4eb741c319d6e7c4d1ea6b9bf3e8","Type":"ContainerStarted","Data":"1838c358c38110fce0335c7672c3a53e18fcf4422ce8ccb61e299caab6daae17"} Jun 08 20:55:18.787860 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.787826 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" event={"ID":"e9c5582db71cca6a5029e095ab8772af","Type":"ContainerStarted","Data":"eb56d18a8d3647ff459fc8a482ae045951dd69a9e2a0848a8c473a4aa4afbd42"} Jun 08 20:55:18.789841 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.789808 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 20:55:18.801995 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.801959 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-etc-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802181 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-run\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802181 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802076 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-run\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802181 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802075 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-etc-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802181 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-lib-modules\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802181 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802160 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-etc-selinux\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-ovnkube-script-lib\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802206 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-host\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-os-release\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-cni-bin\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802277 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-lib-modules\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802322 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35984130-d201-4a4c-a7da-68430945eb38-ovn-node-metrics-cert\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802340 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-host\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-cni-multus\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3862e89-7fcb-4319-b18b-15340574aa27-agent-certs\") pod \"konnectivity-agent-m6bnc\" (UID: \"b3862e89-7fcb-4319-b18b-15340574aa27\") " pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-log-socket\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802363 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-cni-bin\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802457 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802441 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-var-lib-kubelet\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802468 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-cni-multus\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz4tf\" (UniqueName: \"kubernetes.io/projected/2e864677-53de-4e46-9964-638364be4d26-kube-api-access-wz4tf\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802511 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-log-socket\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802498 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-var-lib-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcgz\" (UniqueName: \"kubernetes.io/projected/35984130-d201-4a4c-a7da-68430945eb38-kube-api-access-jzcgz\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802570 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-kubernetes\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysctl-conf\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-system-cni-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-k8s-cni-cncf-io\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-systemd\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e97709c8-4d49-4a31-8846-721ab0966d30-etc-tuned\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvfxm\" (UniqueName: \"kubernetes.io/projected/4504bb35-e317-4eea-adbc-6d6d41fdb215-kube-api-access-jvfxm\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802752 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-kubernetes\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802765 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802800 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-var-lib-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802820 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-var-lib-kubelet\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.802978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802830 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2453927-0895-42dc-b314-284c1221f9d6-kubelet-config\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802968 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysctl-conf\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803036 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-system-cni-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803047 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-ovnkube-script-lib\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803083 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-k8s-cni-cncf-io\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.802775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2453927-0895-42dc-b314-284c1221f9d6-kubelet-config\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803120 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-systemd\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-host-slash\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803163 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-openvswitch\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803196 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysconfig\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803220 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-systemd\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-iptables-alerter-script\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803322 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysconfig\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803340 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-systemd\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-cni-bin\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.803712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803359 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-cni-bin\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-kubelet\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803432 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2453927-0895-42dc-b314-284c1221f9d6-dbus\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803457 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803476 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-var-lib-kubelet\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d381a5f4-7df6-4200-8659-e6e42ec1232e-cni-binary-copy\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803478 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-daemon-config\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803574 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m5lf\" (UniqueName: \"kubernetes.io/projected/d381a5f4-7df6-4200-8659-e6e42ec1232e-kube-api-access-6m5lf\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803597 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3862e89-7fcb-4319-b18b-15340574aa27-konnectivity-ca\") pod \"konnectivity-agent-m6bnc\" (UID: \"b3862e89-7fcb-4319-b18b-15340574aa27\") " pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803606 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2453927-0895-42dc-b314-284c1221f9d6-dbus\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803648 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphc2\" (UniqueName: \"kubernetes.io/projected/e97709c8-4d49-4a31-8846-721ab0966d30-kube-api-access-hphc2\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262c2\" (UniqueName: \"kubernetes.io/projected/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-kube-api-access-262c2\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-registration-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.804561 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-cni-netd\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-etc-kubernetes\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-kubelet\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-slash\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803864 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-ovn\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-node-log\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-system-cni-dir\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-cnibin\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-run-ovn-kubernetes\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-cni-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.803988 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-conf-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-multus-certs\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4504bb35-e317-4eea-adbc-6d6d41fdb215-host\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-systemd-units\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804068 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d381a5f4-7df6-4200-8659-e6e42ec1232e-cni-binary-copy\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97709c8-4d49-4a31-8846-721ab0966d30-tmp\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-slash\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.805483 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd9f35b9-cbda-4437-ba6b-387ed48084cf-hosts-file\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9pv\" (UniqueName: \"kubernetes.io/projected/cd9f35b9-cbda-4437-ba6b-387ed48084cf-kube-api-access-pk9pv\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-cnibin\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-run-netns\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-ovnkube-config\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804429 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-cni-netd\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804474 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-sys\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804509 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmnp\" (UniqueName: \"kubernetes.io/projected/d5f0742c-7c89-45cb-8300-90f5fd50b571-kube-api-access-pqmnp\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-device-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9f35b9-cbda-4437-ba6b-387ed48084cf-tmp-dir\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-socket-dir-parent\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804594 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-daemon-config\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-netns\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804640 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-cni-binary-copy\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804662 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-run-ovn\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804718 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-node-log\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804806 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-ovnkube-config\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804854 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-etc-kubernetes\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.806355 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804855 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-cni-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804909 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-kubelet\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-socket-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804963 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-sys-fs\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xd8\" (UniqueName: \"kubernetes.io/projected/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-kube-api-access-z2xd8\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-hostroot\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4504bb35-e317-4eea-adbc-6d6d41fdb215-serviceca\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-os-release\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-env-overrides\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805070 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd9f35b9-cbda-4437-ba6b-387ed48084cf-hosts-file\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.804966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-systemd-units\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805178 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-cnibin\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805195 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3862e89-7fcb-4319-b18b-15340574aa27-konnectivity-ca\") pod \"konnectivity-agent-m6bnc\" (UID: \"b3862e89-7fcb-4319-b18b-15340574aa27\") " pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-multus-certs\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805248 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-host-run-netns\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805248 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-conf-dir\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805323 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4504bb35-e317-4eea-adbc-6d6d41fdb215-host\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805339 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-os-release\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.811518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805363 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-run-ovn-kubernetes\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805367 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-sys\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805410 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-multus-socket-dir-parent\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805461 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-modprobe-d\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.805479 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805498 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9f35b9-cbda-4437-ba6b-387ed48084cf-tmp-dir\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.805578 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:19.305537341 +0000 UTC m=+3.069378648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-modprobe-d\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysctl-d\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805740 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4504bb35-e317-4eea-adbc-6d6d41fdb215-serviceca\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805807 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d381a5f4-7df6-4200-8659-e6e42ec1232e-hostroot\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805838 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35984130-d201-4a4c-a7da-68430945eb38-env-overrides\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805855 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e97709c8-4d49-4a31-8846-721ab0966d30-etc-sysctl-d\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.805953 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35984130-d201-4a4c-a7da-68430945eb38-host-run-netns\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.807679 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97709c8-4d49-4a31-8846-721ab0966d30-tmp\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.808657 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3862e89-7fcb-4319-b18b-15340574aa27-agent-certs\") pod \"konnectivity-agent-m6bnc\" (UID: \"b3862e89-7fcb-4319-b18b-15340574aa27\") " pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.809153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35984130-d201-4a4c-a7da-68430945eb38-ovn-node-metrics-cert\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.813052 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.810146 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e97709c8-4d49-4a31-8846-721ab0966d30-etc-tuned\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.815606 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.815576 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:18.815606 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.815599 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:18.815606 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.815609 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:18.815822 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.815665 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:55:19.315650543 +0000 UTC m=+3.079491849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:18.817540 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.817495 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvfxm\" (UniqueName: \"kubernetes.io/projected/4504bb35-e317-4eea-adbc-6d6d41fdb215-kube-api-access-jvfxm\") pod \"node-ca-tlvw2\" (UID: \"4504bb35-e317-4eea-adbc-6d6d41fdb215\") " pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:18.818035 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.818010 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcgz\" (UniqueName: \"kubernetes.io/projected/35984130-d201-4a4c-a7da-68430945eb38-kube-api-access-jzcgz\") pod \"ovnkube-node-9lqcd\" (UID: \"35984130-d201-4a4c-a7da-68430945eb38\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:18.819216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.819188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m5lf\" (UniqueName: \"kubernetes.io/projected/d381a5f4-7df6-4200-8659-e6e42ec1232e-kube-api-access-6m5lf\") pod \"multus-5tzcw\" (UID: \"d381a5f4-7df6-4200-8659-e6e42ec1232e\") " pod="openshift-multus/multus-5tzcw" Jun 08 20:55:18.821536 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.821482 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9pv\" (UniqueName: \"kubernetes.io/projected/cd9f35b9-cbda-4437-ba6b-387ed48084cf-kube-api-access-pk9pv\") pod \"node-resolver-tcsbt\" (UID: \"cd9f35b9-cbda-4437-ba6b-387ed48084cf\") " pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:18.821644 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.821538 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphc2\" (UniqueName: \"kubernetes.io/projected/e97709c8-4d49-4a31-8846-721ab0966d30-kube-api-access-hphc2\") pod \"tuned-c5msw\" (UID: \"e97709c8-4d49-4a31-8846-721ab0966d30\") " pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.906756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmnp\" (UniqueName: \"kubernetes.io/projected/d5f0742c-7c89-45cb-8300-90f5fd50b571-kube-api-access-pqmnp\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.906887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-device-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.906919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-cni-binary-copy\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.906963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-socket-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.906990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-sys-fs\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907009 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xd8\" (UniqueName: \"kubernetes.io/projected/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-kube-api-access-z2xd8\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-etc-selinux\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-os-release\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz4tf\" (UniqueName: \"kubernetes.io/projected/2e864677-53de-4e46-9964-638364be4d26-kube-api-access-wz4tf\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-host-slash\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907160 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-iptables-alerter-script\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907220 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907229 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-sys-fs\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.908315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907313 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907331 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-262c2\" (UniqueName: \"kubernetes.io/projected/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-kube-api-access-262c2\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907371 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-device-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907426 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-etc-selinux\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907596 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-os-release\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907639 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-registration-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-system-cni-dir\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-cnibin\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907896 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907974 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-socket-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.907987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-cni-binary-copy\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908020 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-registration-dir\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908017 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908046 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-system-cni-dir\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.909212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908074 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e864677-53de-4e46-9964-638364be4d26-cnibin\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.910071 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908077 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-host-slash\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.910071 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908104 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e864677-53de-4e46-9964-638364be4d26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.910071 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.908140 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:18.910071 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:18.908201 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:19.408188811 +0000 UTC m=+3.172030116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:18.910071 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.908530 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-iptables-alerter-script\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.916516 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.916441 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmnp\" (UniqueName: \"kubernetes.io/projected/d5f0742c-7c89-45cb-8300-90f5fd50b571-kube-api-access-pqmnp\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:18.917911 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.917875 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xd8\" (UniqueName: \"kubernetes.io/projected/bbda2b62-2503-4c37-8bb0-f77ec6f0a914-kube-api-access-z2xd8\") pod \"aws-ebs-csi-driver-node-pw42p\" (UID: \"bbda2b62-2503-4c37-8bb0-f77ec6f0a914\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:18.918140 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.918119 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-262c2\" (UniqueName: \"kubernetes.io/projected/95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21-kube-api-access-262c2\") pod \"iptables-alerter-56hbd\" (UID: \"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21\") " pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:18.920137 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.919943 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz4tf\" (UniqueName: \"kubernetes.io/projected/2e864677-53de-4e46-9964-638364be4d26-kube-api-access-wz4tf\") pod \"multus-additional-cni-plugins-jpnpk\" (UID: \"2e864677-53de-4e46-9964-638364be4d26\") " pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:18.989615 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:18.989579 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:19.000557 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.000523 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:19.027682 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.027645 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tlvw2" Jun 08 20:55:19.028804 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.028776 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c5msw" Jun 08 20:55:19.038715 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.038685 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tcsbt" Jun 08 20:55:19.046825 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.046784 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5tzcw" Jun 08 20:55:19.056804 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.056775 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" Jun 08 20:55:19.065858 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.065822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-56hbd" Jun 08 20:55:19.070985 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.070958 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" Jun 08 20:55:19.310741 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.310639 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:19.310916 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.310814 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:19.310916 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.310893 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:20.310873501 +0000 UTC m=+4.074714822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:19.412070 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.412034 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:19.412267 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.412095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:19.412267 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.412220 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:19.412267 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.412253 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:19.412467 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.412287 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:19.412467 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.412318 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:19.412467 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.412353 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:20.412327608 +0000 UTC m=+4.176168920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:19.412467 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.412380 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:55:20.412369907 +0000 UTC m=+4.176211219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:19.734477 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.734388 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 20:50:18 +0000 UTC" deadline="2028-02-25 15:42:13.341534398 +0000 UTC" Jun 08 20:55:19.734477 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.734422 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15042h46m53.607116122s" Jun 08 20:55:19.780988 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:19.780949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:19.781161 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:19.781067 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:19.984962 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:19.984930 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd381a5f4_7df6_4200_8659_e6e42ec1232e.slice/crio-69e4d1b9e4d49fc4304e91dba09fa898d63232a1d243cd38156b0eab33cfa264 WatchSource:0}: Error finding container 69e4d1b9e4d49fc4304e91dba09fa898d63232a1d243cd38156b0eab33cfa264: Status 404 returned error can't find the container with id 69e4d1b9e4d49fc4304e91dba09fa898d63232a1d243cd38156b0eab33cfa264 Jun 08 20:55:19.986052 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:19.986016 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4504bb35_e317_4eea_adbc_6d6d41fdb215.slice/crio-7522f220f2ead2cd63bda4d426b79246ba1413f1e7ee236a8e6014c1d5728d9d WatchSource:0}: Error finding container 7522f220f2ead2cd63bda4d426b79246ba1413f1e7ee236a8e6014c1d5728d9d: Status 404 returned error can't find the container with id 7522f220f2ead2cd63bda4d426b79246ba1413f1e7ee236a8e6014c1d5728d9d Jun 08 20:55:19.986864 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:19.986841 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e864677_53de_4e46_9964_638364be4d26.slice/crio-aa86b5806cec03e82e16c02580a84407ec786981f336dce2f74d0d847a42ab59 WatchSource:0}: Error finding container aa86b5806cec03e82e16c02580a84407ec786981f336dce2f74d0d847a42ab59: Status 404 returned error can't find the container with id aa86b5806cec03e82e16c02580a84407ec786981f336dce2f74d0d847a42ab59 Jun 08 20:55:19.989450 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:19.988464 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9f35b9_cbda_4437_ba6b_387ed48084cf.slice/crio-998e801a172895e152e33b5888e02c7a2d5ff9e864de2738b37237be477d568c WatchSource:0}: Error finding container 998e801a172895e152e33b5888e02c7a2d5ff9e864de2738b37237be477d568c: Status 404 returned error can't find the container with id 998e801a172895e152e33b5888e02c7a2d5ff9e864de2738b37237be477d568c Jun 08 20:55:19.992375 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:19.992269 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95de6c04_5b3e_4c6d_9c5d_ffcd21dfef21.slice/crio-13261fd7cc4e91b003405571297c69fc626d8edaa21c2e40a1d75b59f2f73b76 WatchSource:0}: Error finding container 13261fd7cc4e91b003405571297c69fc626d8edaa21c2e40a1d75b59f2f73b76: Status 404 returned error can't find the container with id 13261fd7cc4e91b003405571297c69fc626d8edaa21c2e40a1d75b59f2f73b76 Jun 08 20:55:19.994693 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:19.994671 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3862e89_7fcb_4319_b18b_15340574aa27.slice/crio-401791753acd9b248c3f51401201017619ff63054f44340ade56d4fd8b2636e0 WatchSource:0}: Error finding container 401791753acd9b248c3f51401201017619ff63054f44340ade56d4fd8b2636e0: Status 404 returned error can't find the container with id 401791753acd9b248c3f51401201017619ff63054f44340ade56d4fd8b2636e0 Jun 08 20:55:20.017350 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:20.017328 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbda2b62_2503_4c37_8bb0_f77ec6f0a914.slice/crio-d2b3c857f273604a2365bda5fa94ce31c9b8f0586a3494518b3820c1be2596a5 WatchSource:0}: Error finding container d2b3c857f273604a2365bda5fa94ce31c9b8f0586a3494518b3820c1be2596a5: Status 404 returned error can't find the container with id d2b3c857f273604a2365bda5fa94ce31c9b8f0586a3494518b3820c1be2596a5 Jun 08 20:55:20.018016 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:20.017996 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35984130_d201_4a4c_a7da_68430945eb38.slice/crio-677f762ef1e48d811b61bfb772cc7d42a865113fc62bd92bf156bd571944adbe WatchSource:0}: Error finding container 677f762ef1e48d811b61bfb772cc7d42a865113fc62bd92bf156bd571944adbe: Status 404 returned error can't find the container with id 677f762ef1e48d811b61bfb772cc7d42a865113fc62bd92bf156bd571944adbe Jun 08 20:55:20.020187 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:20.020167 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97709c8_4d49_4a31_8846_721ab0966d30.slice/crio-90759e0e068927d3cba863e683f0b8e56eef715094430aec4f963712f7fd42f1 WatchSource:0}: Error finding container 90759e0e068927d3cba863e683f0b8e56eef715094430aec4f963712f7fd42f1: Status 404 returned error can't find the container with id 90759e0e068927d3cba863e683f0b8e56eef715094430aec4f963712f7fd42f1 Jun 08 20:55:20.319375 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.319336 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:20.319569 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.319477 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:20.319569 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.319544 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:22.319526766 +0000 UTC m=+6.083368075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:20.420426 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.420386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:20.420614 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.420449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:20.420614 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.420578 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:20.420730 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.420639 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:22.420619112 +0000 UTC m=+6.184460420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:20.420792 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.420733 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:20.420792 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.420748 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:20.420792 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.420763 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:20.420918 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.420800 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:55:22.420788017 +0000 UTC m=+6.184629336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:20.735251 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.735163 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 20:50:18 +0000 UTC" deadline="2028-01-19 15:26:19.492511822 +0000 UTC" Jun 08 20:55:20.735251 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.735199 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14154h30m58.757316975s" Jun 08 20:55:20.782978 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.782947 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:20.783169 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.783079 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:20.783532 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.783510 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:20.783645 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:20.783627 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:20.799704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.799662 2554 generic.go:356] "Generic (PLEG): container finished" podID="e9c5582db71cca6a5029e095ab8772af" containerID="e8b8af296e8329290cf2600a4cfda4e7e5001756110ba73665adcfb0cba1eae5" exitCode=0 Jun 08 20:55:20.799868 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.799761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" event={"ID":"e9c5582db71cca6a5029e095ab8772af","Type":"ContainerDied","Data":"e8b8af296e8329290cf2600a4cfda4e7e5001756110ba73665adcfb0cba1eae5"} Jun 08 20:55:20.827914 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.827874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m6bnc" event={"ID":"b3862e89-7fcb-4319-b18b-15340574aa27","Type":"ContainerStarted","Data":"401791753acd9b248c3f51401201017619ff63054f44340ade56d4fd8b2636e0"} Jun 08 20:55:20.842260 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.842213 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"677f762ef1e48d811b61bfb772cc7d42a865113fc62bd92bf156bd571944adbe"} Jun 08 20:55:20.852358 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.852228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tlvw2" event={"ID":"4504bb35-e317-4eea-adbc-6d6d41fdb215","Type":"ContainerStarted","Data":"7522f220f2ead2cd63bda4d426b79246ba1413f1e7ee236a8e6014c1d5728d9d"} Jun 08 20:55:20.862634 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.862592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5tzcw" event={"ID":"d381a5f4-7df6-4200-8659-e6e42ec1232e","Type":"ContainerStarted","Data":"69e4d1b9e4d49fc4304e91dba09fa898d63232a1d243cd38156b0eab33cfa264"} Jun 08 20:55:20.877961 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.877925 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" event={"ID":"e42e4eb741c319d6e7c4d1ea6b9bf3e8","Type":"ContainerStarted","Data":"afd6efdf0b30476071391ddc83bce9fcb9904492e33ea86eabe2f5a0084299cf"} Jun 08 20:55:20.896629 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.896586 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c5msw" event={"ID":"e97709c8-4d49-4a31-8846-721ab0966d30","Type":"ContainerStarted","Data":"90759e0e068927d3cba863e683f0b8e56eef715094430aec4f963712f7fd42f1"} Jun 08 20:55:20.897214 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.897150 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-176.ec2.internal" podStartSLOduration=3.897129575 podStartE2EDuration="3.897129575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:20.896654712 +0000 UTC m=+4.660496040" watchObservedRunningTime="2026-06-08 20:55:20.897129575 +0000 UTC m=+4.660970906" Jun 08 20:55:20.905643 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.905601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" event={"ID":"bbda2b62-2503-4c37-8bb0-f77ec6f0a914","Type":"ContainerStarted","Data":"d2b3c857f273604a2365bda5fa94ce31c9b8f0586a3494518b3820c1be2596a5"} Jun 08 20:55:20.911084 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.909460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-56hbd" event={"ID":"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21","Type":"ContainerStarted","Data":"13261fd7cc4e91b003405571297c69fc626d8edaa21c2e40a1d75b59f2f73b76"} Jun 08 20:55:20.918235 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.914744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tcsbt" event={"ID":"cd9f35b9-cbda-4437-ba6b-387ed48084cf","Type":"ContainerStarted","Data":"998e801a172895e152e33b5888e02c7a2d5ff9e864de2738b37237be477d568c"} Jun 08 20:55:20.918235 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:20.917344 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerStarted","Data":"aa86b5806cec03e82e16c02580a84407ec786981f336dce2f74d0d847a42ab59"} Jun 08 20:55:21.780772 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:21.780735 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:21.781236 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:21.780872 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:21.945867 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:21.945828 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" event={"ID":"e9c5582db71cca6a5029e095ab8772af","Type":"ContainerStarted","Data":"2f7f3790cadbc20eb952c94303559ffdcbf818a934ec7536af5cf11af719d475"} Jun 08 20:55:21.963267 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:21.962324 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-176.ec2.internal" podStartSLOduration=4.962270094 podStartE2EDuration="4.962270094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:21.961931354 +0000 UTC m=+5.725772684" watchObservedRunningTime="2026-06-08 20:55:21.962270094 +0000 UTC m=+5.726111423" Jun 08 20:55:22.336962 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:22.336920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:22.337153 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.337134 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:22.337244 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.337201 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:26.337181826 +0000 UTC m=+10.101023134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:22.437665 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:22.437624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:22.437842 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:22.437724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:22.437906 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.437893 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:22.437971 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.437911 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:22.437971 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.437924 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:22.438076 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.437985 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:55:26.437966065 +0000 UTC m=+10.201807373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:22.438464 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.438441 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:22.438556 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.438502 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:26.438484513 +0000 UTC m=+10.202325824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:22.782897 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:22.782863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:22.783392 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.782994 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:22.783471 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:22.783394 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:22.783530 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:22.783503 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:23.781129 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:23.781083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:23.781340 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:23.781232 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:24.781198 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:24.781158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:24.781696 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:24.781363 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:24.781895 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:24.781837 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:24.781985 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:24.781944 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:25.781176 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:25.781138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:25.781377 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:25.781287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:26.368941 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:26.368898 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:26.369139 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.369117 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:26.369263 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.369250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:34.369202649 +0000 UTC m=+18.133043956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:26.471070 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:26.471017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:26.471233 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:26.471083 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:26.471233 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.471197 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:26.471443 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.471225 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:26.471443 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.471251 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:26.471443 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.471260 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:34.47123993 +0000 UTC m=+18.235081241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:26.471443 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.471266 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:26.471443 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.471339 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:55:34.471322663 +0000 UTC m=+18.235163974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:26.782439 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:26.782351 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:26.782867 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.782478 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:26.782867 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:26.782592 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:26.782867 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:26.782709 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:27.780711 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:27.780676 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:27.780921 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:27.780801 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:28.781449 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:28.781402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:28.781804 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:28.781543 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:28.781918 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:28.781895 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:28.782025 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:28.782003 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:29.780306 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:29.780265 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:29.780501 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:29.780397 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:30.781228 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:30.781138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:30.781228 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:30.781162 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:30.781740 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:30.781283 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:30.781740 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:30.781393 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:31.780879 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:31.780842 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:31.781049 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:31.780959 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:32.782361 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:32.782327 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:32.782792 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:32.782470 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:32.782889 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:32.782858 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:32.783032 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:32.782980 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:33.780354 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:33.780312 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:33.780515 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:33.780457 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:34.433195 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:34.433157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:34.433646 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.433356 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:34.433646 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.433437 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:50.433414789 +0000 UTC m=+34.197256110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:34.533951 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:34.533902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:34.534140 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:34.534002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:34.534140 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.534068 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:34.534232 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.534152 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:34.534232 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.534174 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:34.534232 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.534189 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:34.534232 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.534155 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:50.534137629 +0000 UTC m=+34.297978939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:34.534413 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.534250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:55:50.534233616 +0000 UTC m=+34.298074927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:34.780567 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:34.780474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:34.780741 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:34.780483 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:34.780741 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.780629 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:34.780741 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:34.780694 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:35.780252 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:35.780208 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:35.780830 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:35.780371 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:36.781045 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:36.781004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:36.781493 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:36.781115 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:36.781493 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:36.781214 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:36.781493 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:36.781357 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:37.780519 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:37.780484 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:37.780728 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:37.780610 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:38.781198 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:38.781157 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:38.781694 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:38.781157 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:38.781694 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:38.781282 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:38.781694 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:38.781366 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:39.781596 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.781132 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:39.782337 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:39.781726 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:39.986871 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.986830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m6bnc" event={"ID":"b3862e89-7fcb-4319-b18b-15340574aa27","Type":"ContainerStarted","Data":"823f6eb3c9555c8671c628a2a2c5893f8e1b6e04af7b5ef1871e7a33136d333a"} Jun 08 20:55:39.990440 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.990408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"340b58cbddc259791dd7b2f80aed98e77b00e1030749035ba9db7fe9c8076307"} Jun 08 20:55:39.990610 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.990504 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"a2ce4a0f260bf6b1ff2ce4209ddff1a61feb6e6c7e1cfcd4f1326c03adea0ef3"} Jun 08 20:55:39.990610 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.990541 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"fddcbcd612c556cd27ef1dcfa727bbc4439db4f96015d31dbba80d27a731e98a"} Jun 08 20:55:39.990610 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.990573 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"1316713202a3c5be4a22d97acf84921e9c23632b86beb02c95013bd0fcc737ac"} Jun 08 20:55:39.990610 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.990609 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"450c85d58083ae90c1b86f00ea577b8ad37de4103943539ef1162dc748be04cb"} Jun 08 20:55:39.990807 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.990640 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"887e8714db31a05b3dd631a3677d7fc21cb6f3c065cccfdd6bea3c6adc9cec7b"} Jun 08 20:55:39.992102 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.992060 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tlvw2" event={"ID":"4504bb35-e317-4eea-adbc-6d6d41fdb215","Type":"ContainerStarted","Data":"cb50a289bf49e02d8816a69fb94942276c6398bb499ef2321f995c0293fc364d"} Jun 08 20:55:39.993677 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.993650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5tzcw" event={"ID":"d381a5f4-7df6-4200-8659-e6e42ec1232e","Type":"ContainerStarted","Data":"b9d77f30ba5033f894a3d5db655c0db8fc033d7acfb26d180ad9ad3a71267721"} Jun 08 20:55:39.995179 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.995149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c5msw" event={"ID":"e97709c8-4d49-4a31-8846-721ab0966d30","Type":"ContainerStarted","Data":"76cbab2edd358394375190d34a33af8d86f6f8a7be70c499051e4176e6bf29f3"} Jun 08 20:55:39.996765 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.996740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" event={"ID":"bbda2b62-2503-4c37-8bb0-f77ec6f0a914","Type":"ContainerStarted","Data":"3131c525daa21584ad3bb794b22837ed0aa52f0565a8db8ee93a393967af5f47"} Jun 08 20:55:39.998340 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.998314 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tcsbt" event={"ID":"cd9f35b9-cbda-4437-ba6b-387ed48084cf","Type":"ContainerStarted","Data":"056f3e1525cfcfe0d8e9e330f7e32a13c4e3123bc149be207e75cebe2c3c5410"} Jun 08 20:55:39.999949 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.999917 2554 generic.go:356] "Generic (PLEG): container finished" podID="2e864677-53de-4e46-9964-638364be4d26" containerID="4f4e624a2c93a9f61795d388403033535e3d1df0848f91d71cb11ddd9b7b0ad5" exitCode=0 Jun 08 20:55:40.000043 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:39.999956 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerDied","Data":"4f4e624a2c93a9f61795d388403033535e3d1df0848f91d71cb11ddd9b7b0ad5"} Jun 08 20:55:40.005034 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.004980 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m6bnc" podStartSLOduration=5.068495904 podStartE2EDuration="24.004959942s" totalImagesPullingTime="18.936464038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:40.004888271 +0000 UTC m=+23.768729598" watchObservedRunningTime="2026-06-08 20:55:40.004959942 +0000 UTC m=+23.768801286" Jun 08 20:55:40.023511 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.023449 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tlvw2" podStartSLOduration=9.627427183 podStartE2EDuration="24.023427309s" totalImagesPullingTime="14.396000126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:40.023110461 +0000 UTC m=+23.786951788" watchObservedRunningTime="2026-06-08 20:55:40.023427309 +0000 UTC m=+23.787268659" Jun 08 20:55:40.042176 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.042117 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c5msw" podStartSLOduration=5.112703328 podStartE2EDuration="24.042095554s" totalImagesPullingTime="18.929392226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:40.041999691 +0000 UTC m=+23.805841019" watchObservedRunningTime="2026-06-08 20:55:40.042095554 +0000 UTC m=+23.805936883" Jun 08 20:55:40.089430 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.089374 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tcsbt" podStartSLOduration=4.129256212 podStartE2EDuration="23.089357674s" totalImagesPullingTime="18.960101462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:40.089193815 +0000 UTC m=+23.853035142" watchObservedRunningTime="2026-06-08 20:55:40.089357674 +0000 UTC m=+23.853199002" Jun 08 20:55:40.089591 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.089480 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5tzcw" podStartSLOduration=4.070660597 podStartE2EDuration="23.089474744s" totalImagesPullingTime="19.018814147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:40.063638556 +0000 UTC m=+23.827479885" watchObservedRunningTime="2026-06-08 20:55:40.089474744 +0000 UTC m=+23.853316072" Jun 08 20:55:40.232097 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.232031 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.780955 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T20:55:40.232050251Z","UUID":"c4aec57b-6e91-40cf-81ea-75719cece3be","Handler":null,"Name":"","Endpoint":""} Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.781117 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.781125 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:40.781245 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:40.781364 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.782793 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 20:55:40.783308 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:40.782836 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 20:55:41.004424 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:41.004384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" event={"ID":"bbda2b62-2503-4c37-8bb0-f77ec6f0a914","Type":"ContainerStarted","Data":"c4c0986b4811f726df338fcffb97055d5efb065607be47c379233ef685bac88d"} Jun 08 20:55:41.006363 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:41.006324 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-56hbd" event={"ID":"95de6c04-5b3e-4c6d-9c5d-ffcd21dfef21","Type":"ContainerStarted","Data":"e29e44918decf4cb400bbf360a77dc74c41cb121e4ec4a096ffa2e2fa3aeba64"} Jun 08 20:55:41.021450 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:41.021400 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-56hbd" podStartSLOduration=5.099874198 podStartE2EDuration="24.021382703s" totalImagesPullingTime="18.921508505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:41.020926405 +0000 UTC m=+24.784767733" watchObservedRunningTime="2026-06-08 20:55:41.021382703 +0000 UTC m=+24.785224031" Jun 08 20:55:41.781096 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:41.781051 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:41.781409 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:41.781200 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:42.011790 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:42.011686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" event={"ID":"bbda2b62-2503-4c37-8bb0-f77ec6f0a914","Type":"ContainerStarted","Data":"970227ca816ad9b0b3d81290ab2b309f8101e3f611be736a9e946f2ddb6c11aa"} Jun 08 20:55:42.015651 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:42.015612 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"df2efa3dc2bc5d4d9b1a9d2357d4d1b9f205c85e39f7ba256d02b1f27fefa1b2"} Jun 08 20:55:42.030750 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:42.030686 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pw42p" podStartSLOduration=4.345134592 podStartE2EDuration="25.030670461s" totalImagesPullingTime="20.685535869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:42.029023934 +0000 UTC m=+25.792865261" watchObservedRunningTime="2026-06-08 20:55:42.030670461 +0000 UTC m=+25.794511788" Jun 08 20:55:42.766542 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:42.766503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:42.781263 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:42.781228 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:42.781464 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:42.781229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:42.781464 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:42.781380 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:42.781577 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:42.781483 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:43.780662 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:43.780462 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:43.781060 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:43.780746 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:43.928123 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:43.928088 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:43.928733 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:43.928713 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:44.021290 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:44.021206 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m6bnc" Jun 08 20:55:44.781363 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:44.781074 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:44.781363 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:44.781139 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:44.782105 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:44.781368 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:44.782105 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:44.781447 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:45.025406 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.025366 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" event={"ID":"35984130-d201-4a4c-a7da-68430945eb38","Type":"ContainerStarted","Data":"75b5a796415d7684e410ed1eb6d404413598be7ee5f1feb6e832138f165c5bb9"} Jun 08 20:55:45.025670 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.025650 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:45.027524 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.027503 2554 generic.go:356] "Generic (PLEG): container finished" podID="2e864677-53de-4e46-9964-638364be4d26" containerID="fe0d2946d222a11cb12a1a0eeb6c4536a09aa89756172d7837f41b4812aaaeda" exitCode=0 Jun 08 20:55:45.027620 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.027586 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerDied","Data":"fe0d2946d222a11cb12a1a0eeb6c4536a09aa89756172d7837f41b4812aaaeda"} Jun 08 20:55:45.043738 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.043664 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:45.054581 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.054532 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" podStartSLOduration=10.040727274 podStartE2EDuration="29.054516543s" totalImagesPullingTime="19.013789269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:45.053974652 +0000 UTC m=+28.817815980" watchObservedRunningTime="2026-06-08 20:55:45.054516543 +0000 UTC m=+28.818357870" Jun 08 20:55:45.781022 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:45.780987 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:45.781159 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:45.781123 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:46.030226 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.030196 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:46.030657 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.030285 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:46.047219 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.047196 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:55:46.428909 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.428826 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpp5z"] Jun 08 20:55:46.429057 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.429007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:46.429153 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:46.429130 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:46.432354 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.432321 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frhgs"] Jun 08 20:55:46.432510 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.432442 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:46.432570 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:46.432541 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:46.432982 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.432957 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hdncs"] Jun 08 20:55:46.433083 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:46.433043 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:46.433149 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:46.433132 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:47.034436 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:47.034400 2554 generic.go:356] "Generic (PLEG): container finished" podID="2e864677-53de-4e46-9964-638364be4d26" containerID="e6adc5e36e10e235ea36fb2b8833231990bee133263a2f6d3022e6870bbc4764" exitCode=0 Jun 08 20:55:47.034814 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:47.034484 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerDied","Data":"e6adc5e36e10e235ea36fb2b8833231990bee133263a2f6d3022e6870bbc4764"} Jun 08 20:55:47.780430 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:47.780391 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:47.780648 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:47.780440 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:47.780648 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:47.780510 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:47.780648 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:47.780575 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:48.780896 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:48.780807 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:48.781332 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:48.780905 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:49.042244 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:49.042155 2554 generic.go:356] "Generic (PLEG): container finished" podID="2e864677-53de-4e46-9964-638364be4d26" containerID="4590cffe5afff2ecc3e17537850123bd08dcb71a86f2c01acfa338fd8e121910" exitCode=0 Jun 08 20:55:49.042244 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:49.042214 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerDied","Data":"4590cffe5afff2ecc3e17537850123bd08dcb71a86f2c01acfa338fd8e121910"} Jun 08 20:55:49.780823 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:49.780786 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:49.781059 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:49.780901 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:49.781059 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:49.780965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:49.781416 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:49.781081 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:50.453597 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:50.453310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:50.453824 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.453403 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:50.453824 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.453686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret podName:f2453927-0895-42dc-b314-284c1221f9d6 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:22.453670633 +0000 UTC m=+66.217511939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret") pod "global-pull-secret-syncer-kpp5z" (UID: "f2453927-0895-42dc-b314-284c1221f9d6") : object "kube-system"/"original-pull-secret" not registered Jun 08 20:55:50.554874 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:50.554829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:50.554874 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:50.554882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:50.555086 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.554977 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:50.555086 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.554999 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 20:55:50.555086 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.555020 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 20:55:50.555086 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.555030 2554 projected.go:196] Error preparing data for projected volume kube-api-access-b6c75 for pod openshift-network-diagnostics/network-check-target-hdncs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:50.555086 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.555031 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:22.55501728 +0000 UTC m=+66.318858585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 20:55:50.555086 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.555082 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75 podName:005e9ce7-9d68-4886-a0c3-e1328a95cccc nodeName:}" failed. No retries permitted until 2026-06-08 20:56:22.555069052 +0000 UTC m=+66.318910359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b6c75" (UniqueName: "kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75") pod "network-check-target-hdncs" (UID: "005e9ce7-9d68-4886-a0c3-e1328a95cccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 20:55:50.781113 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:50.781034 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:50.781523 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:50.781149 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpp5z" podUID="f2453927-0895-42dc-b314-284c1221f9d6" Jun 08 20:55:51.780903 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:51.780866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:51.780903 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:51.780905 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:51.781133 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:51.781007 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:55:51.781482 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:51.781144 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdncs" podUID="005e9ce7-9d68-4886-a0c3-e1328a95cccc" Jun 08 20:55:52.028920 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.028833 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-176.ec2.internal" event="NodeReady" Jun 08 20:55:52.029088 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.028996 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 20:55:52.093014 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.092165 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dbdc46c7-5kmfj"] Jun 08 20:55:52.119345 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.119288 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4fpvc"] Jun 08 20:55:52.119527 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.119445 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.136190 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.136157 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 20:55:52.136408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.136239 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 20:55:52.136555 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.136540 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 20:55:52.136629 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.136544 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6wgq7\"" Jun 08 20:55:52.141475 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.141446 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5wp2h"] Jun 08 20:55:52.141621 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.141577 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.143944 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.143918 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 20:55:52.145202 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.145181 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 20:55:52.145339 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.145247 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l5nt5\"" Jun 08 20:55:52.145521 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.145501 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 20:55:52.145832 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.145813 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 20:55:52.161608 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.161577 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dbdc46c7-5kmfj"] Jun 08 20:55:52.161608 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.161614 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4fpvc"] Jun 08 20:55:52.161845 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.161630 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wp2h"] Jun 08 20:55:52.161845 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.161722 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.166367 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.166345 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 20:55:52.166975 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.166957 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5mnkl\"" Jun 08 20:55:52.167117 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.167064 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 20:55:52.266764 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266726 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdd4bd6-7a34-4632-b350-01f3723bd717-config-volume\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cdd4bd6-7a34-4632-b350-01f3723bd717-tmp-dir\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-image-registry-private-configuration\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-installation-pull-secrets\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qkl5\" (UniqueName: \"kubernetes.io/projected/7d2090cc-04ad-4881-8a47-2b2bd286daab-kube-api-access-5qkl5\") pod \"ingress-canary-4fpvc\" (UID: \"7d2090cc-04ad-4881-8a47-2b2bd286daab\") " pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266920 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-trusted-ca\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.266953 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8807162-6d01-4a9c-997e-583d112379c8-ca-trust-extracted\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.267232 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.266973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5748\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-kube-api-access-t5748\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.267232 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.267005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-bound-sa-token\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.267232 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.267068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.267232 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.267097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrbg\" (UniqueName: \"kubernetes.io/projected/7cdd4bd6-7a34-4632-b350-01f3723bd717-kube-api-access-7nrbg\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.267232 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.267138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d2090cc-04ad-4881-8a47-2b2bd286daab-cert\") pod \"ingress-canary-4fpvc\" (UID: \"7d2090cc-04ad-4881-8a47-2b2bd286daab\") " pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.267232 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.267168 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-registry-certificates\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.363707 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.363600 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" limit=1024 Jun 08 20:55:52.368462 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdd4bd6-7a34-4632-b350-01f3723bd717-config-volume\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.368462 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cdd4bd6-7a34-4632-b350-01f3723bd717-tmp-dir\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-image-registry-private-configuration\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-installation-pull-secrets\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368554 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qkl5\" (UniqueName: \"kubernetes.io/projected/7d2090cc-04ad-4881-8a47-2b2bd286daab-kube-api-access-5qkl5\") pod \"ingress-canary-4fpvc\" (UID: \"7d2090cc-04ad-4881-8a47-2b2bd286daab\") " pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368588 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-trusted-ca\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8807162-6d01-4a9c-997e-583d112379c8-ca-trust-extracted\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368673 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5748\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-kube-api-access-t5748\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.368708 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.368702 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.368723 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.368776 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:52.868756206 +0000 UTC m=+36.632597512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-bound-sa-token\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368889 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cdd4bd6-7a34-4632-b350-01f3723bd717-tmp-dir\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrbg\" (UniqueName: \"kubernetes.io/projected/7cdd4bd6-7a34-4632-b350-01f3723bd717-kube-api-access-7nrbg\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.368977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d2090cc-04ad-4881-8a47-2b2bd286daab-cert\") pod \"ingress-canary-4fpvc\" (UID: \"7d2090cc-04ad-4881-8a47-2b2bd286daab\") " pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.369008 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-registry-certificates\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.369092 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.369063 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:55:52.369576 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.369139 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cdd4bd6-7a34-4632-b350-01f3723bd717-config-volume\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.369576 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.369250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:52.869230245 +0000 UTC m=+36.633071566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:55:52.369576 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.369439 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8807162-6d01-4a9c-997e-583d112379c8-ca-trust-extracted\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.369576 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.369539 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-registry-certificates\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.369855 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.369835 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-trusted-ca\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.373585 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.373559 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-installation-pull-secrets\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.373706 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.373568 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d2090cc-04ad-4881-8a47-2b2bd286daab-cert\") pod \"ingress-canary-4fpvc\" (UID: \"7d2090cc-04ad-4881-8a47-2b2bd286daab\") " pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.373706 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.373604 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-image-registry-private-configuration\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.385003 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.384966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrbg\" (UniqueName: \"kubernetes.io/projected/7cdd4bd6-7a34-4632-b350-01f3723bd717-kube-api-access-7nrbg\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.385170 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.385125 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qkl5\" (UniqueName: \"kubernetes.io/projected/7d2090cc-04ad-4881-8a47-2b2bd286daab-kube-api-access-5qkl5\") pod \"ingress-canary-4fpvc\" (UID: \"7d2090cc-04ad-4881-8a47-2b2bd286daab\") " pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.385852 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.385804 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5748\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-kube-api-access-t5748\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.387489 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.387465 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-bound-sa-token\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.451757 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.451717 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4fpvc" Jun 08 20:55:52.496439 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.496345 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" limit=1024 Jun 08 20:55:52.780583 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.780498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:55:52.783675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.783649 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 20:55:52.874672 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.874631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:52.874829 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:52.874704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:52.874829 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.874774 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:55:52.874829 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.874799 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:55:52.874829 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.874784 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:55:52.875015 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.874869 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:53.874849229 +0000 UTC m=+37.638690538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:55:52.875015 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:52.874908 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:53.874886669 +0000 UTC m=+37.638727997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:55:53.521002 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.520964 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4fpvc"] Jun 08 20:55:53.524617 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:55:53.524580 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2090cc_04ad_4881_8a47_2b2bd286daab.slice/crio-f423eb17d1d4d490c2ea9189bce84a83432f34d0705982b3dca077e92d7ec542 WatchSource:0}: Error finding container f423eb17d1d4d490c2ea9189bce84a83432f34d0705982b3dca077e92d7ec542: Status 404 returned error can't find the container with id f423eb17d1d4d490c2ea9189bce84a83432f34d0705982b3dca077e92d7ec542 Jun 08 20:55:53.780346 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.780131 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:55:53.780528 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.780187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:55:53.784790 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.784757 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9wp4t\"" Jun 08 20:55:53.784790 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.784757 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 20:55:53.785391 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.784799 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mklb\"" Jun 08 20:55:53.785391 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.784765 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 20:55:53.785391 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.784757 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 20:55:53.887486 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.887354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:53.887486 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:53.887447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:53.887720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:53.887543 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:55:53.887720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:53.887635 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:55:53.887720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:53.887651 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:55:53.887720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:53.887639 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:55.887617359 +0000 UTC m=+39.651458668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:55:53.887720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:53.887710 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:55.887696488 +0000 UTC m=+39.651537793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:55:54.058212 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:54.058174 2554 generic.go:356] "Generic (PLEG): container finished" podID="2e864677-53de-4e46-9964-638364be4d26" containerID="abf6de040e9d946e00deee359cf11751661765ec583c2f671d29214a8dfb3b77" exitCode=0 Jun 08 20:55:54.058380 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:54.058261 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerDied","Data":"abf6de040e9d946e00deee359cf11751661765ec583c2f671d29214a8dfb3b77"} Jun 08 20:55:54.059409 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:54.059381 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4fpvc" event={"ID":"7d2090cc-04ad-4881-8a47-2b2bd286daab","Type":"ContainerStarted","Data":"f423eb17d1d4d490c2ea9189bce84a83432f34d0705982b3dca077e92d7ec542"} Jun 08 20:55:55.066435 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:55.066314 2554 generic.go:356] "Generic (PLEG): container finished" podID="2e864677-53de-4e46-9964-638364be4d26" containerID="b0a75ca6deb1dfd82ff57847ee4eabc2b46db14f5413bfdce373bbbf1911b7f4" exitCode=0 Jun 08 20:55:55.066435 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:55.066383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerDied","Data":"b0a75ca6deb1dfd82ff57847ee4eabc2b46db14f5413bfdce373bbbf1911b7f4"} Jun 08 20:55:55.902703 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:55.902665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:55.902871 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:55.902763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:55.902871 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:55.902842 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:55:55.902871 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:55.902857 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:55:55.902871 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:55.902868 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:55:55.903005 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:55.902916 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:59.902897177 +0000 UTC m=+43.666738482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:55:55.903005 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:55.902931 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:55:59.902925217 +0000 UTC m=+43.666766522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:55:56.072364 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.072325 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" event={"ID":"2e864677-53de-4e46-9964-638364be4d26","Type":"ContainerStarted","Data":"b5e1981016e1f27d76ad997ca2fe456748455a3856cd60d5ac932e70c0d70bb4"} Jun 08 20:55:56.073674 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.073649 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4fpvc" event={"ID":"7d2090cc-04ad-4881-8a47-2b2bd286daab","Type":"ContainerStarted","Data":"bfe6cb60615c2e8c047c55a820f73472d0543c265b38fac7b610cbf67d4e31a1"} Jun 08 20:55:56.114897 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.114831 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jpnpk" podStartSLOduration=13.691068685 podStartE2EDuration="39.114815254s" totalImagesPullingTime="25.423746569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:56.112510559 +0000 UTC m=+39.876351887" watchObservedRunningTime="2026-06-08 20:55:56.114815254 +0000 UTC m=+39.878656582" Jun 08 20:55:56.141965 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.141915 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4fpvc" podStartSLOduration=2.211715374 podStartE2EDuration="4.141899005s" totalImagesPullingTime="1.930183631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:55:56.141276024 +0000 UTC m=+39.905117349" watchObservedRunningTime="2026-06-08 20:55:56.141899005 +0000 UTC m=+39.905740367" Jun 08 20:55:56.307315 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.307119 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" limit=1024 Jun 08 20:55:56.407723 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.407634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" limit=1024 Jun 08 20:55:56.553904 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.553869 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" limit=1024 Jun 08 20:55:56.655188 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:56.655151 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" limit=1024 Jun 08 20:55:59.932562 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:59.932513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:55:59.932951 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:55:59.932610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:55:59.932951 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:59.932668 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:55:59.932951 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:59.932706 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:55:59.932951 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:59.932717 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:55:59.932951 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:59.932750 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:07.932733807 +0000 UTC m=+51.696575113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:55:59.932951 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:55:59.932765 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:07.932758364 +0000 UTC m=+51.696599670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:56:07.995264 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:07.995225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:56:07.995714 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:07.995277 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:56:07.995714 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:07.995394 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:56:07.995714 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:07.995398 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:56:07.995714 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:07.995419 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:56:07.995714 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:07.995454 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:23.995439956 +0000 UTC m=+67.759281268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:56:07.995714 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:07.995467 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:23.995461678 +0000 UTC m=+67.759302984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:56:17.360523 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.360488 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56"] Jun 08 20:56:17.407634 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.407590 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56"] Jun 08 20:56:17.407826 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.407730 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.412034 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.412001 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 20:56:17.412216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.412095 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 20:56:17.412216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.412097 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 20:56:17.412216 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.412103 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 20:56:17.464129 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.464086 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5bc66d4f-bb04-4870-887e-14bee30827d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.464334 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.464151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc66d4f-bb04-4870-887e-14bee30827d6-tmp\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.464334 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.464211 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwpsm\" (UniqueName: \"kubernetes.io/projected/5bc66d4f-bb04-4870-887e-14bee30827d6-kube-api-access-lwpsm\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.565063 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.565023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc66d4f-bb04-4870-887e-14bee30827d6-tmp\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.565153 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.565084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwpsm\" (UniqueName: \"kubernetes.io/projected/5bc66d4f-bb04-4870-887e-14bee30827d6-kube-api-access-lwpsm\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.565153 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.565130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5bc66d4f-bb04-4870-887e-14bee30827d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.565436 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.565416 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bc66d4f-bb04-4870-887e-14bee30827d6-tmp\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.569415 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.569381 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5bc66d4f-bb04-4870-887e-14bee30827d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.574230 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.574201 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwpsm\" (UniqueName: \"kubernetes.io/projected/5bc66d4f-bb04-4870-887e-14bee30827d6-kube-api-access-lwpsm\") pod \"klusterlet-addon-workmgr-6db7b76964-tqr56\" (UID: \"5bc66d4f-bb04-4870-887e-14bee30827d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.716601 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.716503 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:17.870583 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:17.870544 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56"] Jun 08 20:56:17.873658 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:56:17.873633 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc66d4f_bb04_4870_887e_14bee30827d6.slice/crio-59bd896d5853e87de63a58b023234990433a0fb48e222aea71c56361ebb9970c WatchSource:0}: Error finding container 59bd896d5853e87de63a58b023234990433a0fb48e222aea71c56361ebb9970c: Status 404 returned error can't find the container with id 59bd896d5853e87de63a58b023234990433a0fb48e222aea71c56361ebb9970c Jun 08 20:56:18.051113 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:18.051034 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lqcd" Jun 08 20:56:18.126344 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:18.126287 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" event={"ID":"5bc66d4f-bb04-4870-887e-14bee30827d6","Type":"ContainerStarted","Data":"59bd896d5853e87de63a58b023234990433a0fb48e222aea71c56361ebb9970c"} Jun 08 20:56:22.501714 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.501668 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:56:22.504872 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.504848 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 20:56:22.514661 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.514623 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2453927-0895-42dc-b314-284c1221f9d6-original-pull-secret\") pod \"global-pull-secret-syncer-kpp5z\" (UID: \"f2453927-0895-42dc-b314-284c1221f9d6\") " pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:56:22.602390 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.602352 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:56:22.602572 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.602433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:56:22.605448 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.605428 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 20:56:22.605503 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.605458 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 20:56:22.612937 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:22.612909 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 20:56:22.613081 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:22.612990 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:57:26.61296728 +0000 UTC m=+130.376808598 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : secret "metrics-daemon-secret" not found Jun 08 20:56:22.615742 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.615724 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 20:56:22.625789 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.625752 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6c75\" (UniqueName: \"kubernetes.io/projected/005e9ce7-9d68-4886-a0c3-e1328a95cccc-kube-api-access-b6c75\") pod \"network-check-target-hdncs\" (UID: \"005e9ce7-9d68-4886-a0c3-e1328a95cccc\") " pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:56:22.790792 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.790752 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpp5z" Jun 08 20:56:22.898455 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.898424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mklb\"" Jun 08 20:56:22.906017 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.905989 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:56:22.919939 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:22.919909 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpp5z"] Jun 08 20:56:22.924008 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:56:22.923974 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2453927_0895_42dc_b314_284c1221f9d6.slice/crio-1593f83a8c6e6e0c67b664dcb80887830384cb05af4fae5063d7c3c1ead43307 WatchSource:0}: Error finding container 1593f83a8c6e6e0c67b664dcb80887830384cb05af4fae5063d7c3c1ead43307: Status 404 returned error can't find the container with id 1593f83a8c6e6e0c67b664dcb80887830384cb05af4fae5063d7c3c1ead43307 Jun 08 20:56:23.034094 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.034058 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hdncs"] Jun 08 20:56:23.036920 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:56:23.036894 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005e9ce7_9d68_4886_a0c3_e1328a95cccc.slice/crio-a5b3182c1144cb420713d4cb50c6240111feba1edfb674334ef5236b56110590 WatchSource:0}: Error finding container a5b3182c1144cb420713d4cb50c6240111feba1edfb674334ef5236b56110590: Status 404 returned error can't find the container with id a5b3182c1144cb420713d4cb50c6240111feba1edfb674334ef5236b56110590 Jun 08 20:56:23.142348 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.142227 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" event={"ID":"5bc66d4f-bb04-4870-887e-14bee30827d6","Type":"ContainerStarted","Data":"eaebc6d0d8c3ca6e7021efe2e459c18ef148848ab3a81d3a3c8e11ab0ecd0a04"} Jun 08 20:56:23.142540 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.142442 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:23.143584 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.143557 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpp5z" event={"ID":"f2453927-0895-42dc-b314-284c1221f9d6","Type":"ContainerStarted","Data":"1593f83a8c6e6e0c67b664dcb80887830384cb05af4fae5063d7c3c1ead43307"} Jun 08 20:56:23.144471 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.144441 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:56:23.144847 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.144830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hdncs" event={"ID":"005e9ce7-9d68-4886-a0c3-e1328a95cccc","Type":"ContainerStarted","Data":"a5b3182c1144cb420713d4cb50c6240111feba1edfb674334ef5236b56110590"} Jun 08 20:56:23.160332 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:23.160259 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" podStartSLOduration=1.7540675000000001 podStartE2EDuration="6.160241736s" totalImagesPullingTime="4.406174236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:56:23.159759398 +0000 UTC m=+66.923600737" watchObservedRunningTime="2026-06-08 20:56:23.160241736 +0000 UTC m=+66.924083064" Jun 08 20:56:24.012625 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:24.012583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:56:24.013082 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:24.012661 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:56:24.013082 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:24.012735 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:56:24.013082 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:24.012760 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:56:24.013082 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:24.012766 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:56:24.013082 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:24.012822 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:56.012806648 +0000 UTC m=+99.776647953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:56:24.013082 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:24.012841 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:56:56.012832364 +0000 UTC m=+99.776673671 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:56:26.154681 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:26.154641 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hdncs" event={"ID":"005e9ce7-9d68-4886-a0c3-e1328a95cccc","Type":"ContainerStarted","Data":"2136fd0aa72bfa3726f31110ac4be146c875af5bd46f21062020e282ebbc91bc"} Jun 08 20:56:26.155062 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:26.154705 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:56:26.174157 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:26.172675 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hdncs" podStartSLOduration=66.176208115 podStartE2EDuration="1m9.172653761s" totalImagesPullingTime="2.996445646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:56:26.17113257 +0000 UTC m=+69.934973898" watchObservedRunningTime="2026-06-08 20:56:26.172653761 +0000 UTC m=+69.936495089" Jun 08 20:56:28.161949 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:28.161912 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpp5z" event={"ID":"f2453927-0895-42dc-b314-284c1221f9d6","Type":"ContainerStarted","Data":"3470da2846fc41d6d9d616548def1e4778501264f35b5540557fccbe2a888b7c"} Jun 08 20:56:28.180464 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:28.180406 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kpp5z" podStartSLOduration=66.403760165 podStartE2EDuration="1m11.180389894s" totalImagesPullingTime="4.776629729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:56:28.179919999 +0000 UTC m=+71.943761327" watchObservedRunningTime="2026-06-08 20:56:28.180389894 +0000 UTC m=+71.944231222" Jun 08 20:56:56.058005 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:56.057961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:56:56.058458 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:56.058057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:56:56.058458 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:56.058109 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:56:56.058458 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:56.058147 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:56:56.058458 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:56.058158 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:56:56.058458 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:56.058188 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 20:58:00.058171012 +0000 UTC m=+163.822012318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:56:56.058458 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:56:56.058207 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 20:58:00.058195532 +0000 UTC m=+163.822036838 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:56:57.160994 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:56:57.160962 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hdncs" Jun 08 20:57:26.676255 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:57:26.676198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:57:26.676785 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:57:26.676384 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 20:57:26.676785 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:57:26.676457 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:28.676440253 +0000 UTC m=+252.440281559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : secret "metrics-daemon-secret" not found Jun 08 20:57:55.131849 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:57:55.131789 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" podUID="c8807162-6d01-4a9c-997e-583d112379c8" Jun 08 20:57:55.172221 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:57:55.172180 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5wp2h" podUID="7cdd4bd6-7a34-4632-b350-01f3723bd717" Jun 08 20:57:55.371329 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:57:55.371284 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:57:55.371495 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:57:55.371339 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wp2h" Jun 08 20:57:56.790449 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:57:56.790409 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 20:58:00.130693 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:00.130642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 20:58:00.131108 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:00.130705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 20:58:00.131108 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:58:00.130794 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 20:58:00.131108 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:58:00.130867 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls podName:7cdd4bd6-7a34-4632-b350-01f3723bd717 nodeName:}" failed. No retries permitted until 2026-06-08 21:00:02.130852014 +0000 UTC m=+285.894693320 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls") pod "dns-default-5wp2h" (UID: "7cdd4bd6-7a34-4632-b350-01f3723bd717") : secret "dns-default-metrics-tls" not found Jun 08 20:58:00.131108 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:58:00.130797 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 20:58:00.131108 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:58:00.130897 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dbdc46c7-5kmfj: secret "image-registry-tls" not found Jun 08 20:58:00.131108 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:58:00.130953 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls podName:c8807162-6d01-4a9c-997e-583d112379c8 nodeName:}" failed. No retries permitted until 2026-06-08 21:00:02.130940036 +0000 UTC m=+285.894781342 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls") pod "image-registry-5dbdc46c7-5kmfj" (UID: "c8807162-6d01-4a9c-997e-583d112379c8") : secret "image-registry-tls" not found Jun 08 20:58:09.780640 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:09.780533 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:58:23.143559 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:23.143503 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" podUID="5bc66d4f-bb04-4870-887e-14bee30827d6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 08 20:58:23.441704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:23.441622 2554 generic.go:356] "Generic (PLEG): container finished" podID="5bc66d4f-bb04-4870-887e-14bee30827d6" containerID="eaebc6d0d8c3ca6e7021efe2e459c18ef148848ab3a81d3a3c8e11ab0ecd0a04" exitCode=1 Jun 08 20:58:23.441704 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:23.441688 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" event={"ID":"5bc66d4f-bb04-4870-887e-14bee30827d6","Type":"ContainerDied","Data":"eaebc6d0d8c3ca6e7021efe2e459c18ef148848ab3a81d3a3c8e11ab0ecd0a04"} Jun 08 20:58:23.441999 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:23.441986 2554 scope.go:117] "RemoveContainer" containerID="eaebc6d0d8c3ca6e7021efe2e459c18ef148848ab3a81d3a3c8e11ab0ecd0a04" Jun 08 20:58:24.445908 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:24.445867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" event={"ID":"5bc66d4f-bb04-4870-887e-14bee30827d6","Type":"ContainerStarted","Data":"0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f"} Jun 08 20:58:24.446350 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:24.446157 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:58:24.446770 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:58:24.446750 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 20:59:18.292731 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.292688 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv"] Jun 08 20:59:18.294386 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.294368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" Jun 08 20:59:18.296491 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.296463 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5fddf6b9d7-kztd5"] Jun 08 20:59:18.297531 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.297506 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mh6dn\"" Jun 08 20:59:18.298015 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.297994 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.301541 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.301522 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 20:59:18.301635 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.301552 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 20:59:18.301635 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.301555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 20:59:18.302408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.302392 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 20:59:18.302617 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.302596 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 20:59:18.302952 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.302937 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z8w8g\"" Jun 08 20:59:18.303630 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.303615 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 20:59:18.313560 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.313534 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv"] Jun 08 20:59:18.318166 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.318140 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fddf6b9d7-kztd5"] Jun 08 20:59:18.392518 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.392477 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7"] Jun 08 20:59:18.394341 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.394285 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6"] Jun 08 20:59:18.394488 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.394390 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.395924 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.395903 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-47z22"] Jun 08 20:59:18.396061 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.396040 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.397491 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397465 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.397768 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-default-certificate\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.397869 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-stats-auth\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.397928 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6bmp\" (UniqueName: \"kubernetes.io/projected/70ddf87c-e45e-4789-834e-3f1e64435f62-kube-api-access-l6bmp\") pod \"network-check-source-dbd9cf844-k2trv\" (UID: \"70ddf87c-e45e-4789-834e-3f1e64435f62\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" Jun 08 20:59:18.397928 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397915 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 20:59:18.398031 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.398031 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397959 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 20:59:18.398031 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397961 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rt2p\" (UniqueName: \"kubernetes.io/projected/69f20847-6a9b-495e-97e1-35dfd9bc4769-kube-api-access-4rt2p\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.398031 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.397988 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.398226 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.398032 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fwmlg\"" Jun 08 20:59:18.398286 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.398244 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 20:59:18.398375 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.398336 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 20:59:18.400261 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.400242 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 20:59:18.400399 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.400273 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cqgvg\"" Jun 08 20:59:18.400399 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.400286 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 20:59:18.400399 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.400248 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 20:59:18.400399 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.400361 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 20:59:18.403077 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.403061 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 20:59:18.403490 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.403474 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 20:59:18.403581 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.403479 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 20:59:18.404014 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.404001 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 20:59:18.404549 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.404529 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dxtxx\"" Jun 08 20:59:18.409675 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.409651 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 20:59:18.411720 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.411696 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7"] Jun 08 20:59:18.412648 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.412625 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-47z22"] Jun 08 20:59:18.413470 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.413447 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6"] Jun 08 20:59:18.481572 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.481530 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs"] Jun 08 20:59:18.483820 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.483795 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:18.486667 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.486646 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 20:59:18.486667 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.486649 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 20:59:18.486667 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.486686 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-96wgq\"" Jun 08 20:59:18.486986 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.486959 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 20:59:18.492434 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.492407 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs"] Jun 08 20:59:18.498432 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498400 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rt2p\" (UniqueName: \"kubernetes.io/projected/69f20847-6a9b-495e-97e1-35dfd9bc4769-kube-api-access-4rt2p\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.498432 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.498629 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6j2z\" (UniqueName: \"kubernetes.io/projected/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-kube-api-access-p6j2z\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.498629 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498477 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a848a-a116-4b5d-9164-d3c196f72b57-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.498629 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-service-ca-bundle\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.498629 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.498597 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:18.998575339 +0000 UTC m=+242.762416647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : configmap references non-existent config key: service-ca.crt Jun 08 20:59:18.498770 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498676 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.498770 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498699 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-snapshots\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.498770 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f82a848a-a116-4b5d-9164-d3c196f72b57-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.498862 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-stats-auth\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.498862 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.498862 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6bmp\" (UniqueName: \"kubernetes.io/projected/70ddf87c-e45e-4789-834e-3f1e64435f62-kube-api-access-l6bmp\") pod \"network-check-source-dbd9cf844-k2trv\" (UID: \"70ddf87c-e45e-4789-834e-3f1e64435f62\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" Jun 08 20:59:18.498862 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498852 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-tmp\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.498996 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-trusted-ca-bundle\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.498996 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-serving-cert\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.498996 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqbzs\" (UniqueName: \"kubernetes.io/projected/f82a848a-a116-4b5d-9164-d3c196f72b57-kube-api-access-tqbzs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.498996 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.498983 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fzd8\" (UniqueName: \"kubernetes.io/projected/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-kube-api-access-8fzd8\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.499126 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.499015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-default-certificate\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.499126 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.499055 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.499194 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.499148 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 20:59:18.499228 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.499204 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:18.999186588 +0000 UTC m=+242.763027898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : secret "router-metrics-certs-default" not found Jun 08 20:59:18.501500 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.501471 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-stats-auth\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.501619 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.501499 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-default-certificate\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.508090 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.508059 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6bmp\" (UniqueName: \"kubernetes.io/projected/70ddf87c-e45e-4789-834e-3f1e64435f62-kube-api-access-l6bmp\") pod \"network-check-source-dbd9cf844-k2trv\" (UID: \"70ddf87c-e45e-4789-834e-3f1e64435f62\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" Jun 08 20:59:18.508441 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.508423 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rt2p\" (UniqueName: \"kubernetes.io/projected/69f20847-6a9b-495e-97e1-35dfd9bc4769-kube-api-access-4rt2p\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:18.600130 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-trusted-ca-bundle\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.600130 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-serving-cert\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqbzs\" (UniqueName: \"kubernetes.io/projected/f82a848a-a116-4b5d-9164-d3c196f72b57-kube-api-access-tqbzs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fzd8\" (UniqueName: \"kubernetes.io/projected/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-kube-api-access-8fzd8\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98xwx\" (UniqueName: \"kubernetes.io/projected/b3d97a1a-bd49-4a4c-a225-ad564cd17850-kube-api-access-98xwx\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6j2z\" (UniqueName: \"kubernetes.io/projected/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-kube-api-access-p6j2z\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a848a-a116-4b5d-9164-d3c196f72b57-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.600418 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-service-ca-bundle\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.600765 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.600765 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-snapshots\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.600765 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600517 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f82a848a-a116-4b5d-9164-d3c196f72b57-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.600945 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600915 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-service-ca-bundle\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.601183 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.600979 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.601183 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.601014 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-tmp\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.601183 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.601098 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-trusted-ca-bundle\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.601183 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.601171 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f82a848a-a116-4b5d-9164-d3c196f72b57-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.601408 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.601183 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:18.601408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.601187 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.601408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.601183 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-snapshots\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.601408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.601316 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-tmp\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.601614 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.601453 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls podName:3b6a6613-02d4-4c40-bbad-cdf99ef1d281 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:19.101431132 +0000 UTC m=+242.865272439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zxgv6" (UID: "3b6a6613-02d4-4c40-bbad-cdf99ef1d281") : secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:18.602903 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.602882 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-serving-cert\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.603028 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.602956 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a848a-a116-4b5d-9164-d3c196f72b57-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.604712 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.604692 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" Jun 08 20:59:18.609894 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.609863 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqbzs\" (UniqueName: \"kubernetes.io/projected/f82a848a-a116-4b5d-9164-d3c196f72b57-kube-api-access-tqbzs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wtsv7\" (UID: \"f82a848a-a116-4b5d-9164-d3c196f72b57\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.610171 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.610151 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6j2z\" (UniqueName: \"kubernetes.io/projected/ec7610dd-cfc9-46f2-ace2-8f20b3adb9db-kube-api-access-p6j2z\") pod \"insights-operator-896549976-47z22\" (UID: \"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db\") " pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.611187 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.611136 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fzd8\" (UniqueName: \"kubernetes.io/projected/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-kube-api-access-8fzd8\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:18.701940 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.701886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:18.701940 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.701938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98xwx\" (UniqueName: \"kubernetes.io/projected/b3d97a1a-bd49-4a4c-a225-ad564cd17850-kube-api-access-98xwx\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:18.702188 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.702037 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 20:59:18.702188 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:18.702113 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls podName:b3d97a1a-bd49-4a4c-a225-ad564cd17850 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:19.202097312 +0000 UTC m=+242.965938633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-82nhs" (UID: "b3d97a1a-bd49-4a4c-a225-ad564cd17850") : secret "samples-operator-tls" not found Jun 08 20:59:18.704976 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.704942 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" Jun 08 20:59:18.712120 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.712028 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98xwx\" (UniqueName: \"kubernetes.io/projected/b3d97a1a-bd49-4a4c-a225-ad564cd17850-kube-api-access-98xwx\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:18.717874 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.717845 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-47z22" Jun 08 20:59:18.741799 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.741761 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv"] Jun 08 20:59:18.746913 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:59:18.746880 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ddf87c_e45e_4789_834e_3f1e64435f62.slice/crio-80b53f5e6cfa5fdbd2eb2faae54ede8dca8141199bd2c1cc1fcce2db218939ce WatchSource:0}: Error finding container 80b53f5e6cfa5fdbd2eb2faae54ede8dca8141199bd2c1cc1fcce2db218939ce: Status 404 returned error can't find the container with id 80b53f5e6cfa5fdbd2eb2faae54ede8dca8141199bd2c1cc1fcce2db218939ce Jun 08 20:59:18.857651 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.857533 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7"] Jun 08 20:59:18.860585 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:59:18.860550 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82a848a_a116_4b5d_9164_d3c196f72b57.slice/crio-bb03dcb9f69b6334d09be5c01cd207baae6a4f49397be216a74ab8cecf097d97 WatchSource:0}: Error finding container bb03dcb9f69b6334d09be5c01cd207baae6a4f49397be216a74ab8cecf097d97: Status 404 returned error can't find the container with id bb03dcb9f69b6334d09be5c01cd207baae6a4f49397be216a74ab8cecf097d97 Jun 08 20:59:18.873538 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:18.873507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-47z22"] Jun 08 20:59:18.876561 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:59:18.876537 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7610dd_cfc9_46f2_ace2_8f20b3adb9db.slice/crio-54aa7b8584794c4f9d29bb18505f6d0dedf0c367775446ce1539f249293fe250 WatchSource:0}: Error finding container 54aa7b8584794c4f9d29bb18505f6d0dedf0c367775446ce1539f249293fe250: Status 404 returned error can't find the container with id 54aa7b8584794c4f9d29bb18505f6d0dedf0c367775446ce1539f249293fe250 Jun 08 20:59:19.005408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.005368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:19.005408 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.005412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:19.005620 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.005543 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 20:59:19.005620 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.005542 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:20.005525191 +0000 UTC m=+243.769366497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : configmap references non-existent config key: service-ca.crt Jun 08 20:59:19.005695 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.005679 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:20.005664912 +0000 UTC m=+243.769506222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : secret "router-metrics-certs-default" not found Jun 08 20:59:19.106237 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.106194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:19.106434 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.106336 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:19.106434 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.106393 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls podName:3b6a6613-02d4-4c40-bbad-cdf99ef1d281 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:20.106379179 +0000 UTC m=+243.870220486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zxgv6" (UID: "3b6a6613-02d4-4c40-bbad-cdf99ef1d281") : secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:19.207471 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.207371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:19.207625 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.207558 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 20:59:19.207668 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:19.207645 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls podName:b3d97a1a-bd49-4a4c-a225-ad564cd17850 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:20.207619219 +0000 UTC m=+243.971460548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-82nhs" (UID: "b3d97a1a-bd49-4a4c-a225-ad564cd17850") : secret "samples-operator-tls" not found Jun 08 20:59:19.591677 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.591621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" event={"ID":"70ddf87c-e45e-4789-834e-3f1e64435f62","Type":"ContainerStarted","Data":"876be079d8f1b3a32d4ff9685162a47ce73053ed13ee2376526c95d6fc002a48"} Jun 08 20:59:19.592156 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.591729 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" event={"ID":"70ddf87c-e45e-4789-834e-3f1e64435f62","Type":"ContainerStarted","Data":"80b53f5e6cfa5fdbd2eb2faae54ede8dca8141199bd2c1cc1fcce2db218939ce"} Jun 08 20:59:19.593272 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.593241 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-47z22" event={"ID":"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db","Type":"ContainerStarted","Data":"54aa7b8584794c4f9d29bb18505f6d0dedf0c367775446ce1539f249293fe250"} Jun 08 20:59:19.594469 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.594446 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" event={"ID":"f82a848a-a116-4b5d-9164-d3c196f72b57","Type":"ContainerStarted","Data":"bb03dcb9f69b6334d09be5c01cd207baae6a4f49397be216a74ab8cecf097d97"} Jun 08 20:59:19.609874 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:19.609806 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-k2trv" podStartSLOduration=1.609781543 podStartE2EDuration="1.609781543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:19.608460085 +0000 UTC m=+243.372301415" watchObservedRunningTime="2026-06-08 20:59:19.609781543 +0000 UTC m=+243.373622871" Jun 08 20:59:20.015903 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:20.015750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:20.015903 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:20.015818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:20.016152 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.016057 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:22.016037502 +0000 UTC m=+245.779878814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : configmap references non-existent config key: service-ca.crt Jun 08 20:59:20.016285 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.016261 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 20:59:20.016379 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.016371 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:22.01635241 +0000 UTC m=+245.780193716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : secret "router-metrics-certs-default" not found Jun 08 20:59:20.117283 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:20.117200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:20.117476 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.117381 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:20.117476 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.117469 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls podName:3b6a6613-02d4-4c40-bbad-cdf99ef1d281 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:22.117446314 +0000 UTC m=+245.881287621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zxgv6" (UID: "3b6a6613-02d4-4c40-bbad-cdf99ef1d281") : secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:20.218557 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:20.218517 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:20.218720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.218622 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 20:59:20.218720 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:20.218686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls podName:b3d97a1a-bd49-4a4c-a225-ad564cd17850 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:22.218671315 +0000 UTC m=+245.982512622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-82nhs" (UID: "b3d97a1a-bd49-4a4c-a225-ad564cd17850") : secret "samples-operator-tls" not found Jun 08 20:59:21.603725 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:21.603665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" event={"ID":"f82a848a-a116-4b5d-9164-d3c196f72b57","Type":"ContainerStarted","Data":"44a1b31b4863fc0b237abddaab4d88456d8ba8e8aaecc74494c3ff0fe837a503"} Jun 08 20:59:21.605148 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:21.605116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-47z22" event={"ID":"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db","Type":"ContainerStarted","Data":"8bd70009ed2d904feb1e8bb5039cb3ab93c9afd90158d3bb967b2456aeadcb8e"} Jun 08 20:59:21.627036 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:21.626969 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" podStartSLOduration=1.172865368 podStartE2EDuration="3.626949517s" totalImagesPullingTime="2.454084149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:21.626107189 +0000 UTC m=+245.389948516" watchObservedRunningTime="2026-06-08 20:59:21.626949517 +0000 UTC m=+245.390790847" Jun 08 20:59:21.648464 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:21.648407 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-47z22" podStartSLOduration=1.20863379 podStartE2EDuration="3.648385965s" totalImagesPullingTime="2.439752175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:21.647558541 +0000 UTC m=+245.411399865" watchObservedRunningTime="2026-06-08 20:59:21.648385965 +0000 UTC m=+245.412227294" Jun 08 20:59:22.034318 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:22.034201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:22.034318 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:22.034248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:22.034549 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.034389 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 20:59:22.034549 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.034438 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:26.034422161 +0000 UTC m=+249.798263487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : configmap references non-existent config key: service-ca.crt Jun 08 20:59:22.034549 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.034471 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:26.034454252 +0000 UTC m=+249.798295563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : secret "router-metrics-certs-default" not found Jun 08 20:59:22.135233 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:22.135187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:22.135457 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.135388 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:22.135518 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.135466 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls podName:3b6a6613-02d4-4c40-bbad-cdf99ef1d281 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:26.135446147 +0000 UTC m=+249.899287471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zxgv6" (UID: "3b6a6613-02d4-4c40-bbad-cdf99ef1d281") : secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:22.236006 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:22.235961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:22.236195 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.236119 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 20:59:22.236195 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:22.236182 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls podName:b3d97a1a-bd49-4a4c-a225-ad564cd17850 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:26.236165768 +0000 UTC m=+250.000007090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-82nhs" (UID: "b3d97a1a-bd49-4a4c-a225-ad564cd17850") : secret "samples-operator-tls" not found Jun 08 20:59:24.379733 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:24.379703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tcsbt_cd9f35b9-cbda-4437-ba6b-387ed48084cf/dns-node-resolver/0.log" Jun 08 20:59:25.180482 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:25.180454 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tlvw2_4504bb35-e317-4eea-adbc-6d6d41fdb215/node-ca/0.log" Jun 08 20:59:25.981090 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:25.981062 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4fpvc_7d2090cc-04ad-4881-8a47-2b2bd286daab/serve-healthcheck-canary/0.log" Jun 08 20:59:26.067616 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:26.067569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:26.067616 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:26.067613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:26.067875 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.067734 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:34.067719028 +0000 UTC m=+257.831560335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : configmap references non-existent config key: service-ca.crt Jun 08 20:59:26.067875 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.067748 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 20:59:26.067875 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.067804 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:34.067786556 +0000 UTC m=+257.831627862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : secret "router-metrics-certs-default" not found Jun 08 20:59:26.168742 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:26.168708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:26.168901 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.168815 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:26.168901 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.168869 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls podName:3b6a6613-02d4-4c40-bbad-cdf99ef1d281 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:34.16885557 +0000 UTC m=+257.932696876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zxgv6" (UID: "3b6a6613-02d4-4c40-bbad-cdf99ef1d281") : secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:26.269723 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:26.269633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:26.269874 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.269805 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 20:59:26.269916 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:26.269880 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls podName:b3d97a1a-bd49-4a4c-a225-ad564cd17850 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:34.269862065 +0000 UTC m=+258.033703382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-82nhs" (UID: "b3d97a1a-bd49-4a4c-a225-ad564cd17850") : secret "samples-operator-tls" not found Jun 08 20:59:28.688719 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:28.688678 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 20:59:28.689102 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:28.688829 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 20:59:28.689102 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:28.688896 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs podName:d5f0742c-7c89-45cb-8300-90f5fd50b571 nodeName:}" failed. No retries permitted until 2026-06-08 21:01:30.688879775 +0000 UTC m=+374.452721081 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs") pod "network-metrics-daemon-frhgs" (UID: "d5f0742c-7c89-45cb-8300-90f5fd50b571") : secret "metrics-daemon-secret" not found Jun 08 20:59:34.136111 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.136045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:34.136111 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.136106 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:34.136582 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:34.136233 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle podName:69f20847-6a9b-495e-97e1-35dfd9bc4769 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:50.136218639 +0000 UTC m=+273.900059945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle") pod "router-default-5fddf6b9d7-kztd5" (UID: "69f20847-6a9b-495e-97e1-35dfd9bc4769") : configmap references non-existent config key: service-ca.crt Jun 08 20:59:34.138812 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.138783 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69f20847-6a9b-495e-97e1-35dfd9bc4769-metrics-certs\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:34.236849 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.236749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:34.237003 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:34.236898 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:34.237003 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:34.236969 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls podName:3b6a6613-02d4-4c40-bbad-cdf99ef1d281 nodeName:}" failed. No retries permitted until 2026-06-08 20:59:50.236952482 +0000 UTC m=+274.000793789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-zxgv6" (UID: "3b6a6613-02d4-4c40-bbad-cdf99ef1d281") : secret "cluster-monitoring-operator-tls" not found Jun 08 20:59:34.337589 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.337545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:34.340137 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.340110 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3d97a1a-bd49-4a4c-a225-ad564cd17850-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-82nhs\" (UID: \"b3d97a1a-bd49-4a4c-a225-ad564cd17850\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:34.392840 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.392752 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" Jun 08 20:59:34.525849 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.525810 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs"] Jun 08 20:59:34.647638 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:34.647544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" event={"ID":"b3d97a1a-bd49-4a4c-a225-ad564cd17850","Type":"ContainerStarted","Data":"f00b23b775e5535bc7046618c2ce4e99b2d551275ae5f3f2e448529f1eb47594"} Jun 08 20:59:36.654618 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:36.654582 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" event={"ID":"b3d97a1a-bd49-4a4c-a225-ad564cd17850","Type":"ContainerStarted","Data":"1a1228f0e01b03511b1453f9e2aeedae504ab987053b0b3950c398c2d35d007d"} Jun 08 20:59:37.659178 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:37.659144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" event={"ID":"b3d97a1a-bd49-4a4c-a225-ad564cd17850","Type":"ContainerStarted","Data":"9eca9ca23040916e0dea0f6dafcb88281365eb202eb5d9e6eaac9b2337a2e191"} Jun 08 20:59:37.676930 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:37.676877 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-82nhs" podStartSLOduration=17.657885729 podStartE2EDuration="19.676860282s" totalImagesPullingTime="2.018974553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:37.675405293 +0000 UTC m=+261.439246622" watchObservedRunningTime="2026-06-08 20:59:37.676860282 +0000 UTC m=+261.440701610" Jun 08 20:59:44.694119 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.694085 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zflr2"] Jun 08 20:59:44.697531 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.697510 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.702030 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.702005 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 20:59:44.702147 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.702055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-msb2v\"" Jun 08 20:59:44.702147 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.702069 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 20:59:44.707875 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.707852 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zflr2"] Jun 08 20:59:44.823979 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.823933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f20918-9afa-4399-b679-db7a0f75aa79-data-volume\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.823979 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.823978 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b55d\" (UniqueName: \"kubernetes.io/projected/14f20918-9afa-4399-b679-db7a0f75aa79-kube-api-access-5b55d\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.824205 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.824004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f20918-9afa-4399-b679-db7a0f75aa79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.824205 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.824082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14f20918-9afa-4399-b679-db7a0f75aa79-crio-socket\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.824205 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.824138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f20918-9afa-4399-b679-db7a0f75aa79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925313 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f20918-9afa-4399-b679-db7a0f75aa79-data-volume\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925313 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b55d\" (UniqueName: \"kubernetes.io/projected/14f20918-9afa-4399-b679-db7a0f75aa79-kube-api-access-5b55d\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925574 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f20918-9afa-4399-b679-db7a0f75aa79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925574 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14f20918-9afa-4399-b679-db7a0f75aa79-crio-socket\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925574 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f20918-9afa-4399-b679-db7a0f75aa79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925574 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925513 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14f20918-9afa-4399-b679-db7a0f75aa79-crio-socket\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925736 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925611 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14f20918-9afa-4399-b679-db7a0f75aa79-data-volume\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.925988 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.925966 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14f20918-9afa-4399-b679-db7a0f75aa79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.928038 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.928017 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14f20918-9afa-4399-b679-db7a0f75aa79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:44.934750 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:44.934723 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b55d\" (UniqueName: \"kubernetes.io/projected/14f20918-9afa-4399-b679-db7a0f75aa79-kube-api-access-5b55d\") pod \"insights-runtime-extractor-zflr2\" (UID: \"14f20918-9afa-4399-b679-db7a0f75aa79\") " pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:45.006531 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:45.006435 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zflr2" Jun 08 20:59:45.147384 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:45.146458 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zflr2"] Jun 08 20:59:45.685687 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:45.685647 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zflr2" event={"ID":"14f20918-9afa-4399-b679-db7a0f75aa79","Type":"ContainerStarted","Data":"f85523ff6b4f4427cbe2cc7dc5a1ac2677a8a15e7aabc185fa9a2e0ab1288acd"} Jun 08 20:59:45.685869 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:45.685725 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zflr2" event={"ID":"14f20918-9afa-4399-b679-db7a0f75aa79","Type":"ContainerStarted","Data":"811db9eddcb0bafc959d0b77fe0466cd746793c4c6118e419ba0a44bbff81f08"} Jun 08 20:59:46.691763 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:46.691724 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zflr2" event={"ID":"14f20918-9afa-4399-b679-db7a0f75aa79","Type":"ContainerStarted","Data":"f46fa99796cfbaa26960802d573b896dfb3a73302a9ba1b7fa8307b465458f68"} Jun 08 20:59:48.700310 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:48.700254 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zflr2" event={"ID":"14f20918-9afa-4399-b679-db7a0f75aa79","Type":"ContainerStarted","Data":"806f76c60c05595bfe8dd5d40b8f833d30431b3ec8f5affeac9683d5f4cc4b1c"} Jun 08 20:59:48.720049 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:48.719986 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zflr2" podStartSLOduration=2.321648093 podStartE2EDuration="4.719968267s" totalImagesPullingTime="2.398320174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 20:59:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:48.719037189 +0000 UTC m=+272.482878516" watchObservedRunningTime="2026-06-08 20:59:48.719968267 +0000 UTC m=+272.483809596" Jun 08 20:59:50.168128 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.168073 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:50.168737 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.168715 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69f20847-6a9b-495e-97e1-35dfd9bc4769-service-ca-bundle\") pod \"router-default-5fddf6b9d7-kztd5\" (UID: \"69f20847-6a9b-495e-97e1-35dfd9bc4769\") " pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:50.268800 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.268739 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:50.271349 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.271314 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6613-02d4-4c40-bbad-cdf99ef1d281-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-zxgv6\" (UID: \"3b6a6613-02d4-4c40-bbad-cdf99ef1d281\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:50.410068 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.410025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:50.511911 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.511641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" Jun 08 20:59:50.550539 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.550472 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fddf6b9d7-kztd5"] Jun 08 20:59:50.553556 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:59:50.553524 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f20847_6a9b_495e_97e1_35dfd9bc4769.slice/crio-8ac65be3c452b46bb2f4b26dcb57d85384ae00ad4dd21d9f1bdd12ad817f070a WatchSource:0}: Error finding container 8ac65be3c452b46bb2f4b26dcb57d85384ae00ad4dd21d9f1bdd12ad817f070a: Status 404 returned error can't find the container with id 8ac65be3c452b46bb2f4b26dcb57d85384ae00ad4dd21d9f1bdd12ad817f070a Jun 08 20:59:50.657949 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.657787 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6"] Jun 08 20:59:50.660864 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:59:50.660836 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6a6613_02d4_4c40_bbad_cdf99ef1d281.slice/crio-52d874dff06c59acad4b5d91f693847b064103cc2bcc5576311c9bf36b7e8381 WatchSource:0}: Error finding container 52d874dff06c59acad4b5d91f693847b064103cc2bcc5576311c9bf36b7e8381: Status 404 returned error can't find the container with id 52d874dff06c59acad4b5d91f693847b064103cc2bcc5576311c9bf36b7e8381 Jun 08 20:59:50.709060 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.708958 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" event={"ID":"69f20847-6a9b-495e-97e1-35dfd9bc4769","Type":"ContainerStarted","Data":"6f2446ed5cd4b635bc147905fdb5eb9e0e70e9499a45cefd9367fe4ff32187ca"} Jun 08 20:59:50.709060 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.709015 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" event={"ID":"69f20847-6a9b-495e-97e1-35dfd9bc4769","Type":"ContainerStarted","Data":"8ac65be3c452b46bb2f4b26dcb57d85384ae00ad4dd21d9f1bdd12ad817f070a"} Jun 08 20:59:50.710410 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.710379 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" event={"ID":"3b6a6613-02d4-4c40-bbad-cdf99ef1d281","Type":"ContainerStarted","Data":"52d874dff06c59acad4b5d91f693847b064103cc2bcc5576311c9bf36b7e8381"} Jun 08 20:59:50.730370 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:50.730285 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" podStartSLOduration=32.730270734 podStartE2EDuration="32.730270734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:50.728035747 +0000 UTC m=+274.491877075" watchObservedRunningTime="2026-06-08 20:59:50.730270734 +0000 UTC m=+274.494112065" Jun 08 20:59:51.410913 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:51.410876 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:51.413905 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:51.413874 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:51.713970 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:51.713882 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:51.715155 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:51.715134 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5fddf6b9d7-kztd5" Jun 08 20:59:52.718828 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:52.718795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" event={"ID":"3b6a6613-02d4-4c40-bbad-cdf99ef1d281","Type":"ContainerStarted","Data":"ff426a8fb6a2a22d883620c5cde5aea41161f4b6ee8726d1f632a4e42b152b2b"} Jun 08 20:59:52.737053 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:52.736990 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-zxgv6" podStartSLOduration=32.740996575 podStartE2EDuration="34.736974462s" totalImagesPullingTime="1.995977887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:52.736441441 +0000 UTC m=+276.500282768" watchObservedRunningTime="2026-06-08 20:59:52.736974462 +0000 UTC m=+276.500815790" Jun 08 20:59:53.160544 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.160502 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx"] Jun 08 20:59:53.163646 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.163628 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:53.166430 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.166406 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 20:59:53.166569 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.166485 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hvg4h\"" Jun 08 20:59:53.180316 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.175402 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx"] Jun 08 20:59:53.300663 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.300617 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9a78f33e-acc2-416f-97a1-f049b29c1866-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cp2vx\" (UID: \"9a78f33e-acc2-416f-97a1-f049b29c1866\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:53.401600 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.401551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9a78f33e-acc2-416f-97a1-f049b29c1866-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cp2vx\" (UID: \"9a78f33e-acc2-416f-97a1-f049b29c1866\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:53.404234 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.404207 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9a78f33e-acc2-416f-97a1-f049b29c1866-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cp2vx\" (UID: \"9a78f33e-acc2-416f-97a1-f049b29c1866\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:53.472143 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.472044 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:53.607223 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.607189 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx"] Jun 08 20:59:53.610562 ip-10-0-135-176 kubenswrapper[2554]: W0608 20:59:53.610531 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a78f33e_acc2_416f_97a1_f049b29c1866.slice/crio-5e7abc0a7a79041c97f6f09fa991f5135ab97d0bfd5180ec0d77921ea49db9b9 WatchSource:0}: Error finding container 5e7abc0a7a79041c97f6f09fa991f5135ab97d0bfd5180ec0d77921ea49db9b9: Status 404 returned error can't find the container with id 5e7abc0a7a79041c97f6f09fa991f5135ab97d0bfd5180ec0d77921ea49db9b9 Jun 08 20:59:53.723033 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:53.722931 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" event={"ID":"9a78f33e-acc2-416f-97a1-f049b29c1866","Type":"ContainerStarted","Data":"5e7abc0a7a79041c97f6f09fa991f5135ab97d0bfd5180ec0d77921ea49db9b9"} Jun 08 20:59:55.732196 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:55.732159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" event={"ID":"9a78f33e-acc2-416f-97a1-f049b29c1866","Type":"ContainerStarted","Data":"f7edec3e44bc9582dad8e77e745c47091bbb6c9bf670133c38e951aa410183b2"} Jun 08 20:59:55.732775 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:55.732418 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:55.737354 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:55.737331 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" Jun 08 20:59:55.748879 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:55.748830 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cp2vx" podStartSLOduration=1.6105059449999999 podStartE2EDuration="2.748814304s" totalImagesPullingTime="1.138308359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 20:59:55.747828818 +0000 UTC m=+279.511670146" watchObservedRunningTime="2026-06-08 20:59:55.748814304 +0000 UTC m=+279.512655632" Jun 08 20:59:58.372795 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:58.372734 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" podUID="c8807162-6d01-4a9c-997e-583d112379c8" Jun 08 20:59:58.372795 ip-10-0-135-176 kubenswrapper[2554]: E0608 20:59:58.372734 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5wp2h" podUID="7cdd4bd6-7a34-4632-b350-01f3723bd717" Jun 08 20:59:58.742647 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:58.742566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wp2h" Jun 08 20:59:58.742793 ip-10-0-135-176 kubenswrapper[2554]: I0608 20:59:58.742566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:02.171139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.171100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:02.171139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.171145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 21:00:02.173828 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.173785 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cdd4bd6-7a34-4632-b350-01f3723bd717-metrics-tls\") pod \"dns-default-5wp2h\" (UID: \"7cdd4bd6-7a34-4632-b350-01f3723bd717\") " pod="openshift-dns/dns-default-5wp2h" Jun 08 21:00:02.173941 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.173846 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"image-registry-5dbdc46c7-5kmfj\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:02.347960 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.347926 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5mnkl\"" Jun 08 21:00:02.347960 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.347926 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6wgq7\"" Jun 08 21:00:02.354403 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.354361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:02.354403 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.354402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wp2h" Jun 08 21:00:02.508581 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.508549 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dbdc46c7-5kmfj"] Jun 08 21:00:02.512342 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:00:02.512312 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8807162_6d01_4a9c_997e_583d112379c8.slice/crio-b1ff2cba5bf84728d4429dd4b6c962b3c3be0fe32086e6f71b23e63772d2af8b WatchSource:0}: Error finding container b1ff2cba5bf84728d4429dd4b6c962b3c3be0fe32086e6f71b23e63772d2af8b: Status 404 returned error can't find the container with id b1ff2cba5bf84728d4429dd4b6c962b3c3be0fe32086e6f71b23e63772d2af8b Jun 08 21:00:02.524924 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.524828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wp2h"] Jun 08 21:00:02.527045 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:00:02.526992 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdd4bd6_7a34_4632_b350_01f3723bd717.slice/crio-886a4fe30e8d39598ec13934128fcd4f175159d06a7994f90cd58587fac1d16d WatchSource:0}: Error finding container 886a4fe30e8d39598ec13934128fcd4f175159d06a7994f90cd58587fac1d16d: Status 404 returned error can't find the container with id 886a4fe30e8d39598ec13934128fcd4f175159d06a7994f90cd58587fac1d16d Jun 08 21:00:02.755505 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.755411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wp2h" event={"ID":"7cdd4bd6-7a34-4632-b350-01f3723bd717","Type":"ContainerStarted","Data":"886a4fe30e8d39598ec13934128fcd4f175159d06a7994f90cd58587fac1d16d"} Jun 08 21:00:02.756838 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.756815 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" event={"ID":"c8807162-6d01-4a9c-997e-583d112379c8","Type":"ContainerStarted","Data":"ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5"} Jun 08 21:00:02.756942 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.756852 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" event={"ID":"c8807162-6d01-4a9c-997e-583d112379c8","Type":"ContainerStarted","Data":"b1ff2cba5bf84728d4429dd4b6c962b3c3be0fe32086e6f71b23e63772d2af8b"} Jun 08 21:00:02.756981 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.756945 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:02.777964 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:02.777916 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" podStartSLOduration=285.777899776 podStartE2EDuration="4m45.777899776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:00:02.776346114 +0000 UTC m=+286.540187443" watchObservedRunningTime="2026-06-08 21:00:02.777899776 +0000 UTC m=+286.541741081" Jun 08 21:00:05.769752 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:05.769716 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wp2h" event={"ID":"7cdd4bd6-7a34-4632-b350-01f3723bd717","Type":"ContainerStarted","Data":"4303f1c041bd44902351c2876c6bba3b05be50c70ebe292bc1846b74b81bff8e"} Jun 08 21:00:05.770250 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:05.769772 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wp2h" event={"ID":"7cdd4bd6-7a34-4632-b350-01f3723bd717","Type":"ContainerStarted","Data":"d5630236741f86766ab7acd3255ed1f42fe6f05574aedffea7d5740425b6ab10"} Jun 08 21:00:05.770250 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:05.769853 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5wp2h" Jun 08 21:00:05.788754 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:05.788700 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5wp2h" podStartSLOduration=251.638918447 podStartE2EDuration="4m13.788682026s" totalImagesPullingTime="2.149763579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:00:05.787490656 +0000 UTC m=+289.551331984" watchObservedRunningTime="2026-06-08 21:00:05.788682026 +0000 UTC m=+289.552523354" Jun 08 21:00:07.567982 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.567943 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8t5ls"] Jun 08 21:00:07.571390 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.571363 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.574627 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.574605 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 21:00:07.574871 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.574854 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 21:00:07.574941 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.574887 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mstts\"" Jun 08 21:00:07.575022 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.575003 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 21:00:07.575989 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.575974 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 21:00:07.615961 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.615928 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-accelerators-collector-config\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.615961 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.615962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-sys\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616177 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.615980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616177 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.616064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-root\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616177 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.616109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p8q8\" (UniqueName: \"kubernetes.io/projected/d7548076-a92b-4110-96e7-fb2d3f9d1a00-kube-api-access-2p8q8\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616177 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.616137 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-wtmp\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616177 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.616162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-textfile\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616393 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.616189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-tls\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.616393 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.616209 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7548076-a92b-4110-96e7-fb2d3f9d1a00-metrics-client-ca\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717312 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-tls\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717508 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7548076-a92b-4110-96e7-fb2d3f9d1a00-metrics-client-ca\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717508 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-accelerators-collector-config\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717508 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-sys\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717508 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717480 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-sys\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717836 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717925 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717897 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-root\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717973 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p8q8\" (UniqueName: \"kubernetes.io/projected/d7548076-a92b-4110-96e7-fb2d3f9d1a00-kube-api-access-2p8q8\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.717973 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.717957 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-wtmp\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.718070 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.718019 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-root\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.718070 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.718031 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7548076-a92b-4110-96e7-fb2d3f9d1a00-metrics-client-ca\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.718070 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.718047 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-accelerators-collector-config\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.718192 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.718065 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-textfile\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.718192 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.718101 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-wtmp\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.718360 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.718337 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-textfile\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.720040 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.720018 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-tls\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.720111 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.720092 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7548076-a92b-4110-96e7-fb2d3f9d1a00-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.726963 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.726937 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p8q8\" (UniqueName: \"kubernetes.io/projected/d7548076-a92b-4110-96e7-fb2d3f9d1a00-kube-api-access-2p8q8\") pod \"node-exporter-8t5ls\" (UID: \"d7548076-a92b-4110-96e7-fb2d3f9d1a00\") " pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.880846 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:07.880810 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8t5ls" Jun 08 21:00:07.893989 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:00:07.893958 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7548076_a92b_4110_96e7_fb2d3f9d1a00.slice/crio-36d265a95a22a189b2b031b4ee90e8d5835544abafd309feeb50b8bb592d0080 WatchSource:0}: Error finding container 36d265a95a22a189b2b031b4ee90e8d5835544abafd309feeb50b8bb592d0080: Status 404 returned error can't find the container with id 36d265a95a22a189b2b031b4ee90e8d5835544abafd309feeb50b8bb592d0080 Jun 08 21:00:08.628796 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.628760 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 21:00:08.632890 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.632859 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.636255 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.636230 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 21:00:08.636787 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.636764 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 21:00:08.636913 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.636811 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 21:00:08.637411 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637388 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 21:00:08.637550 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637445 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 21:00:08.637550 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637394 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 21:00:08.637780 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637753 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 21:00:08.637780 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637776 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vhhn6\"" Jun 08 21:00:08.637888 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637821 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 21:00:08.637888 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.637780 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 21:00:08.651854 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.651820 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 21:00:08.727510 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727510 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c782cd-f382-4a3a-b3e2-452217d6ac24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727551 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727607 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-web-config\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727649 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c782cd-f382-4a3a-b3e2-452217d6ac24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6nfq\" (UniqueName: \"kubernetes.io/projected/96c782cd-f382-4a3a-b3e2-452217d6ac24-kube-api-access-z6nfq\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727712 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96c782cd-f382-4a3a-b3e2-452217d6ac24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727978 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96c782cd-f382-4a3a-b3e2-452217d6ac24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727978 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727811 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-config-volume\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727978 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727978 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96c782cd-f382-4a3a-b3e2-452217d6ac24-config-out\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.727978 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.727892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.786259 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.786223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8t5ls" event={"ID":"d7548076-a92b-4110-96e7-fb2d3f9d1a00","Type":"ContainerStarted","Data":"36d265a95a22a189b2b031b4ee90e8d5835544abafd309feeb50b8bb592d0080"} Jun 08 21:00:08.828874 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.828836 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96c782cd-f382-4a3a-b3e2-452217d6ac24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.828874 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.828878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-config-volume\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.828897 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.828915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96c782cd-f382-4a3a-b3e2-452217d6ac24-config-out\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.828952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.828973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c782cd-f382-4a3a-b3e2-452217d6ac24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-web-config\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c782cd-f382-4a3a-b3e2-452217d6ac24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829139 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829128 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6nfq\" (UniqueName: \"kubernetes.io/projected/96c782cd-f382-4a3a-b3e2-452217d6ac24-kube-api-access-z6nfq\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829600 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829600 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96c782cd-f382-4a3a-b3e2-452217d6ac24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829871 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829604 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96c782cd-f382-4a3a-b3e2-452217d6ac24-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.829871 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:08.829680 2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 21:00:08.829965 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:08.829905 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-main-tls podName:96c782cd-f382-4a3a-b3e2-452217d6ac24 nodeName:}" failed. No retries permitted until 2026-06-08 21:00:09.32988627 +0000 UTC m=+293.093727581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "96c782cd-f382-4a3a-b3e2-452217d6ac24") : secret "alertmanager-main-tls" not found Jun 08 21:00:08.829965 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.829941 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c782cd-f382-4a3a-b3e2-452217d6ac24-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.832561 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.830796 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96c782cd-f382-4a3a-b3e2-452217d6ac24-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.832561 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.832158 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.833231 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.833188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.833631 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.833602 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.834284 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.834239 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.834461 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.834441 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96c782cd-f382-4a3a-b3e2-452217d6ac24-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.834701 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.834682 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-config-volume\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.834701 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.834694 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-web-config\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.835941 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.835913 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96c782cd-f382-4a3a-b3e2-452217d6ac24-config-out\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:08.841114 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:08.841090 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6nfq\" (UniqueName: \"kubernetes.io/projected/96c782cd-f382-4a3a-b3e2-452217d6ac24-kube-api-access-z6nfq\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:09.332923 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.332890 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:09.335605 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.335574 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96c782cd-f382-4a3a-b3e2-452217d6ac24-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96c782cd-f382-4a3a-b3e2-452217d6ac24\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:09.545112 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.545076 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 21:00:09.545633 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.545613 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn"] Jun 08 21:00:09.553748 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.553723 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.558957 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.558927 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 21:00:09.558957 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.558930 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 21:00:09.560215 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.560190 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 21:00:09.560364 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.560287 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 21:00:09.560364 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.560346 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jjws5\"" Jun 08 21:00:09.560459 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.560362 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-qb6catmr5urg\"" Jun 08 21:00:09.560647 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.560571 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 21:00:09.566783 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.566752 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn"] Jun 08 21:00:09.636675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.636675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.636675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.636675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e83d842-01e0-4982-8d06-d052b63c7e7f-metrics-client-ca\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.636675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdtp\" (UniqueName: \"kubernetes.io/projected/7e83d842-01e0-4982-8d06-d052b63c7e7f-kube-api-access-nkdtp\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.637098 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636734 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-tls\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.637098 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-grpc-tls\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.637098 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.636814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.698020 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.697977 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 21:00:09.702202 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:00:09.702172 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c782cd_f382_4a3a_b3e2_452217d6ac24.slice/crio-c826e24e0c792afd255297a4cd6f6825bcf0e89a841adc6dcbc3e5586ffa8800 WatchSource:0}: Error finding container c826e24e0c792afd255297a4cd6f6825bcf0e89a841adc6dcbc3e5586ffa8800: Status 404 returned error can't find the container with id c826e24e0c792afd255297a4cd6f6825bcf0e89a841adc6dcbc3e5586ffa8800 Jun 08 21:00:09.737656 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737656 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737937 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e83d842-01e0-4982-8d06-d052b63c7e7f-metrics-client-ca\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737937 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdtp\" (UniqueName: \"kubernetes.io/projected/7e83d842-01e0-4982-8d06-d052b63c7e7f-kube-api-access-nkdtp\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737937 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737799 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-tls\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737937 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737830 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-grpc-tls\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737937 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.737937 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.737883 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.738845 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.738806 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e83d842-01e0-4982-8d06-d052b63c7e7f-metrics-client-ca\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.740766 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.740728 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-grpc-tls\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.740919 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.740769 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-tls\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.741032 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.741009 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.741101 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.741066 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.741165 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.741129 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.741256 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.741236 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e83d842-01e0-4982-8d06-d052b63c7e7f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.748096 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.748063 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdtp\" (UniqueName: \"kubernetes.io/projected/7e83d842-01e0-4982-8d06-d052b63c7e7f-kube-api-access-nkdtp\") pod \"thanos-querier-5bbc9dbf4c-x6dbn\" (UID: \"7e83d842-01e0-4982-8d06-d052b63c7e7f\") " pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:09.788636 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.788594 2554 generic.go:356] "Generic (PLEG): container finished" podID="d7548076-a92b-4110-96e7-fb2d3f9d1a00" containerID="6c2b1570b86e049202efebce710e7dc1bf449dbff504edce01bd26fe0ef902ac" exitCode=0 Jun 08 21:00:09.788833 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.788682 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8t5ls" event={"ID":"d7548076-a92b-4110-96e7-fb2d3f9d1a00","Type":"ContainerDied","Data":"6c2b1570b86e049202efebce710e7dc1bf449dbff504edce01bd26fe0ef902ac"} Jun 08 21:00:09.790005 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.789969 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"c826e24e0c792afd255297a4cd6f6825bcf0e89a841adc6dcbc3e5586ffa8800"} Jun 08 21:00:09.864243 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:09.864212 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:10.017891 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:10.017860 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn"] Jun 08 21:00:10.021584 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:00:10.021555 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e83d842_01e0_4982_8d06_d052b63c7e7f.slice/crio-9367a8e31d86bd3faea0d28a98f0615e388622bf50cf6e3f9aef2a5a7670652c WatchSource:0}: Error finding container 9367a8e31d86bd3faea0d28a98f0615e388622bf50cf6e3f9aef2a5a7670652c: Status 404 returned error can't find the container with id 9367a8e31d86bd3faea0d28a98f0615e388622bf50cf6e3f9aef2a5a7670652c Jun 08 21:00:10.796993 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:10.796951 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8t5ls" event={"ID":"d7548076-a92b-4110-96e7-fb2d3f9d1a00","Type":"ContainerStarted","Data":"c7c78d5d5a2c3f07c329608e4a001ddb121bc9800eade1ad94dbce9d1545b4a4"} Jun 08 21:00:10.796993 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:10.797021 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8t5ls" event={"ID":"d7548076-a92b-4110-96e7-fb2d3f9d1a00","Type":"ContainerStarted","Data":"1e41a1600821ae6005df24b0f0f17e8a429def486634e78c2085ba53e822f318"} Jun 08 21:00:10.798601 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:10.798571 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"9367a8e31d86bd3faea0d28a98f0615e388622bf50cf6e3f9aef2a5a7670652c"} Jun 08 21:00:10.819751 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:10.819672 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8t5ls" podStartSLOduration=2.85064171 podStartE2EDuration="3.819648994s" totalImagesPullingTime="891.037558ms" totalInitContainerRuntime="77.969726ms" isStatefulPod=true podCreationTimestamp="2026-06-08 21:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:00:10.817867278 +0000 UTC m=+294.581708609" watchObservedRunningTime="2026-06-08 21:00:10.819648994 +0000 UTC m=+294.583490323" Jun 08 21:00:11.803543 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:11.803513 2554 generic.go:356] "Generic (PLEG): container finished" podID="96c782cd-f382-4a3a-b3e2-452217d6ac24" containerID="d8e3a7eb11a76e448f7df88a9480931e5c046e99137b53964fd21f7beeaade46" exitCode=0 Jun 08 21:00:11.804029 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:11.803599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerDied","Data":"d8e3a7eb11a76e448f7df88a9480931e5c046e99137b53964fd21f7beeaade46"} Jun 08 21:00:12.781804 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:12.781701 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-frhgs" podUID="d5f0742c-7c89-45cb-8300-90f5fd50b571" Jun 08 21:00:12.809359 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:12.809319 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"ca2773b1e2c1dac1e1f2c72a929e29041bee2094cc9eedefb80db66a4879f7ca"} Jun 08 21:00:12.809713 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:12.809390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"1cd5f671179440c2953649f800047b1c50dd07fcfac87e30fd8521ac9405ad75"} Jun 08 21:00:12.809713 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:12.809414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"d467d048bac96a8d66d24338e549f9f48bc76ad24b2541616e633fb6e6a17fc9"} Jun 08 21:00:14.819753 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.819708 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"c7bfe2bc8809a7e7d2b776496062173a78329218613ed9982686ce1d16255f7d"} Jun 08 21:00:14.820226 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.819796 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"75457817c1cf2cc5a71da41a9371bd515436c815758ccfadd929b5624edd5ba7"} Jun 08 21:00:14.820226 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.819847 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:14.820226 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.819883 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" event={"ID":"7e83d842-01e0-4982-8d06-d052b63c7e7f","Type":"ContainerStarted","Data":"54c601450ec8b81f19ac93125a7af6a089d54c972835a2feaa73d90c6b261b74"} Jun 08 21:00:14.823065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.823037 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"5444823c58a3303ce6073297ead4fd336f14cf07fd6de0d3ec66255f81f7a151"} Jun 08 21:00:14.823212 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.823099 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"ae86325705a7f1f19fd18c55d53ff5fc0a383fe53d7d841935d0e8449bdc2307"} Jun 08 21:00:14.823212 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.823128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"1da36379bfb6f6a5340836f420ac074fa82ac536514fa3b296b7b772c5ae86e2"} Jun 08 21:00:14.823212 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.823152 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"4ba4b835b20cc83e0c8bc9652c4a92362b270b18a42455e2093da6360daa3235"} Jun 08 21:00:14.823212 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.823192 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"51c73224fd61aad03e3f27df559ea023ae6cfb62029b334037f580db244ceb0b"} Jun 08 21:00:14.823369 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.823219 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96c782cd-f382-4a3a-b3e2-452217d6ac24","Type":"ContainerStarted","Data":"8e73d0f4fd6bb5f170017c0bee4c3d48c00b197e026054d838c952690290872c"} Jun 08 21:00:14.846457 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.846397 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" podStartSLOduration=2.330883053 podStartE2EDuration="5.846376765s" totalImagesPullingTime="3.515493712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:00:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:00:14.845153695 +0000 UTC m=+298.608995029" watchObservedRunningTime="2026-06-08 21:00:14.846376765 +0000 UTC m=+298.610218148" Jun 08 21:00:14.876927 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:14.876865 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.812615693 podStartE2EDuration="6.876846194s" totalImagesPullingTime="3.047764091s" totalInitContainerRuntime="16.46641ms" isStatefulPod=false podCreationTimestamp="2026-06-08 21:00:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:00:14.875220173 +0000 UTC m=+298.639061502" watchObservedRunningTime="2026-06-08 21:00:14.876846194 +0000 UTC m=+298.640687522" Jun 08 21:00:15.775250 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:15.775207 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5wp2h" Jun 08 21:00:16.721412 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:16.721384 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 21:00:17.230453 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:17.230411 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dbdc46c7-5kmfj"] Jun 08 21:00:17.234996 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:17.234956 2554 patch_prober.go:28] interesting pod/image-registry-5dbdc46c7-5kmfj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 21:00:17.235143 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:17.235010 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" podUID="c8807162-6d01-4a9c-997e-583d112379c8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:00:20.833631 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:20.833605 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bbc9dbf4c-x6dbn" Jun 08 21:00:23.862146 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:23.862056 2554 generic.go:356] "Generic (PLEG): container finished" podID="5bc66d4f-bb04-4870-887e-14bee30827d6" containerID="0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f" exitCode=1 Jun 08 21:00:23.862621 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:23.862137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" event={"ID":"5bc66d4f-bb04-4870-887e-14bee30827d6","Type":"ContainerDied","Data":"0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f"} Jun 08 21:00:23.862621 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:23.862216 2554 scope.go:117] "RemoveContainer" containerID="eaebc6d0d8c3ca6e7021efe2e459c18ef148848ab3a81d3a3c8e11ab0ecd0a04" Jun 08 21:00:23.862621 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:23.862560 2554 scope.go:117] "RemoveContainer" containerID="0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f" Jun 08 21:00:23.862779 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:23.862761 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6db7b76964-tqr56_open-cluster-management-agent-addon(5bc66d4f-bb04-4870-887e-14bee30827d6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" podUID="5bc66d4f-bb04-4870-887e-14bee30827d6" Jun 08 21:00:24.446523 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:24.446482 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 21:00:24.781359 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:24.781245 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 21:00:24.872983 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:24.872953 2554 scope.go:117] "RemoveContainer" containerID="0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f" Jun 08 21:00:24.873386 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:24.873118 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6db7b76964-tqr56_open-cluster-management-agent-addon(5bc66d4f-bb04-4870-887e-14bee30827d6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" podUID="5bc66d4f-bb04-4870-887e-14bee30827d6" Jun 08 21:00:27.235290 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:27.235258 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:27.717358 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:27.717287 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 21:00:27.717682 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:27.717669 2554 scope.go:117] "RemoveContainer" containerID="0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f" Jun 08 21:00:27.717848 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:27.717829 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6db7b76964-tqr56_open-cluster-management-agent-addon(5bc66d4f-bb04-4870-887e-14bee30827d6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" podUID="5bc66d4f-bb04-4870-887e-14bee30827d6" Jun 08 21:00:41.780855 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:41.780826 2554 scope.go:117] "RemoveContainer" containerID="0d03e77008d4004fb7ca245beba81dca111867e7870fdb82b6235f2055c9b00f" Jun 08 21:00:41.937182 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:41.937149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" event={"ID":"5bc66d4f-bb04-4870-887e-14bee30827d6","Type":"ContainerStarted","Data":"a2137d95b37b7c8d669b29c9f1a92c8ca1d3c507fb3fe7192ba6bbd3b7160f35"} Jun 08 21:00:41.937416 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:41.937395 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 21:00:41.939043 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:41.939021 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db7b76964-tqr56" Jun 08 21:00:42.251046 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.251004 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" podUID="c8807162-6d01-4a9c-997e-583d112379c8" containerName="registry" containerID="cri-o://ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5" gracePeriod=30 Jun 08 21:00:42.523519 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.523482 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:42.533464 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533414 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8807162-6d01-4a9c-997e-583d112379c8-ca-trust-extracted\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533464 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533483 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-installation-pull-secrets\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533521 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-image-registry-private-configuration\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533547 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533579 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5748\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-kube-api-access-t5748\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533613 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-trusted-ca\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533635 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-bound-sa-token\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.533740 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.533689 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-registry-certificates\") pod \"c8807162-6d01-4a9c-997e-583d112379c8\" (UID: \"c8807162-6d01-4a9c-997e-583d112379c8\") " Jun 08 21:00:42.534354 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.534075 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:00:42.534547 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.534415 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 21:00:42.536363 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.536316 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:00:42.536501 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.536473 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-kube-api-access-t5748" (OuterVolumeSpecName: "kube-api-access-t5748") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "kube-api-access-t5748". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:00:42.536739 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.536711 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:00:42.536863 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.536828 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 21:00:42.536925 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.536860 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:00:42.545213 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.545179 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8807162-6d01-4a9c-997e-583d112379c8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c8807162-6d01-4a9c-997e-583d112379c8" (UID: "c8807162-6d01-4a9c-997e-583d112379c8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 21:00:42.634731 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634690 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-image-registry-private-configuration\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634731 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634725 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-registry-tls\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634731 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634736 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5748\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-kube-api-access-t5748\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634969 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634745 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-trusted-ca\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634969 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634754 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8807162-6d01-4a9c-997e-583d112379c8-bound-sa-token\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634969 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634762 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8807162-6d01-4a9c-997e-583d112379c8-registry-certificates\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634969 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634771 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8807162-6d01-4a9c-997e-583d112379c8-ca-trust-extracted\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.634969 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.634778 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8807162-6d01-4a9c-997e-583d112379c8-installation-pull-secrets\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:00:42.944126 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.944091 2554 generic.go:356] "Generic (PLEG): container finished" podID="c8807162-6d01-4a9c-997e-583d112379c8" containerID="ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5" exitCode=0 Jun 08 21:00:42.944573 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.944151 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" Jun 08 21:00:42.944573 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.944184 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" event={"ID":"c8807162-6d01-4a9c-997e-583d112379c8","Type":"ContainerDied","Data":"ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5"} Jun 08 21:00:42.944573 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.944243 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dbdc46c7-5kmfj" event={"ID":"c8807162-6d01-4a9c-997e-583d112379c8","Type":"ContainerDied","Data":"b1ff2cba5bf84728d4429dd4b6c962b3c3be0fe32086e6f71b23e63772d2af8b"} Jun 08 21:00:42.944573 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.944266 2554 scope.go:117] "RemoveContainer" containerID="ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5" Jun 08 21:00:42.952870 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.952846 2554 scope.go:117] "RemoveContainer" containerID="ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5" Jun 08 21:00:42.953216 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:00:42.953197 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5\": container with ID starting with ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5 not found: ID does not exist" containerID="ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5" Jun 08 21:00:42.953258 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.953227 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5"} err="failed to get container status \"ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5\": rpc error: code = NotFound desc = could not find container \"ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5\": container with ID starting with ac39cae6ca8c428d2dc3da7c34f1f5e023b6b70af1c2f38c7ef85171dcfca9c5 not found: ID does not exist" Jun 08 21:00:42.963454 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.963422 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dbdc46c7-5kmfj"] Jun 08 21:00:42.970248 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:42.970221 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dbdc46c7-5kmfj"] Jun 08 21:00:44.786189 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:44.786150 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8807162-6d01-4a9c-997e-583d112379c8" path="/var/lib/kubelet/pods/c8807162-6d01-4a9c-997e-583d112379c8/volumes" Jun 08 21:00:46.961318 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:46.961260 2554 generic.go:356] "Generic (PLEG): container finished" podID="ec7610dd-cfc9-46f2-ace2-8f20b3adb9db" containerID="8bd70009ed2d904feb1e8bb5039cb3ab93c9afd90158d3bb967b2456aeadcb8e" exitCode=0 Jun 08 21:00:46.961777 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:46.961337 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-47z22" event={"ID":"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db","Type":"ContainerDied","Data":"8bd70009ed2d904feb1e8bb5039cb3ab93c9afd90158d3bb967b2456aeadcb8e"} Jun 08 21:00:46.961777 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:46.961726 2554 scope.go:117] "RemoveContainer" containerID="8bd70009ed2d904feb1e8bb5039cb3ab93c9afd90158d3bb967b2456aeadcb8e" Jun 08 21:00:47.966957 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:47.966923 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-47z22" event={"ID":"ec7610dd-cfc9-46f2-ace2-8f20b3adb9db","Type":"ContainerStarted","Data":"d351abda66315c76e31efcb5783d527e398fbe01c0805d7b0f3abbbf42f58c42"} Jun 08 21:00:51.982675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:51.982638 2554 generic.go:356] "Generic (PLEG): container finished" podID="f82a848a-a116-4b5d-9164-d3c196f72b57" containerID="44a1b31b4863fc0b237abddaab4d88456d8ba8e8aaecc74494c3ff0fe837a503" exitCode=0 Jun 08 21:00:51.983054 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:51.982709 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" event={"ID":"f82a848a-a116-4b5d-9164-d3c196f72b57","Type":"ContainerDied","Data":"44a1b31b4863fc0b237abddaab4d88456d8ba8e8aaecc74494c3ff0fe837a503"} Jun 08 21:00:51.983094 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:51.983063 2554 scope.go:117] "RemoveContainer" containerID="44a1b31b4863fc0b237abddaab4d88456d8ba8e8aaecc74494c3ff0fe837a503" Jun 08 21:00:52.988154 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:00:52.988120 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wtsv7" event={"ID":"f82a848a-a116-4b5d-9164-d3c196f72b57","Type":"ContainerStarted","Data":"753d5fc8f81861e58692ce55d2f40c955ae68cf8bd9163a854cc9b4ad8830d09"} Jun 08 21:01:30.742905 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:30.742862 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 21:01:30.745482 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:30.745451 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f0742c-7c89-45cb-8300-90f5fd50b571-metrics-certs\") pod \"network-metrics-daemon-frhgs\" (UID: \"d5f0742c-7c89-45cb-8300-90f5fd50b571\") " pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 21:01:30.784579 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:30.784549 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9wp4t\"" Jun 08 21:01:30.792862 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:30.792825 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frhgs" Jun 08 21:01:30.929077 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:30.929046 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frhgs"] Jun 08 21:01:30.931687 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:01:30.931650 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f0742c_7c89_45cb_8300_90f5fd50b571.slice/crio-b54c402092cf03f3f769e95ba6f13041cec1cab07d20cf2175534bd4bc00e3e9 WatchSource:0}: Error finding container b54c402092cf03f3f769e95ba6f13041cec1cab07d20cf2175534bd4bc00e3e9: Status 404 returned error can't find the container with id b54c402092cf03f3f769e95ba6f13041cec1cab07d20cf2175534bd4bc00e3e9 Jun 08 21:01:30.933774 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:30.933754 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:01:31.140667 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:31.140623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frhgs" event={"ID":"d5f0742c-7c89-45cb-8300-90f5fd50b571","Type":"ContainerStarted","Data":"b54c402092cf03f3f769e95ba6f13041cec1cab07d20cf2175534bd4bc00e3e9"} Jun 08 21:01:32.146018 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:32.145982 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frhgs" event={"ID":"d5f0742c-7c89-45cb-8300-90f5fd50b571","Type":"ContainerStarted","Data":"7e3dba2383801d65f4c7162f724216b40adbdb0e13ba2600b707c186d20f92d6"} Jun 08 21:01:32.146445 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:32.146064 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frhgs" event={"ID":"d5f0742c-7c89-45cb-8300-90f5fd50b571","Type":"ContainerStarted","Data":"7d2d29582f1caea1f7bcab0f6157cd0c56ccc5c1b6a0f3d507cd661eeddd52a4"} Jun 08 21:01:32.164222 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:01:32.164159 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-frhgs" podStartSLOduration=374.345652053 podStartE2EDuration="6m15.164141002s" totalImagesPullingTime="818.488949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:01:32.162232589 +0000 UTC m=+375.926073919" watchObservedRunningTime="2026-06-08 21:01:32.164141002 +0000 UTC m=+375.927982371" Jun 08 21:03:30.863281 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.863243 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq"] Jun 08 21:03:30.863709 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.863560 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8807162-6d01-4a9c-997e-583d112379c8" containerName="registry" Jun 08 21:03:30.863709 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.863572 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8807162-6d01-4a9c-997e-583d112379c8" containerName="registry" Jun 08 21:03:30.863709 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.863638 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8807162-6d01-4a9c-997e-583d112379c8" containerName="registry" Jun 08 21:03:30.866526 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.866506 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:30.869501 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.869471 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-b2sxf\"" Jun 08 21:03:30.870812 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.870774 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 21:03:30.870812 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.870802 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 21:03:30.876428 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:30.876401 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq"] Jun 08 21:03:31.015693 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.015646 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30077b81-099c-43d9-a3ce-25a8c20226d8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9b2cq\" (UID: \"30077b81-099c-43d9-a3ce-25a8c20226d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.015885 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.015732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrx8w\" (UniqueName: \"kubernetes.io/projected/30077b81-099c-43d9-a3ce-25a8c20226d8-kube-api-access-zrx8w\") pod \"cert-manager-cainjector-5d99449ffd-9b2cq\" (UID: \"30077b81-099c-43d9-a3ce-25a8c20226d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.117039 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.116934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30077b81-099c-43d9-a3ce-25a8c20226d8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9b2cq\" (UID: \"30077b81-099c-43d9-a3ce-25a8c20226d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.117039 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.117016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrx8w\" (UniqueName: \"kubernetes.io/projected/30077b81-099c-43d9-a3ce-25a8c20226d8-kube-api-access-zrx8w\") pod \"cert-manager-cainjector-5d99449ffd-9b2cq\" (UID: \"30077b81-099c-43d9-a3ce-25a8c20226d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.126820 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.126787 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30077b81-099c-43d9-a3ce-25a8c20226d8-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9b2cq\" (UID: \"30077b81-099c-43d9-a3ce-25a8c20226d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.126990 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.126969 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrx8w\" (UniqueName: \"kubernetes.io/projected/30077b81-099c-43d9-a3ce-25a8c20226d8-kube-api-access-zrx8w\") pod \"cert-manager-cainjector-5d99449ffd-9b2cq\" (UID: \"30077b81-099c-43d9-a3ce-25a8c20226d8\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.183373 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.183324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" Jun 08 21:03:31.321424 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.321208 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq"] Jun 08 21:03:31.324413 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:03:31.324379 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30077b81_099c_43d9_a3ce_25a8c20226d8.slice/crio-54477f976e1df1cfcb06cbccf557a0fe9876172bf7bf208c1a07a24a8f13a335 WatchSource:0}: Error finding container 54477f976e1df1cfcb06cbccf557a0fe9876172bf7bf208c1a07a24a8f13a335: Status 404 returned error can't find the container with id 54477f976e1df1cfcb06cbccf557a0fe9876172bf7bf208c1a07a24a8f13a335 Jun 08 21:03:31.607427 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:31.607391 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" event={"ID":"30077b81-099c-43d9-a3ce-25a8c20226d8","Type":"ContainerStarted","Data":"54477f976e1df1cfcb06cbccf557a0fe9876172bf7bf208c1a07a24a8f13a335"} Jun 08 21:03:34.623347 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:34.623309 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" event={"ID":"30077b81-099c-43d9-a3ce-25a8c20226d8","Type":"ContainerStarted","Data":"b80447702f1d1e0ee2b647d2b5aff6428bd32b094441415f1f4ee8ff31f4ee59"} Jun 08 21:03:34.641520 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:34.641462 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9b2cq" podStartSLOduration=1.939020567 podStartE2EDuration="4.64144608s" totalImagesPullingTime="2.702425513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:03:34.639925248 +0000 UTC m=+498.403766577" watchObservedRunningTime="2026-06-08 21:03:34.64144608 +0000 UTC m=+498.405287407" Jun 08 21:03:43.449436 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.449394 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5"] Jun 08 21:03:43.452663 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.452641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.455519 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.455489 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 21:03:43.456738 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.456718 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:03:43.456853 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.456719 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r7bs4\"" Jun 08 21:03:43.461497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.461472 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5"] Jun 08 21:03:43.632716 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.632680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4c0b5d-993e-4586-8604-9d74356cd583-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9qz5\" (UID: \"cf4c0b5d-993e-4586-8604-9d74356cd583\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.632913 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.632749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmlp\" (UniqueName: \"kubernetes.io/projected/cf4c0b5d-993e-4586-8604-9d74356cd583-kube-api-access-txmlp\") pod \"openshift-lws-operator-fd8ccff4c-d9qz5\" (UID: \"cf4c0b5d-993e-4586-8604-9d74356cd583\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.733436 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.733342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txmlp\" (UniqueName: \"kubernetes.io/projected/cf4c0b5d-993e-4586-8604-9d74356cd583-kube-api-access-txmlp\") pod \"openshift-lws-operator-fd8ccff4c-d9qz5\" (UID: \"cf4c0b5d-993e-4586-8604-9d74356cd583\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.733436 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.733405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4c0b5d-993e-4586-8604-9d74356cd583-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9qz5\" (UID: \"cf4c0b5d-993e-4586-8604-9d74356cd583\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.733807 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.733792 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4c0b5d-993e-4586-8604-9d74356cd583-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9qz5\" (UID: \"cf4c0b5d-993e-4586-8604-9d74356cd583\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.742629 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.742599 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmlp\" (UniqueName: \"kubernetes.io/projected/cf4c0b5d-993e-4586-8604-9d74356cd583-kube-api-access-txmlp\") pod \"openshift-lws-operator-fd8ccff4c-d9qz5\" (UID: \"cf4c0b5d-993e-4586-8604-9d74356cd583\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.763061 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.763028 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" Jun 08 21:03:43.904279 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:43.904246 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5"] Jun 08 21:03:43.907910 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:03:43.907881 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf4c0b5d_993e_4586_8604_9d74356cd583.slice/crio-58abdde757067815c72b80642b05995e5ac4524a2f8d081c30ac47fbeef6d1ad WatchSource:0}: Error finding container 58abdde757067815c72b80642b05995e5ac4524a2f8d081c30ac47fbeef6d1ad: Status 404 returned error can't find the container with id 58abdde757067815c72b80642b05995e5ac4524a2f8d081c30ac47fbeef6d1ad Jun 08 21:03:44.666371 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:44.666282 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" event={"ID":"cf4c0b5d-993e-4586-8604-9d74356cd583","Type":"ContainerStarted","Data":"58abdde757067815c72b80642b05995e5ac4524a2f8d081c30ac47fbeef6d1ad"} Jun 08 21:03:46.676862 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:46.676763 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" event={"ID":"cf4c0b5d-993e-4586-8604-9d74356cd583","Type":"ContainerStarted","Data":"f9c552dfde3f9b2a39136ad98ac8afcb1bdce2eba5d28372050fb4b52eb9afd4"} Jun 08 21:03:46.694673 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:03:46.694614 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9qz5" podStartSLOduration=1.213212162 podStartE2EDuration="3.694597568s" totalImagesPullingTime="2.481385406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:03:46.693373368 +0000 UTC m=+510.457214696" watchObservedRunningTime="2026-06-08 21:03:46.694597568 +0000 UTC m=+510.458438896" Jun 08 21:04:02.242111 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.242064 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf"] Jun 08 21:04:02.252194 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.252159 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.255369 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.255339 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 21:04:02.255542 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.255411 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 21:04:02.255542 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.255488 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 21:04:02.255542 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.255500 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 21:04:02.255542 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.255505 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sq78f\"" Jun 08 21:04:02.261622 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.261587 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf"] Jun 08 21:04:02.273921 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.273882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78bc9911-4948-45b3-aae2-d5299aa15cb3-manifests\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.273921 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.273923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78bc9911-4948-45b3-aae2-d5299aa15cb3-tmp\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.274126 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.274002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlphg\" (UniqueName: \"kubernetes.io/projected/78bc9911-4948-45b3-aae2-d5299aa15cb3-kube-api-access-nlphg\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.274126 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.274050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78bc9911-4948-45b3-aae2-d5299aa15cb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.274126 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.274074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78bc9911-4948-45b3-aae2-d5299aa15cb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.374695 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.374650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78bc9911-4948-45b3-aae2-d5299aa15cb3-manifests\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.374695 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.374693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78bc9911-4948-45b3-aae2-d5299aa15cb3-tmp\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.374909 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.374738 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlphg\" (UniqueName: \"kubernetes.io/projected/78bc9911-4948-45b3-aae2-d5299aa15cb3-kube-api-access-nlphg\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.374909 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.374761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78bc9911-4948-45b3-aae2-d5299aa15cb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.374909 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.374780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78bc9911-4948-45b3-aae2-d5299aa15cb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.375143 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.375119 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78bc9911-4948-45b3-aae2-d5299aa15cb3-manifests\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.377526 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.377485 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78bc9911-4948-45b3-aae2-d5299aa15cb3-tmp\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.377693 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.377619 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78bc9911-4948-45b3-aae2-d5299aa15cb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.377762 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.377715 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78bc9911-4948-45b3-aae2-d5299aa15cb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.383708 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.383674 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlphg\" (UniqueName: \"kubernetes.io/projected/78bc9911-4948-45b3-aae2-d5299aa15cb3-kube-api-access-nlphg\") pod \"opendatahub-operator-controller-manager-666ff48864-6w7zf\" (UID: \"78bc9911-4948-45b3-aae2-d5299aa15cb3\") " pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.564176 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.564066 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:02.724821 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.724667 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf"] Jun 08 21:04:02.728112 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:02.728085 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bc9911_4948_45b3_aae2_d5299aa15cb3.slice/crio-d97c728bd9372730a722ab7a5b2b3f28a9e7ac3df3363c4c0f0a2239bf2e4539 WatchSource:0}: Error finding container d97c728bd9372730a722ab7a5b2b3f28a9e7ac3df3363c4c0f0a2239bf2e4539: Status 404 returned error can't find the container with id d97c728bd9372730a722ab7a5b2b3f28a9e7ac3df3363c4c0f0a2239bf2e4539 Jun 08 21:04:02.750445 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:02.750399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" event={"ID":"78bc9911-4948-45b3-aae2-d5299aa15cb3","Type":"ContainerStarted","Data":"d97c728bd9372730a722ab7a5b2b3f28a9e7ac3df3363c4c0f0a2239bf2e4539"} Jun 08 21:04:06.771688 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:06.771650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" event={"ID":"78bc9911-4948-45b3-aae2-d5299aa15cb3","Type":"ContainerStarted","Data":"139998ab53705d54a30a656fe4edd9d44d250a0ea8a42c5c0df1e72efa86d22a"} Jun 08 21:04:07.777946 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:07.777908 2554 generic.go:356] "Generic (PLEG): container finished" podID="78bc9911-4948-45b3-aae2-d5299aa15cb3" containerID="139998ab53705d54a30a656fe4edd9d44d250a0ea8a42c5c0df1e72efa86d22a" exitCode=0 Jun 08 21:04:07.778399 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:07.777950 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" event={"ID":"78bc9911-4948-45b3-aae2-d5299aa15cb3","Type":"ContainerDied","Data":"139998ab53705d54a30a656fe4edd9d44d250a0ea8a42c5c0df1e72efa86d22a"} Jun 08 21:04:08.786552 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:08.786510 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" event={"ID":"78bc9911-4948-45b3-aae2-d5299aa15cb3","Type":"ContainerStarted","Data":"0049b9baca40083ec225dc22e99431bfc6a9fe01da4026c968d125a0097e7ea5"} Jun 08 21:04:08.786930 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:08.786579 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:19.793061 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:19.793027 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" Jun 08 21:04:19.817315 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:19.817237 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-666ff48864-6w7zf" podStartSLOduration=13.268202115 podStartE2EDuration="17.817213584s" totalImagesPullingTime="3.549147305s" totalInitContainerRuntime="999.864164ms" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:08.81368663 +0000 UTC m=+532.577527958" watchObservedRunningTime="2026-06-08 21:04:19.817213584 +0000 UTC m=+543.581054914" Jun 08 21:04:22.308271 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.308230 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj"] Jun 08 21:04:22.316955 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.316925 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.320065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.320033 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 21:04:22.320065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.320056 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 21:04:22.326738 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.326704 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj"] Jun 08 21:04:22.371578 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.371538 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qczjs"] Jun 08 21:04:22.375146 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.375125 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:22.378190 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.378161 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 21:04:22.378363 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.378221 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jrt8v\"" Jun 08 21:04:22.385571 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.385542 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qczjs"] Jun 08 21:04:22.456629 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.456585 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba820239-599b-4a21-b026-ea4850224c72-tmp\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.456629 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.456627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-cert\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:22.456900 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.456707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkfw\" (UniqueName: \"kubernetes.io/projected/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-kube-api-access-lwkfw\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:22.456900 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.456804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba820239-599b-4a21-b026-ea4850224c72-tls-certs\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.456900 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.456845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwk7b\" (UniqueName: \"kubernetes.io/projected/ba820239-599b-4a21-b026-ea4850224c72-kube-api-access-fwk7b\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.557988 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.557945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwk7b\" (UniqueName: \"kubernetes.io/projected/ba820239-599b-4a21-b026-ea4850224c72-kube-api-access-fwk7b\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.557988 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.557991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba820239-599b-4a21-b026-ea4850224c72-tmp\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.558236 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.558017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-cert\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:22.558236 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.558046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkfw\" (UniqueName: \"kubernetes.io/projected/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-kube-api-access-lwkfw\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:22.558236 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.558089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba820239-599b-4a21-b026-ea4850224c72-tls-certs\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.558236 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:04:22.558132 2554 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 21:04:22.558236 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:04:22.558207 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-cert podName:66999ecc-ff23-4d6c-9e42-e6ae16aeb864 nodeName:}" failed. No retries permitted until 2026-06-08 21:04:23.058188058 +0000 UTC m=+546.822029369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-cert") pod "odh-model-controller-6dc94f689f-qczjs" (UID: "66999ecc-ff23-4d6c-9e42-e6ae16aeb864") : secret "odh-model-controller-webhook-cert" not found Jun 08 21:04:22.560824 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.560736 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba820239-599b-4a21-b026-ea4850224c72-tmp\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.560958 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.560907 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba820239-599b-4a21-b026-ea4850224c72-tls-certs\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.568460 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.568430 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwk7b\" (UniqueName: \"kubernetes.io/projected/ba820239-599b-4a21-b026-ea4850224c72-kube-api-access-fwk7b\") pod \"kube-auth-proxy-df9d9cc9-n5krj\" (UID: \"ba820239-599b-4a21-b026-ea4850224c72\") " pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.568600 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.568516 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkfw\" (UniqueName: \"kubernetes.io/projected/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-kube-api-access-lwkfw\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:22.628212 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.628173 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" Jun 08 21:04:22.778714 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.778672 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj"] Jun 08 21:04:22.783891 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:22.783855 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba820239_599b_4a21_b026_ea4850224c72.slice/crio-99ecaa5a7bd8901aa6abc0bb54ba296857c3745ba2d6e29b1d0f2ed4914ce47b WatchSource:0}: Error finding container 99ecaa5a7bd8901aa6abc0bb54ba296857c3745ba2d6e29b1d0f2ed4914ce47b: Status 404 returned error can't find the container with id 99ecaa5a7bd8901aa6abc0bb54ba296857c3745ba2d6e29b1d0f2ed4914ce47b Jun 08 21:04:22.850281 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:22.850231 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" event={"ID":"ba820239-599b-4a21-b026-ea4850224c72","Type":"ContainerStarted","Data":"99ecaa5a7bd8901aa6abc0bb54ba296857c3745ba2d6e29b1d0f2ed4914ce47b"} Jun 08 21:04:23.061903 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.061863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-cert\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:23.064568 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.064542 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66999ecc-ff23-4d6c-9e42-e6ae16aeb864-cert\") pod \"odh-model-controller-6dc94f689f-qczjs\" (UID: \"66999ecc-ff23-4d6c-9e42-e6ae16aeb864\") " pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:23.232661 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.232575 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-kvbwq"] Jun 08 21:04:23.237366 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.237342 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.241264 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.241237 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 21:04:23.258439 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.258405 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-kvbwq"] Jun 08 21:04:23.287875 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.287836 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:23.365187 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.365155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqj9t\" (UniqueName: \"kubernetes.io/projected/c1885044-35d7-4fd0-bc79-66b08a611f9e-kube-api-access-nqj9t\") pod \"model-serving-api-5dd488fc48-kvbwq\" (UID: \"c1885044-35d7-4fd0-bc79-66b08a611f9e\") " pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.365187 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.365190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1885044-35d7-4fd0-bc79-66b08a611f9e-tls-certs\") pod \"model-serving-api-5dd488fc48-kvbwq\" (UID: \"c1885044-35d7-4fd0-bc79-66b08a611f9e\") " pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.436847 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.436669 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qczjs"] Jun 08 21:04:23.439999 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:23.439961 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66999ecc_ff23_4d6c_9e42_e6ae16aeb864.slice/crio-0759bd16e2be27781ebb5ddeb010ca2ea50c61852616f42a50c87dc4463f8d90 WatchSource:0}: Error finding container 0759bd16e2be27781ebb5ddeb010ca2ea50c61852616f42a50c87dc4463f8d90: Status 404 returned error can't find the container with id 0759bd16e2be27781ebb5ddeb010ca2ea50c61852616f42a50c87dc4463f8d90 Jun 08 21:04:23.466589 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.466551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqj9t\" (UniqueName: \"kubernetes.io/projected/c1885044-35d7-4fd0-bc79-66b08a611f9e-kube-api-access-nqj9t\") pod \"model-serving-api-5dd488fc48-kvbwq\" (UID: \"c1885044-35d7-4fd0-bc79-66b08a611f9e\") " pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.466784 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.466602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1885044-35d7-4fd0-bc79-66b08a611f9e-tls-certs\") pod \"model-serving-api-5dd488fc48-kvbwq\" (UID: \"c1885044-35d7-4fd0-bc79-66b08a611f9e\") " pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.469766 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.469732 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1885044-35d7-4fd0-bc79-66b08a611f9e-tls-certs\") pod \"model-serving-api-5dd488fc48-kvbwq\" (UID: \"c1885044-35d7-4fd0-bc79-66b08a611f9e\") " pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.477013 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.476944 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqj9t\" (UniqueName: \"kubernetes.io/projected/c1885044-35d7-4fd0-bc79-66b08a611f9e-kube-api-access-nqj9t\") pod \"model-serving-api-5dd488fc48-kvbwq\" (UID: \"c1885044-35d7-4fd0-bc79-66b08a611f9e\") " pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.548115 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.548022 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:23.723364 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.723330 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-kvbwq"] Jun 08 21:04:23.726090 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:23.726044 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1885044_35d7_4fd0_bc79_66b08a611f9e.slice/crio-0ff135cb46f609ae85c3a3d934762a86c2742bb22465603785f205bbf37a1d88 WatchSource:0}: Error finding container 0ff135cb46f609ae85c3a3d934762a86c2742bb22465603785f205bbf37a1d88: Status 404 returned error can't find the container with id 0ff135cb46f609ae85c3a3d934762a86c2742bb22465603785f205bbf37a1d88 Jun 08 21:04:23.858691 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.858648 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" event={"ID":"c1885044-35d7-4fd0-bc79-66b08a611f9e","Type":"ContainerStarted","Data":"0ff135cb46f609ae85c3a3d934762a86c2742bb22465603785f205bbf37a1d88"} Jun 08 21:04:23.860259 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:23.860214 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" event={"ID":"66999ecc-ff23-4d6c-9e42-e6ae16aeb864","Type":"ContainerStarted","Data":"0759bd16e2be27781ebb5ddeb010ca2ea50c61852616f42a50c87dc4463f8d90"} Jun 08 21:04:28.891815 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.891776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" event={"ID":"66999ecc-ff23-4d6c-9e42-e6ae16aeb864","Type":"ContainerStarted","Data":"57a4396221ac5dd2aa85a8350f3d1d3882fe3c22c76c5ab115e472689609a466"} Jun 08 21:04:28.892281 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.891949 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:28.893406 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.893367 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" event={"ID":"ba820239-599b-4a21-b026-ea4850224c72","Type":"ContainerStarted","Data":"748d1ebce1dc6608e0d219e04aca2bdd116e52bbd522f0df75e56389494849e3"} Jun 08 21:04:28.894908 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.894882 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" event={"ID":"c1885044-35d7-4fd0-bc79-66b08a611f9e","Type":"ContainerStarted","Data":"4f5980b6b34ece90677d801032f6fb04efdc733c240219ad432b6c131d8a9487"} Jun 08 21:04:28.895042 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.895030 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:28.925166 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.925103 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" podStartSLOduration=2.418019046 podStartE2EDuration="6.925083401s" totalImagesPullingTime="4.507064355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:28.923737651 +0000 UTC m=+552.687578991" watchObservedRunningTime="2026-06-08 21:04:28.925083401 +0000 UTC m=+552.688924730" Jun 08 21:04:28.954333 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.954262 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" podStartSLOduration=1.7403629710000001 podStartE2EDuration="5.954245629s" totalImagesPullingTime="4.213882658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:28.952743679 +0000 UTC m=+552.716585007" watchObservedRunningTime="2026-06-08 21:04:28.954245629 +0000 UTC m=+552.718086958" Jun 08 21:04:28.987234 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:28.987182 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-df9d9cc9-n5krj" podStartSLOduration=1.839536473 podStartE2EDuration="6.987165463s" totalImagesPullingTime="5.14762899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:28.985419785 +0000 UTC m=+552.749261114" watchObservedRunningTime="2026-06-08 21:04:28.987165463 +0000 UTC m=+552.751006815" Jun 08 21:04:32.452943 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.452900 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-k898d"] Jun 08 21:04:32.456575 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.456553 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.462110 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.462083 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-787tp\"" Jun 08 21:04:32.462289 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.462123 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 08 21:04:32.481037 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.480998 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9"] Jun 08 21:04:32.484407 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.484380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.487644 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.487617 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9ntlh\"" Jun 08 21:04:32.488258 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.488242 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 08 21:04:32.493702 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.493672 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-k898d"] Jun 08 21:04:32.521337 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.521284 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9"] Jun 08 21:04:32.549954 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.549906 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59e6622-8f20-4158-bafd-2f0ba9dbc5a1-cert\") pod \"kserve-controller-manager-69fc866d76-k898d\" (UID: \"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.549954 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.549957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586ct\" (UniqueName: \"kubernetes.io/projected/b59e6622-8f20-4158-bafd-2f0ba9dbc5a1-kube-api-access-586ct\") pod \"kserve-controller-manager-69fc866d76-k898d\" (UID: \"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.650929 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.650889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59e6622-8f20-4158-bafd-2f0ba9dbc5a1-cert\") pod \"kserve-controller-manager-69fc866d76-k898d\" (UID: \"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.651118 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.650953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snc5m\" (UniqueName: \"kubernetes.io/projected/64c3e3fc-9d59-4e1a-99ec-65515ae01f5c-kube-api-access-snc5m\") pod \"llmisvc-controller-manager-864bfd7bc9-4q8j9\" (UID: \"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.651118 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.650987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586ct\" (UniqueName: \"kubernetes.io/projected/b59e6622-8f20-4158-bafd-2f0ba9dbc5a1-kube-api-access-586ct\") pod \"kserve-controller-manager-69fc866d76-k898d\" (UID: \"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.651118 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.651032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64c3e3fc-9d59-4e1a-99ec-65515ae01f5c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4q8j9\" (UID: \"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.653743 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.653714 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b59e6622-8f20-4158-bafd-2f0ba9dbc5a1-cert\") pod \"kserve-controller-manager-69fc866d76-k898d\" (UID: \"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.669692 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.669650 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586ct\" (UniqueName: \"kubernetes.io/projected/b59e6622-8f20-4158-bafd-2f0ba9dbc5a1-kube-api-access-586ct\") pod \"kserve-controller-manager-69fc866d76-k898d\" (UID: \"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.752438 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.752289 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snc5m\" (UniqueName: \"kubernetes.io/projected/64c3e3fc-9d59-4e1a-99ec-65515ae01f5c-kube-api-access-snc5m\") pod \"llmisvc-controller-manager-864bfd7bc9-4q8j9\" (UID: \"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.752438 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.752409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64c3e3fc-9d59-4e1a-99ec-65515ae01f5c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4q8j9\" (UID: \"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.755140 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.755117 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64c3e3fc-9d59-4e1a-99ec-65515ae01f5c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-4q8j9\" (UID: \"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.763892 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.763858 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snc5m\" (UniqueName: \"kubernetes.io/projected/64c3e3fc-9d59-4e1a-99ec-65515ae01f5c-kube-api-access-snc5m\") pod \"llmisvc-controller-manager-864bfd7bc9-4q8j9\" (UID: \"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.768697 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.768670 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:32.796635 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.796603 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:32.945235 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.945203 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-k898d"] Jun 08 21:04:32.947797 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:32.947755 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59e6622_8f20_4158_bafd_2f0ba9dbc5a1.slice/crio-0a0bd3cca2a2e7e23793db228eb46c74ae5cfccc30316d1151031d37bdb9551d WatchSource:0}: Error finding container 0a0bd3cca2a2e7e23793db228eb46c74ae5cfccc30316d1151031d37bdb9551d: Status 404 returned error can't find the container with id 0a0bd3cca2a2e7e23793db228eb46c74ae5cfccc30316d1151031d37bdb9551d Jun 08 21:04:32.969778 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:32.969752 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9"] Jun 08 21:04:32.971848 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:32.971822 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod64c3e3fc_9d59_4e1a_99ec_65515ae01f5c.slice/crio-a6e8e7f6ad9800bc08328628f09dea3aaa715fc1c6872dd94100f51413ceb739 WatchSource:0}: Error finding container a6e8e7f6ad9800bc08328628f09dea3aaa715fc1c6872dd94100f51413ceb739: Status 404 returned error can't find the container with id a6e8e7f6ad9800bc08328628f09dea3aaa715fc1c6872dd94100f51413ceb739 Jun 08 21:04:33.921658 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:33.921618 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" event={"ID":"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1","Type":"ContainerStarted","Data":"0a0bd3cca2a2e7e23793db228eb46c74ae5cfccc30316d1151031d37bdb9551d"} Jun 08 21:04:33.923328 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:33.923271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" event={"ID":"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c","Type":"ContainerStarted","Data":"a6e8e7f6ad9800bc08328628f09dea3aaa715fc1c6872dd94100f51413ceb739"} Jun 08 21:04:36.939743 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:36.939687 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" event={"ID":"b59e6622-8f20-4158-bafd-2f0ba9dbc5a1","Type":"ContainerStarted","Data":"6b641d97577fa1731cc47e328855bca1fe05f7a3304f1fbdb6ff6d24503a9c34"} Jun 08 21:04:36.940122 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:36.939760 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:04:36.990679 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:36.990616 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" podStartSLOduration=1.122962549 podStartE2EDuration="4.990587367s" totalImagesPullingTime="3.867624818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:36.989753059 +0000 UTC m=+560.753594389" watchObservedRunningTime="2026-06-08 21:04:36.990587367 +0000 UTC m=+560.754428700" Jun 08 21:04:37.947533 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:37.947490 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" event={"ID":"64c3e3fc-9d59-4e1a-99ec-65515ae01f5c","Type":"ContainerStarted","Data":"8dc039746f5d4792f0d89b11df502cb074717092936eb1b1001f27188e59d387"} Jun 08 21:04:37.948017 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:37.947575 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:04:37.998003 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:37.997941 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" podStartSLOduration=2.152320174 podStartE2EDuration="5.99792281s" totalImagesPullingTime="3.845602636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:37.995644534 +0000 UTC m=+561.759485863" watchObservedRunningTime="2026-06-08 21:04:37.99792281 +0000 UTC m=+561.761764163" Jun 08 21:04:39.288377 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.288329 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t"] Jun 08 21:04:39.290654 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.290635 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.293502 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.293476 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 08 21:04:39.293654 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.293480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4sq7g\"" Jun 08 21:04:39.293654 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.293479 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 08 21:04:39.308720 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.308686 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t"] Jun 08 21:04:39.420520 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.420481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/686da22e-f6cc-46ad-b916-c896a865fda2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-j8r7t\" (UID: \"686da22e-f6cc-46ad-b916-c896a865fda2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.420724 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.420558 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknfr\" (UniqueName: \"kubernetes.io/projected/686da22e-f6cc-46ad-b916-c896a865fda2-kube-api-access-dknfr\") pod \"servicemesh-operator3-57f65f65fb-j8r7t\" (UID: \"686da22e-f6cc-46ad-b916-c896a865fda2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.521838 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.521794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/686da22e-f6cc-46ad-b916-c896a865fda2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-j8r7t\" (UID: \"686da22e-f6cc-46ad-b916-c896a865fda2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.522036 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.521872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknfr\" (UniqueName: \"kubernetes.io/projected/686da22e-f6cc-46ad-b916-c896a865fda2-kube-api-access-dknfr\") pod \"servicemesh-operator3-57f65f65fb-j8r7t\" (UID: \"686da22e-f6cc-46ad-b916-c896a865fda2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.524722 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.524690 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/686da22e-f6cc-46ad-b916-c896a865fda2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-j8r7t\" (UID: \"686da22e-f6cc-46ad-b916-c896a865fda2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.533466 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.533437 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknfr\" (UniqueName: \"kubernetes.io/projected/686da22e-f6cc-46ad-b916-c896a865fda2-kube-api-access-dknfr\") pod \"servicemesh-operator3-57f65f65fb-j8r7t\" (UID: \"686da22e-f6cc-46ad-b916-c896a865fda2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.601233 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.601187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:39.806490 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.806457 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t"] Jun 08 21:04:39.807519 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:39.807493 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686da22e_f6cc_46ad_b916_c896a865fda2.slice/crio-acbe30d2131cffafd0c25019e3db7f24628947e7a5dd183f4963092e6406a71f WatchSource:0}: Error finding container acbe30d2131cffafd0c25019e3db7f24628947e7a5dd183f4963092e6406a71f: Status 404 returned error can't find the container with id acbe30d2131cffafd0c25019e3db7f24628947e7a5dd183f4963092e6406a71f Jun 08 21:04:39.902063 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.901967 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-qczjs" Jun 08 21:04:39.904601 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.904562 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-kvbwq" Jun 08 21:04:39.958551 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:39.958511 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" event={"ID":"686da22e-f6cc-46ad-b916-c896a865fda2","Type":"ContainerStarted","Data":"acbe30d2131cffafd0c25019e3db7f24628947e7a5dd183f4963092e6406a71f"} Jun 08 21:04:40.234507 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.234398 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-58849dbc9d-tlzvp"] Jun 08 21:04:40.237539 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.237510 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.242009 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.241976 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vbqnz\"" Jun 08 21:04:40.242185 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.242058 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 21:04:40.257452 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.257417 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-58849dbc9d-tlzvp"] Jun 08 21:04:40.330227 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.330192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frsjb\" (UniqueName: \"kubernetes.io/projected/e9310295-8b1c-4a22-8165-11d9ba1ba08f-kube-api-access-frsjb\") pod \"dashboard-redirect-58849dbc9d-tlzvp\" (UID: \"e9310295-8b1c-4a22-8165-11d9ba1ba08f\") " pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.330726 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.330239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e9310295-8b1c-4a22-8165-11d9ba1ba08f-redirect-config\") pod \"dashboard-redirect-58849dbc9d-tlzvp\" (UID: \"e9310295-8b1c-4a22-8165-11d9ba1ba08f\") " pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.430928 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.430885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e9310295-8b1c-4a22-8165-11d9ba1ba08f-redirect-config\") pod \"dashboard-redirect-58849dbc9d-tlzvp\" (UID: \"e9310295-8b1c-4a22-8165-11d9ba1ba08f\") " pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.431154 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.431134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frsjb\" (UniqueName: \"kubernetes.io/projected/e9310295-8b1c-4a22-8165-11d9ba1ba08f-kube-api-access-frsjb\") pod \"dashboard-redirect-58849dbc9d-tlzvp\" (UID: \"e9310295-8b1c-4a22-8165-11d9ba1ba08f\") " pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.431980 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.431957 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e9310295-8b1c-4a22-8165-11d9ba1ba08f-redirect-config\") pod \"dashboard-redirect-58849dbc9d-tlzvp\" (UID: \"e9310295-8b1c-4a22-8165-11d9ba1ba08f\") " pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.456436 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.456404 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frsjb\" (UniqueName: \"kubernetes.io/projected/e9310295-8b1c-4a22-8165-11d9ba1ba08f-kube-api-access-frsjb\") pod \"dashboard-redirect-58849dbc9d-tlzvp\" (UID: \"e9310295-8b1c-4a22-8165-11d9ba1ba08f\") " pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.548590 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.548495 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" Jun 08 21:04:40.738602 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.738559 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-58849dbc9d-tlzvp"] Jun 08 21:04:40.871864 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:04:40.871815 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9310295_8b1c_4a22_8165_11d9ba1ba08f.slice/crio-092f4786620e301f5369a21482be7a981571e478c6d0ec511b756d800dae7931 WatchSource:0}: Error finding container 092f4786620e301f5369a21482be7a981571e478c6d0ec511b756d800dae7931: Status 404 returned error can't find the container with id 092f4786620e301f5369a21482be7a981571e478c6d0ec511b756d800dae7931 Jun 08 21:04:40.964978 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:40.964933 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" event={"ID":"e9310295-8b1c-4a22-8165-11d9ba1ba08f","Type":"ContainerStarted","Data":"092f4786620e301f5369a21482be7a981571e478c6d0ec511b756d800dae7931"} Jun 08 21:04:43.985271 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:43.985174 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" event={"ID":"e9310295-8b1c-4a22-8165-11d9ba1ba08f","Type":"ContainerStarted","Data":"7ace79cc750639aaa536c725143b3668bbd02188ccca3021b715804a02adb9f9"} Jun 08 21:04:43.987900 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:43.987863 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" event={"ID":"686da22e-f6cc-46ad-b916-c896a865fda2","Type":"ContainerStarted","Data":"954e951859144ca0d30f54c792f16da9a8e7c79c2be0841f11d979f1e6b2134d"} Jun 08 21:04:43.988069 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:43.988036 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:04:44.048137 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:44.048068 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" podStartSLOduration=1.2614127370000001 podStartE2EDuration="5.048044262s" totalImagesPullingTime="3.786631525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:44.045115466 +0000 UTC m=+567.808956793" watchObservedRunningTime="2026-06-08 21:04:44.048044262 +0000 UTC m=+567.811885594" Jun 08 21:04:44.048391 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:44.048341 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-58849dbc9d-tlzvp" podStartSLOduration=1.268829749 podStartE2EDuration="4.048330152s" totalImagesPullingTime="2.779500403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:04:44.013474645 +0000 UTC m=+567.777316002" watchObservedRunningTime="2026-06-08 21:04:44.048330152 +0000 UTC m=+567.812171480" Jun 08 21:04:54.995384 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:04:54.995353 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j8r7t" Jun 08 21:05:07.953699 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:07.953664 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-k898d" Jun 08 21:05:08.716553 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.716515 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z"] Jun 08 21:05:08.722924 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.722894 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.732855 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.732827 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 08 21:05:08.733004 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.732931 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 08 21:05:08.733004 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.732955 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 21:05:08.733004 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.732932 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 08 21:05:08.733172 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.733156 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cksbw\"" Jun 08 21:05:08.742666 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.742635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z"] Jun 08 21:05:08.766821 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.766783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.766821 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.766834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qck\" (UniqueName: \"kubernetes.io/projected/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-kube-api-access-m9qck\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.767065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.766856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.767065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.766939 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.767065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.766963 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.767065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.766990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.767065 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.767007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.867944 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.867901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.867944 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.867948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qck\" (UniqueName: \"kubernetes.io/projected/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-kube-api-access-m9qck\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.868174 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.868068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.868174 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.868128 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.868174 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.868157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.868338 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.868199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.868338 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.868247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.869026 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.868915 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.870827 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.870796 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.871005 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.870988 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.871132 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.871109 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.871178 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.871164 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.877431 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.877400 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.877994 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.877973 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qck\" (UniqueName: \"kubernetes.io/projected/0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71-kube-api-access-m9qck\") pod \"istiod-openshift-gateway-75c67f8887-4zj8z\" (UID: \"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:08.953599 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:08.953569 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-4q8j9" Jun 08 21:05:09.032325 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:09.032207 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:09.188283 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:09.188258 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z"] Jun 08 21:05:09.191412 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:05:09.191382 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bffd5aa_cd5b_4bea_a12c_60eb9f0eee71.slice/crio-10a3ed0b6d6c916d52fe3bf465ec3c94bf639e4fcd08c2ef892a8c718b5cacc5 WatchSource:0}: Error finding container 10a3ed0b6d6c916d52fe3bf465ec3c94bf639e4fcd08c2ef892a8c718b5cacc5: Status 404 returned error can't find the container with id 10a3ed0b6d6c916d52fe3bf465ec3c94bf639e4fcd08c2ef892a8c718b5cacc5 Jun 08 21:05:10.122389 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:10.122346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" event={"ID":"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71","Type":"ContainerStarted","Data":"10a3ed0b6d6c916d52fe3bf465ec3c94bf639e4fcd08c2ef892a8c718b5cacc5"} Jun 08 21:05:11.624312 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:11.624257 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 08 21:05:11.624677 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:11.624395 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 08 21:05:12.134902 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:12.134860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" event={"ID":"0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71","Type":"ContainerStarted","Data":"e503644597bdf1f297fbfc12f4715e939443af2bd69e27d3fbad9eae02ea4606"} Jun 08 21:05:12.135093 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:12.135059 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:12.136917 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:12.136881 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-4zj8z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 08 21:05:12.137074 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:12.136942 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" podUID="0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 21:05:12.156679 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:12.156623 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" podStartSLOduration=1.726144491 podStartE2EDuration="4.156603964s" totalImagesPullingTime="2.430459473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:05:12.156419627 +0000 UTC m=+595.920260954" watchObservedRunningTime="2026-06-08 21:05:12.156603964 +0000 UTC m=+595.920445292" Jun 08 21:05:13.141654 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:13.141624 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4zj8z" Jun 08 21:05:58.730903 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.730866 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-prcrj"] Jun 08 21:05:58.736513 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.736485 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:05:58.739634 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.739608 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z2fw4\"" Jun 08 21:05:58.740919 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.740896 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 21:05:58.741049 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.740896 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 21:05:58.746497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.746473 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-prcrj"] Jun 08 21:05:58.826247 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.826104 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q262f\" (UniqueName: \"kubernetes.io/projected/f381d149-a98d-424f-852f-b86ff8d9a111-kube-api-access-q262f\") pod \"authorino-operator-75cc8d5cb7-prcrj\" (UID: \"f381d149-a98d-424f-852f-b86ff8d9a111\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:05:58.927734 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.927683 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q262f\" (UniqueName: \"kubernetes.io/projected/f381d149-a98d-424f-852f-b86ff8d9a111-kube-api-access-q262f\") pod \"authorino-operator-75cc8d5cb7-prcrj\" (UID: \"f381d149-a98d-424f-852f-b86ff8d9a111\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:05:58.943376 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:58.943343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q262f\" (UniqueName: \"kubernetes.io/projected/f381d149-a98d-424f-852f-b86ff8d9a111-kube-api-access-q262f\") pod \"authorino-operator-75cc8d5cb7-prcrj\" (UID: \"f381d149-a98d-424f-852f-b86ff8d9a111\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:05:59.049119 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:59.049024 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:05:59.209513 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:59.209477 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-prcrj"] Jun 08 21:05:59.213107 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:05:59.213073 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf381d149_a98d_424f_852f_b86ff8d9a111.slice/crio-801fbb730f226ffe1755fe1cd6250cbdf604f2cbfc1bfcd30796b019cf6a9fe3 WatchSource:0}: Error finding container 801fbb730f226ffe1755fe1cd6250cbdf604f2cbfc1bfcd30796b019cf6a9fe3: Status 404 returned error can't find the container with id 801fbb730f226ffe1755fe1cd6250cbdf604f2cbfc1bfcd30796b019cf6a9fe3 Jun 08 21:05:59.370641 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:05:59.370601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" event={"ID":"f381d149-a98d-424f-852f-b86ff8d9a111","Type":"ContainerStarted","Data":"801fbb730f226ffe1755fe1cd6250cbdf604f2cbfc1bfcd30796b019cf6a9fe3"} Jun 08 21:06:02.389790 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:02.389745 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" event={"ID":"f381d149-a98d-424f-852f-b86ff8d9a111","Type":"ContainerStarted","Data":"350adc28c4ac91e713a9b549772db05e892f78b7e64becb0c78f47412dab6c0e"} Jun 08 21:06:02.390271 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:02.389872 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:06:02.416534 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:02.416471 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" podStartSLOduration=1.631761537 podStartE2EDuration="4.416453207s" totalImagesPullingTime="2.78469167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:06:02.414452015 +0000 UTC m=+646.178293342" watchObservedRunningTime="2026-06-08 21:06:02.416453207 +0000 UTC m=+646.180294536" Jun 08 21:06:13.397131 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:13.397099 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-prcrj" Jun 08 21:06:51.819314 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.819262 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:06:51.821829 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.821804 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:51.824684 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.824654 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vxm9t\"" Jun 08 21:06:51.824855 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.824696 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 21:06:51.832098 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.832068 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:06:51.850285 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.850241 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:06:51.929534 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.929490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4rv\" (UniqueName: \"kubernetes.io/projected/a863062b-92bc-4f21-996c-845e0642a897-kube-api-access-fc4rv\") pod \"limitador-limitador-54d6d988d5-hd6q8\" (UID: \"a863062b-92bc-4f21-996c-845e0642a897\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:51.929738 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:51.929565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a863062b-92bc-4f21-996c-845e0642a897-config-file\") pod \"limitador-limitador-54d6d988d5-hd6q8\" (UID: \"a863062b-92bc-4f21-996c-845e0642a897\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:52.030702 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.030666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a863062b-92bc-4f21-996c-845e0642a897-config-file\") pod \"limitador-limitador-54d6d988d5-hd6q8\" (UID: \"a863062b-92bc-4f21-996c-845e0642a897\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:52.030910 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.030737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4rv\" (UniqueName: \"kubernetes.io/projected/a863062b-92bc-4f21-996c-845e0642a897-kube-api-access-fc4rv\") pod \"limitador-limitador-54d6d988d5-hd6q8\" (UID: \"a863062b-92bc-4f21-996c-845e0642a897\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:52.031413 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.031388 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a863062b-92bc-4f21-996c-845e0642a897-config-file\") pod \"limitador-limitador-54d6d988d5-hd6q8\" (UID: \"a863062b-92bc-4f21-996c-845e0642a897\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:52.042171 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.042129 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4rv\" (UniqueName: \"kubernetes.io/projected/a863062b-92bc-4f21-996c-845e0642a897-kube-api-access-fc4rv\") pod \"limitador-limitador-54d6d988d5-hd6q8\" (UID: \"a863062b-92bc-4f21-996c-845e0642a897\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:52.134384 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.134349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:52.284460 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.284413 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:06:52.286720 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:06:52.286685 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda863062b_92bc_4f21_996c_845e0642a897.slice/crio-596aa0c76214647462c3f6bd87cd64cf89a5e4c799bd0d1cd86ffc9ebdccf3b7 WatchSource:0}: Error finding container 596aa0c76214647462c3f6bd87cd64cf89a5e4c799bd0d1cd86ffc9ebdccf3b7: Status 404 returned error can't find the container with id 596aa0c76214647462c3f6bd87cd64cf89a5e4c799bd0d1cd86ffc9ebdccf3b7 Jun 08 21:06:52.288603 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.288584 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:06:52.640693 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:52.640660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" event={"ID":"a863062b-92bc-4f21-996c-845e0642a897","Type":"ContainerStarted","Data":"596aa0c76214647462c3f6bd87cd64cf89a5e4c799bd0d1cd86ffc9ebdccf3b7"} Jun 08 21:06:55.662497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:55.662459 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" event={"ID":"a863062b-92bc-4f21-996c-845e0642a897","Type":"ContainerStarted","Data":"758d2e6a5cf87a69bc6a9d50f52249bdea29549be54f6d4b8958c641de45bf06"} Jun 08 21:06:55.662911 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:55.662573 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:06:55.692644 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:06:55.692580 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" podStartSLOduration=2.244256416 podStartE2EDuration="4.692563477s" totalImagesPullingTime="2.448307061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:06:55.690435632 +0000 UTC m=+699.454276959" watchObservedRunningTime="2026-06-08 21:06:55.692563477 +0000 UTC m=+699.456404805" Jun 08 21:07:06.669150 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:07:06.669063 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hd6q8" Jun 08 21:08:24.472992 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.472947 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c766b78f4-z6tlk"] Jun 08 21:08:24.476767 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.476743 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:24.479882 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.479858 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 21:08:24.480048 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.479859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5jh7g\"" Jun 08 21:08:24.480048 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.479859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 21:08:24.487420 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.487384 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c766b78f4-z6tlk"] Jun 08 21:08:24.562122 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.562079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/079eb374-97a7-487f-82c2-e1caa3824ef3-webhook-cert\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:24.562333 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.562146 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppkf\" (UniqueName: \"kubernetes.io/projected/079eb374-97a7-487f-82c2-e1caa3824ef3-kube-api-access-sppkf\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:24.663392 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.663355 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/079eb374-97a7-487f-82c2-e1caa3824ef3-webhook-cert\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:24.663560 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.663444 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sppkf\" (UniqueName: \"kubernetes.io/projected/079eb374-97a7-487f-82c2-e1caa3824ef3-kube-api-access-sppkf\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:24.663560 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:08:24.663522 2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 08 21:08:24.663629 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:08:24.663600 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/079eb374-97a7-487f-82c2-e1caa3824ef3-webhook-cert podName:079eb374-97a7-487f-82c2-e1caa3824ef3 nodeName:}" failed. No retries permitted until 2026-06-08 21:08:25.16358132 +0000 UTC m=+788.927422631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/079eb374-97a7-487f-82c2-e1caa3824ef3-webhook-cert") pod "maas-controller-7c766b78f4-z6tlk" (UID: "079eb374-97a7-487f-82c2-e1caa3824ef3") : secret "maas-controller-webhook-cert" not found Jun 08 21:08:24.672768 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:24.672733 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppkf\" (UniqueName: \"kubernetes.io/projected/079eb374-97a7-487f-82c2-e1caa3824ef3-kube-api-access-sppkf\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:25.167611 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:25.167573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/079eb374-97a7-487f-82c2-e1caa3824ef3-webhook-cert\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:25.170202 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:25.170167 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/079eb374-97a7-487f-82c2-e1caa3824ef3-webhook-cert\") pod \"maas-controller-7c766b78f4-z6tlk\" (UID: \"079eb374-97a7-487f-82c2-e1caa3824ef3\") " pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:25.388432 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:25.388389 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:25.531093 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:25.531049 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c766b78f4-z6tlk"] Jun 08 21:08:25.534540 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:08:25.534510 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079eb374_97a7_487f_82c2_e1caa3824ef3.slice/crio-2e800e17ed60720b8987883fe6a62d3d41aba0230c5c6509513c7e9c69c04544 WatchSource:0}: Error finding container 2e800e17ed60720b8987883fe6a62d3d41aba0230c5c6509513c7e9c69c04544: Status 404 returned error can't find the container with id 2e800e17ed60720b8987883fe6a62d3d41aba0230c5c6509513c7e9c69c04544 Jun 08 21:08:26.121115 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:26.121072 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" event={"ID":"079eb374-97a7-487f-82c2-e1caa3824ef3","Type":"ContainerStarted","Data":"2e800e17ed60720b8987883fe6a62d3d41aba0230c5c6509513c7e9c69c04544"} Jun 08 21:08:28.134793 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:28.134689 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" event={"ID":"079eb374-97a7-487f-82c2-e1caa3824ef3","Type":"ContainerStarted","Data":"b0124d6b19f988ad0cbdb72fca73ad693a4b6c8349f3928c72ff21cb9ecbe46f"} Jun 08 21:08:28.135275 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:28.134964 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:28.154970 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:28.154916 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" podStartSLOduration=1.764811403 podStartE2EDuration="4.154899657s" totalImagesPullingTime="2.390088254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:08:28.154084056 +0000 UTC m=+791.917925399" watchObservedRunningTime="2026-06-08 21:08:28.154899657 +0000 UTC m=+791.918741028" Jun 08 21:08:39.144823 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:39.144741 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c766b78f4-z6tlk" Jun 08 21:08:57.973575 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:57.973535 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-pdrlz"] Jun 08 21:08:57.977247 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:57.977218 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:08:57.980440 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:57.980411 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 21:08:57.980614 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:57.980591 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-q4976\"" Jun 08 21:08:57.989690 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:57.989658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-pdrlz"] Jun 08 21:08:57.999906 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:57.999866 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qfn98"] Jun 08 21:08:58.003372 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.003347 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:08:58.022602 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.022563 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qfn98"] Jun 08 21:08:58.067923 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.067878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh9sp\" (UniqueName: \"kubernetes.io/projected/adc627f4-3e80-4ff5-b56c-02d593e8a942-kube-api-access-sh9sp\") pod \"payload-processing-7c6c859784-qfn98\" (UID: \"adc627f4-3e80-4ff5-b56c-02d593e8a942\") " pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:08:58.068098 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.068015 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5plw\" (UniqueName: \"kubernetes.io/projected/f071772d-afd2-473c-9e6f-03531cbc53db-kube-api-access-q5plw\") pod \"payload-pre-processing-67d7689b65-pdrlz\" (UID: \"f071772d-afd2-473c-9e6f-03531cbc53db\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:08:58.168754 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.168717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5plw\" (UniqueName: \"kubernetes.io/projected/f071772d-afd2-473c-9e6f-03531cbc53db-kube-api-access-q5plw\") pod \"payload-pre-processing-67d7689b65-pdrlz\" (UID: \"f071772d-afd2-473c-9e6f-03531cbc53db\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:08:58.168938 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.168782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh9sp\" (UniqueName: \"kubernetes.io/projected/adc627f4-3e80-4ff5-b56c-02d593e8a942-kube-api-access-sh9sp\") pod \"payload-processing-7c6c859784-qfn98\" (UID: \"adc627f4-3e80-4ff5-b56c-02d593e8a942\") " pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:08:58.180358 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.180316 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5plw\" (UniqueName: \"kubernetes.io/projected/f071772d-afd2-473c-9e6f-03531cbc53db-kube-api-access-q5plw\") pod \"payload-pre-processing-67d7689b65-pdrlz\" (UID: \"f071772d-afd2-473c-9e6f-03531cbc53db\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:08:58.180537 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.180407 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh9sp\" (UniqueName: \"kubernetes.io/projected/adc627f4-3e80-4ff5-b56c-02d593e8a942-kube-api-access-sh9sp\") pod \"payload-processing-7c6c859784-qfn98\" (UID: \"adc627f4-3e80-4ff5-b56c-02d593e8a942\") " pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:08:58.186120 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.186084 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:08:58.289037 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.288943 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:08:58.314371 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.314323 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:08:58.456250 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.456118 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-pdrlz"] Jun 08 21:08:58.459790 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:08:58.459750 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf071772d_afd2_473c_9e6f_03531cbc53db.slice/crio-79bb0177499ec8449a9034dd2e03147e9194b5784dc2a577fd72c3487bdbfc66 WatchSource:0}: Error finding container 79bb0177499ec8449a9034dd2e03147e9194b5784dc2a577fd72c3487bdbfc66: Status 404 returned error can't find the container with id 79bb0177499ec8449a9034dd2e03147e9194b5784dc2a577fd72c3487bdbfc66 Jun 08 21:08:58.481830 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:58.481796 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qfn98"] Jun 08 21:08:58.484426 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:08:58.484393 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc627f4_3e80_4ff5_b56c_02d593e8a942.slice/crio-97c1f1456ac83eed1d43165690d6f6dc845e3ecec624afb4cef6e495cdf2e135 WatchSource:0}: Error finding container 97c1f1456ac83eed1d43165690d6f6dc845e3ecec624afb4cef6e495cdf2e135: Status 404 returned error can't find the container with id 97c1f1456ac83eed1d43165690d6f6dc845e3ecec624afb4cef6e495cdf2e135 Jun 08 21:08:59.301104 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:59.301063 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" event={"ID":"f071772d-afd2-473c-9e6f-03531cbc53db","Type":"ContainerStarted","Data":"79bb0177499ec8449a9034dd2e03147e9194b5784dc2a577fd72c3487bdbfc66"} Jun 08 21:08:59.302991 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:08:59.302938 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerStarted","Data":"97c1f1456ac83eed1d43165690d6f6dc845e3ecec624afb4cef6e495cdf2e135"} Jun 08 21:09:00.310451 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:00.310343 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" event={"ID":"f071772d-afd2-473c-9e6f-03531cbc53db","Type":"ContainerStarted","Data":"68292273f2c265a8d1131a4435eb5699f06cb285523ae95c4e9864ac4a8afb69"} Jun 08 21:09:00.310886 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:00.310470 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:09:00.311991 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:00.311963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerStarted","Data":"d86480c96de90afde0fd1d6c838ed9c4621338be9cb224bf55d82e674d3803ab"} Jun 08 21:09:00.312126 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:00.312108 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:09:00.327668 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:00.327605 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" podStartSLOduration=1.92506295 podStartE2EDuration="3.327583917s" totalImagesPullingTime="1.402520967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:09:00.327418091 +0000 UTC m=+824.091259419" watchObservedRunningTime="2026-06-08 21:09:00.327583917 +0000 UTC m=+824.091425242" Jun 08 21:09:00.345078 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:00.345021 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podStartSLOduration=1.963807786 podStartE2EDuration="3.345003528s" totalImagesPullingTime="1.381195742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:09:00.343284504 +0000 UTC m=+824.107125832" watchObservedRunningTime="2026-06-08 21:09:00.345003528 +0000 UTC m=+824.108844855" Jun 08 21:09:11.319726 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:11.319694 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:09:11.320200 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:09:11.319779 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-pdrlz" Jun 08 21:10:01.139327 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:01.139268 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:10:17.732054 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:17.732012 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:10:22.230059 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:22.230014 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:10:28.820508 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.820423 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8"] Jun 08 21:10:28.824680 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.824649 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:28.827593 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.827570 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 21:10:28.829266 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.829242 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 21:10:28.829266 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.829261 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z7lq2\"" Jun 08 21:10:28.829470 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.829243 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 21:10:28.835090 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.835062 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8"] Jun 08 21:10:28.914127 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.914076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv54z\" (UniqueName: \"kubernetes.io/projected/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-kube-api-access-pv54z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:28.914127 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.914127 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:28.914394 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.914148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:28.914394 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.914173 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:28.914394 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.914231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:28.914394 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:28.914374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.015654 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.015612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.015842 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.015676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.015842 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.015702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv54z\" (UniqueName: \"kubernetes.io/projected/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-kube-api-access-pv54z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.015842 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.015720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.015842 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.015740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.015842 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.015757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.016128 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.016103 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.016190 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.016114 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.016256 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.016189 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.018815 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.018782 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.019354 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.019314 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.024703 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.024672 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv54z\" (UniqueName: \"kubernetes.io/projected/4297df36-e4a1-4bde-9e51-a1f5d527dcc3-kube-api-access-pv54z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8\" (UID: \"4297df36-e4a1-4bde-9e51-a1f5d527dcc3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.137052 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.137004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:10:29.292958 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.292930 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8"] Jun 08 21:10:29.295287 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:10:29.295261 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4297df36_e4a1_4bde_9e51_a1f5d527dcc3.slice/crio-8c1a050ecbbd23ac6bface0fce88a3956ea0a5d83d9c3e0a4031652eedc31441 WatchSource:0}: Error finding container 8c1a050ecbbd23ac6bface0fce88a3956ea0a5d83d9c3e0a4031652eedc31441: Status 404 returned error can't find the container with id 8c1a050ecbbd23ac6bface0fce88a3956ea0a5d83d9c3e0a4031652eedc31441 Jun 08 21:10:29.523379 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.523277 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:10:29.782176 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:29.782059 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" event={"ID":"4297df36-e4a1-4bde-9e51-a1f5d527dcc3","Type":"ContainerStarted","Data":"8c1a050ecbbd23ac6bface0fce88a3956ea0a5d83d9c3e0a4031652eedc31441"} Jun 08 21:10:32.812939 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:32.812837 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" event={"ID":"4297df36-e4a1-4bde-9e51-a1f5d527dcc3","Type":"ContainerStarted","Data":"3d1ccee5008666922d5fc6dea1060e1cd45581677ead0dea77c225827ad78c59"} Jun 08 21:10:38.126262 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:38.126223 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:10:44.024512 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:10:44.024467 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hd6q8"] Jun 08 21:11:00.970439 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:00.970400 2554 generic.go:356] "Generic (PLEG): container finished" podID="adc627f4-3e80-4ff5-b56c-02d593e8a942" containerID="d86480c96de90afde0fd1d6c838ed9c4621338be9cb224bf55d82e674d3803ab" exitCode=1 Jun 08 21:11:00.970856 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:00.970492 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerDied","Data":"d86480c96de90afde0fd1d6c838ed9c4621338be9cb224bf55d82e674d3803ab"} Jun 08 21:11:00.970856 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:00.970839 2554 scope.go:117] "RemoveContainer" containerID="d86480c96de90afde0fd1d6c838ed9c4621338be9cb224bf55d82e674d3803ab" Jun 08 21:11:01.317737 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:01.317640 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:11:01.978879 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:01.978841 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerStarted","Data":"88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8"} Jun 08 21:11:01.979399 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:01.978940 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:11:02.985553 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:02.985517 2554 generic.go:356] "Generic (PLEG): container finished" podID="4297df36-e4a1-4bde-9e51-a1f5d527dcc3" containerID="3d1ccee5008666922d5fc6dea1060e1cd45581677ead0dea77c225827ad78c59" exitCode=0 Jun 08 21:11:02.985960 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:02.985590 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" event={"ID":"4297df36-e4a1-4bde-9e51-a1f5d527dcc3","Type":"ContainerDied","Data":"3d1ccee5008666922d5fc6dea1060e1cd45581677ead0dea77c225827ad78c59"} Jun 08 21:11:05.000049 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:05.000012 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" event={"ID":"4297df36-e4a1-4bde-9e51-a1f5d527dcc3","Type":"ContainerStarted","Data":"afbea00ac70e6784120231f450ced491ed9760b9debac03a808ef2ae626fca30"} Jun 08 21:11:05.021759 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:05.021703 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" podStartSLOduration=2.953522349 podStartE2EDuration="37.021681455s" totalImagesPullingTime="4.325221389s" totalInitContainerRuntime="29.742937717s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:10:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:11:05.019480849 +0000 UTC m=+948.783322181" watchObservedRunningTime="2026-06-08 21:11:05.021681455 +0000 UTC m=+948.785522782" Jun 08 21:11:09.138000 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:09.137949 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:11:09.138415 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:09.138028 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:11:09.151089 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:09.151056 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:11:10.039837 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:10.039806 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8" Jun 08 21:11:12.987985 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:11:12.987942 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:13:01.615075 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:01.615022 2554 generic.go:356] "Generic (PLEG): container finished" podID="adc627f4-3e80-4ff5-b56c-02d593e8a942" containerID="88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8" exitCode=1 Jun 08 21:13:01.615675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:01.615208 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerDied","Data":"88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8"} Jun 08 21:13:01.615675 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:01.615331 2554 scope.go:117] "RemoveContainer" containerID="d86480c96de90afde0fd1d6c838ed9c4621338be9cb224bf55d82e674d3803ab" Jun 08 21:13:01.620158 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:01.615812 2554 scope.go:117] "RemoveContainer" containerID="88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8" Jun 08 21:13:01.620158 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:13:01.616203 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qfn98_openshift-ingress(adc627f4-3e80-4ff5-b56c-02d593e8a942)\"" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podUID="adc627f4-3e80-4ff5-b56c-02d593e8a942" Jun 08 21:13:02.986174 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:02.986129 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:13:02.986631 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:02.986518 2554 scope.go:117] "RemoveContainer" containerID="88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8" Jun 08 21:13:02.986775 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:13:02.986755 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qfn98_openshift-ingress(adc627f4-3e80-4ff5-b56c-02d593e8a942)\"" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podUID="adc627f4-3e80-4ff5-b56c-02d593e8a942" Jun 08 21:13:16.783508 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:16.783416 2554 scope.go:117] "RemoveContainer" containerID="88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8" Jun 08 21:13:17.704992 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:17.704955 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerStarted","Data":"3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c"} Jun 08 21:13:17.705214 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:17.705182 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:13:28.712399 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:13:28.712364 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:14:56.155171 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:56.155144 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-58849dbc9d-tlzvp_e9310295-8b1c-4a22-8165-11d9ba1ba08f/nginx/0.log" Jun 08 21:14:56.375827 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:56.375789 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-k898d_b59e6622-8f20-4158-bafd-2f0ba9dbc5a1/manager/0.log" Jun 08 21:14:56.488956 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:56.488870 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4q8j9_64c3e3fc-9d59-4e1a-99ec-65515ae01f5c/manager/0.log" Jun 08 21:14:56.711618 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:56.711569 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c766b78f4-z6tlk_079eb374-97a7-487f-82c2-e1caa3824ef3/manager/0.log" Jun 08 21:14:56.825249 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:56.825171 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-kvbwq_c1885044-35d7-4fd0-bc79-66b08a611f9e/server/0.log" Jun 08 21:14:56.945477 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:56.945445 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-qczjs_66999ecc-ff23-4d6c-9e42-e6ae16aeb864/manager/0.log" Jun 08 21:14:57.176242 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:57.176207 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666ff48864-6w7zf_78bc9911-4948-45b3-aae2-d5299aa15cb3/copy-manifests/0.log" Jun 08 21:14:57.183288 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:57.183256 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666ff48864-6w7zf_78bc9911-4948-45b3-aae2-d5299aa15cb3/manager/0.log" Jun 08 21:14:58.766176 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:58.766141 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-prcrj_f381d149-a98d-424f-852f-b86ff8d9a111/manager/0.log" Jun 08 21:14:59.308003 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:59.307976 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hd6q8_a863062b-92bc-4f21-996c-845e0642a897/limitador/0.log" Jun 08 21:14:59.877730 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:59.877690 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4zj8z_0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71/discovery/0.log" Jun 08 21:14:59.986480 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:14:59.986451 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df9d9cc9-n5krj_ba820239-599b-4a21-b026-ea4850224c72/kube-auth-proxy/0.log" Jun 08 21:15:00.151843 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.151759 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29682555-blmkk"] Jun 08 21:15:00.155338 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.155285 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:00.158233 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.158210 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2fn2p\"" Jun 08 21:15:00.171418 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.171379 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682555-blmkk"] Jun 08 21:15:00.206745 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.206702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m474c\" (UniqueName: \"kubernetes.io/projected/53e82567-f738-41eb-beca-5aca13ab5300-kube-api-access-m474c\") pod \"maas-api-key-cleanup-29682555-blmkk\" (UID: \"53e82567-f738-41eb-beca-5aca13ab5300\") " pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:00.314077 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.308548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m474c\" (UniqueName: \"kubernetes.io/projected/53e82567-f738-41eb-beca-5aca13ab5300-kube-api-access-m474c\") pod \"maas-api-key-cleanup-29682555-blmkk\" (UID: \"53e82567-f738-41eb-beca-5aca13ab5300\") " pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:00.315895 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.315865 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pdrlz_f071772d-afd2-473c-9e6f-03531cbc53db/payload-pre-processing/0.log" Jun 08 21:15:00.317708 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.317685 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m474c\" (UniqueName: \"kubernetes.io/projected/53e82567-f738-41eb-beca-5aca13ab5300-kube-api-access-m474c\") pod \"maas-api-key-cleanup-29682555-blmkk\" (UID: \"53e82567-f738-41eb-beca-5aca13ab5300\") " pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:00.427643 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.427545 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:00.466287 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.466244 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:00.536810 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.536783 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fddf6b9d7-kztd5_69f20847-6a9b-495e-97e1-35dfd9bc4769/router/0.log" Jun 08 21:15:00.608818 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.608793 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29682555-blmkk"] Jun 08 21:15:00.611111 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:15:00.611079 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e82567_f738_41eb_beca_5aca13ab5300.slice/crio-d8e9399526cd32e61231c8e20c285ea4ba68fddd4a70e5de4f757c6ea226aec1 WatchSource:0}: Error finding container d8e9399526cd32e61231c8e20c285ea4ba68fddd4a70e5de4f757c6ea226aec1: Status 404 returned error can't find the container with id d8e9399526cd32e61231c8e20c285ea4ba68fddd4a70e5de4f757c6ea226aec1 Jun 08 21:15:00.613524 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:00.613503 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:15:01.241543 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:01.241504 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" event={"ID":"53e82567-f738-41eb-beca-5aca13ab5300","Type":"ContainerStarted","Data":"d8e9399526cd32e61231c8e20c285ea4ba68fddd4a70e5de4f757c6ea226aec1"} Jun 08 21:15:01.251724 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:01.251698 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8_4297df36-e4a1-4bde-9e51-a1f5d527dcc3/storage-initializer/0.log" Jun 08 21:15:01.266360 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:01.266312 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czb7m8_4297df36-e4a1-4bde-9e51-a1f5d527dcc3/main/0.log" Jun 08 21:15:05.589036 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.588999 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hpgc8/must-gather-8w457"] Jun 08 21:15:05.594605 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.594579 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.597819 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.597789 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hpgc8\"/\"openshift-service-ca.crt\"" Jun 08 21:15:05.599499 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.599472 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hpgc8\"/\"kube-root-ca.crt\"" Jun 08 21:15:05.600122 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.600099 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hpgc8\"/\"default-dockercfg-stp9v\"" Jun 08 21:15:05.602535 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.602507 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpgc8/must-gather-8w457"] Jun 08 21:15:05.661566 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.661528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a44a4cc9-9514-4310-a0dc-f8f284395191-must-gather-output\") pod \"must-gather-8w457\" (UID: \"a44a4cc9-9514-4310-a0dc-f8f284395191\") " pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.661753 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.661674 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rqc9\" (UniqueName: \"kubernetes.io/projected/a44a4cc9-9514-4310-a0dc-f8f284395191-kube-api-access-5rqc9\") pod \"must-gather-8w457\" (UID: \"a44a4cc9-9514-4310-a0dc-f8f284395191\") " pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.762480 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.762434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rqc9\" (UniqueName: \"kubernetes.io/projected/a44a4cc9-9514-4310-a0dc-f8f284395191-kube-api-access-5rqc9\") pod \"must-gather-8w457\" (UID: \"a44a4cc9-9514-4310-a0dc-f8f284395191\") " pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.762696 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.762515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a44a4cc9-9514-4310-a0dc-f8f284395191-must-gather-output\") pod \"must-gather-8w457\" (UID: \"a44a4cc9-9514-4310-a0dc-f8f284395191\") " pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.763405 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.763381 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a44a4cc9-9514-4310-a0dc-f8f284395191-must-gather-output\") pod \"must-gather-8w457\" (UID: \"a44a4cc9-9514-4310-a0dc-f8f284395191\") " pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.772634 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.772600 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rqc9\" (UniqueName: \"kubernetes.io/projected/a44a4cc9-9514-4310-a0dc-f8f284395191-kube-api-access-5rqc9\") pod \"must-gather-8w457\" (UID: \"a44a4cc9-9514-4310-a0dc-f8f284395191\") " pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:05.906822 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:05.906722 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpgc8/must-gather-8w457" Jun 08 21:15:06.050041 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:06.050017 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpgc8/must-gather-8w457"] Jun 08 21:15:06.052225 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:15:06.052195 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda44a4cc9_9514_4310_a0dc_f8f284395191.slice/crio-3a22bdfad36f0b9c330e0611d949a368a212b21b4e137c8af1790a4fe17ec122 WatchSource:0}: Error finding container 3a22bdfad36f0b9c330e0611d949a368a212b21b4e137c8af1790a4fe17ec122: Status 404 returned error can't find the container with id 3a22bdfad36f0b9c330e0611d949a368a212b21b4e137c8af1790a4fe17ec122 Jun 08 21:15:06.269357 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:06.269248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpgc8/must-gather-8w457" event={"ID":"a44a4cc9-9514-4310-a0dc-f8f284395191","Type":"ContainerStarted","Data":"3a22bdfad36f0b9c330e0611d949a368a212b21b4e137c8af1790a4fe17ec122"} Jun 08 21:15:07.279733 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:07.279574 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpgc8/must-gather-8w457" event={"ID":"a44a4cc9-9514-4310-a0dc-f8f284395191","Type":"ContainerStarted","Data":"f87f705670ca7919ed9fbf76087ea6b8fef98838e8d65fcab1315bf6edf6d1ac"} Jun 08 21:15:07.279733 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:07.279634 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpgc8/must-gather-8w457" event={"ID":"a44a4cc9-9514-4310-a0dc-f8f284395191","Type":"ContainerStarted","Data":"84b1064e08c421e2065a650674afae44f11310f3748eef4f1f5ab1f9aba44fab"} Jun 08 21:15:07.299880 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:07.299810 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hpgc8/must-gather-8w457" podStartSLOduration=1.5182097780000001 podStartE2EDuration="2.299787595s" totalImagesPullingTime="781.577817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:07.29875354 +0000 UTC m=+1191.062594869" watchObservedRunningTime="2026-06-08 21:15:07.299787595 +0000 UTC m=+1191.063628921" Jun 08 21:15:08.487276 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:08.487231 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kpp5z_f2453927-0895-42dc-b314-284c1221f9d6/global-pull-secret-syncer/0.log" Jun 08 21:15:08.631229 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:08.631191 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m6bnc_b3862e89-7fcb-4319-b18b-15340574aa27/konnectivity-agent/0.log" Jun 08 21:15:08.699351 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:08.699219 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-176.ec2.internal_e42e4eb741c319d6e7c4d1ea6b9bf3e8/haproxy/0.log" Jun 08 21:15:11.317958 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:11.317900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" event={"ID":"53e82567-f738-41eb-beca-5aca13ab5300","Type":"ContainerStarted","Data":"25b7f3a492db9c4c611d52c8cbf4073c88248e439ffd2663aff27a5041048435"} Jun 08 21:15:11.337996 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:11.337922 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" podStartSLOduration=1.595788998 podStartE2EDuration="11.337899977s" totalImagesPullingTime="9.742110979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:11.337599894 +0000 UTC m=+1195.101441223" watchObservedRunningTime="2026-06-08 21:15:11.337899977 +0000 UTC m=+1195.101741307" Jun 08 21:15:12.329899 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:12.329837 2554 generic.go:356] "Generic (PLEG): container finished" podID="53e82567-f738-41eb-beca-5aca13ab5300" containerID="25b7f3a492db9c4c611d52c8cbf4073c88248e439ffd2663aff27a5041048435" exitCode=0 Jun 08 21:15:12.330503 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:12.330006 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" event={"ID":"53e82567-f738-41eb-beca-5aca13ab5300","Type":"ContainerDied","Data":"25b7f3a492db9c4c611d52c8cbf4073c88248e439ffd2663aff27a5041048435"} Jun 08 21:15:12.832451 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:12.832411 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-j8r7t_686da22e-f6cc-46ad-b916-c896a865fda2/sail-operator/0.log" Jun 08 21:15:13.603640 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:13.603589 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:13.651225 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:13.651189 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m474c\" (UniqueName: \"kubernetes.io/projected/53e82567-f738-41eb-beca-5aca13ab5300-kube-api-access-m474c\") pod \"53e82567-f738-41eb-beca-5aca13ab5300\" (UID: \"53e82567-f738-41eb-beca-5aca13ab5300\") " Jun 08 21:15:13.710579 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:13.710540 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e82567-f738-41eb-beca-5aca13ab5300-kube-api-access-m474c" (OuterVolumeSpecName: "kube-api-access-m474c") pod "53e82567-f738-41eb-beca-5aca13ab5300" (UID: "53e82567-f738-41eb-beca-5aca13ab5300"). InnerVolumeSpecName "kube-api-access-m474c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 21:15:13.754873 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:13.754836 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m474c\" (UniqueName: \"kubernetes.io/projected/53e82567-f738-41eb-beca-5aca13ab5300-kube-api-access-m474c\") on node \"ip-10-0-135-176.ec2.internal\" DevicePath \"\"" Jun 08 21:15:14.088998 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:14.088962 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-prcrj_f381d149-a98d-424f-852f-b86ff8d9a111/manager/0.log" Jun 08 21:15:14.251640 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:14.251598 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hd6q8_a863062b-92bc-4f21-996c-845e0642a897/limitador/0.log" Jun 08 21:15:14.348353 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:14.348230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" event={"ID":"53e82567-f738-41eb-beca-5aca13ab5300","Type":"ContainerDied","Data":"d8e9399526cd32e61231c8e20c285ea4ba68fddd4a70e5de4f757c6ea226aec1"} Jun 08 21:15:14.348353 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:14.348321 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8e9399526cd32e61231c8e20c285ea4ba68fddd4a70e5de4f757c6ea226aec1" Jun 08 21:15:14.348591 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:14.348392 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29682555-blmkk" Jun 08 21:15:15.924143 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:15.924064 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/alertmanager/0.log" Jun 08 21:15:15.947805 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:15.947761 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/config-reloader/0.log" Jun 08 21:15:15.972648 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:15.972623 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/kube-rbac-proxy-web/0.log" Jun 08 21:15:15.994847 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:15.994819 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/kube-rbac-proxy/0.log" Jun 08 21:15:16.022959 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.022930 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/kube-rbac-proxy-metric/0.log" Jun 08 21:15:16.079685 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.079654 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/prom-label-proxy/0.log" Jun 08 21:15:16.101009 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.100968 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_96c782cd-f382-4a3a-b3e2-452217d6ac24/init-config-reloader/0.log" Jun 08 21:15:16.146327 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.144843 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-zxgv6_3b6a6613-02d4-4c40-bbad-cdf99ef1d281/cluster-monitoring-operator/0.log" Jun 08 21:15:16.487872 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.487836 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8t5ls_d7548076-a92b-4110-96e7-fb2d3f9d1a00/node-exporter/0.log" Jun 08 21:15:16.509954 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.509919 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8t5ls_d7548076-a92b-4110-96e7-fb2d3f9d1a00/kube-rbac-proxy/0.log" Jun 08 21:15:16.530155 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.530119 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8t5ls_d7548076-a92b-4110-96e7-fb2d3f9d1a00/init-textfile/0.log" Jun 08 21:15:16.917179 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:16.914072 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-cp2vx_9a78f33e-acc2-416f-97a1-f049b29c1866/prometheus-operator-admission-webhook/0.log" Jun 08 21:15:17.042886 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.042784 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bbc9dbf4c-x6dbn_7e83d842-01e0-4982-8d06-d052b63c7e7f/thanos-query/0.log" Jun 08 21:15:17.069606 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.069570 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bbc9dbf4c-x6dbn_7e83d842-01e0-4982-8d06-d052b63c7e7f/kube-rbac-proxy-web/0.log" Jun 08 21:15:17.091308 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.091257 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bbc9dbf4c-x6dbn_7e83d842-01e0-4982-8d06-d052b63c7e7f/kube-rbac-proxy/0.log" Jun 08 21:15:17.113524 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.113490 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bbc9dbf4c-x6dbn_7e83d842-01e0-4982-8d06-d052b63c7e7f/prom-label-proxy/0.log" Jun 08 21:15:17.139163 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.139135 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bbc9dbf4c-x6dbn_7e83d842-01e0-4982-8d06-d052b63c7e7f/kube-rbac-proxy-rules/0.log" Jun 08 21:15:17.159783 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.159715 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bbc9dbf4c-x6dbn_7e83d842-01e0-4982-8d06-d052b63c7e7f/kube-rbac-proxy-metrics/0.log" Jun 08 21:15:17.376636 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.376594 2554 generic.go:356] "Generic (PLEG): container finished" podID="adc627f4-3e80-4ff5-b56c-02d593e8a942" containerID="3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c" exitCode=1 Jun 08 21:15:17.376818 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.376748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" event={"ID":"adc627f4-3e80-4ff5-b56c-02d593e8a942","Type":"ContainerDied","Data":"3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c"} Jun 08 21:15:17.376818 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.376812 2554 scope.go:117] "RemoveContainer" containerID="88edaa67e1b18dc490cde3b25a6d0cecc08a77f0139e47ec619ffe51492d4ab8" Jun 08 21:15:17.377289 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:17.377265 2554 scope.go:117] "RemoveContainer" containerID="3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c" Jun 08 21:15:17.377608 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:15:17.377577 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qfn98_openshift-ingress(adc627f4-3e80-4ff5-b56c-02d593e8a942)\"" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podUID="adc627f4-3e80-4ff5-b56c-02d593e8a942" Jun 08 21:15:18.315356 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:18.315313 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:15:18.385833 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:18.385795 2554 scope.go:117] "RemoveContainer" containerID="3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c" Jun 08 21:15:18.386031 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:15:18.385990 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qfn98_openshift-ingress(adc627f4-3e80-4ff5-b56c-02d593e8a942)\"" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podUID="adc627f4-3e80-4ff5-b56c-02d593e8a942" Jun 08 21:15:18.710693 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:18.710649 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" Jun 08 21:15:19.394364 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:19.394332 2554 scope.go:117] "RemoveContainer" containerID="3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c" Jun 08 21:15:19.394838 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:15:19.394588 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qfn98_openshift-ingress(adc627f4-3e80-4ff5-b56c-02d593e8a942)\"" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podUID="adc627f4-3e80-4ff5-b56c-02d593e8a942" Jun 08 21:15:20.366912 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.366869 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n"] Jun 08 21:15:20.367531 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.367507 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e82567-f738-41eb-beca-5aca13ab5300" containerName="cleanup" Jun 08 21:15:20.367531 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.367532 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e82567-f738-41eb-beca-5aca13ab5300" containerName="cleanup" Jun 08 21:15:20.367692 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.367659 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e82567-f738-41eb-beca-5aca13ab5300" containerName="cleanup" Jun 08 21:15:20.374694 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.374667 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.377827 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.377790 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n"] Jun 08 21:15:20.438110 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.438067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-sys\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.438529 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.438126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-lib-modules\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.438529 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.438157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-podres\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.438529 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.438200 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jklx9\" (UniqueName: \"kubernetes.io/projected/d624d5d5-499d-4717-91ef-dd021561ef2e-kube-api-access-jklx9\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.438529 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.438263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-proc\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539287 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-sys\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-lib-modules\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-podres\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jklx9\" (UniqueName: \"kubernetes.io/projected/d624d5d5-499d-4717-91ef-dd021561ef2e-kube-api-access-jklx9\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539414 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-sys\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539497 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-proc\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539741 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539573 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-proc\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539741 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539573 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-podres\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.539741 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.539662 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d624d5d5-499d-4717-91ef-dd021561ef2e-lib-modules\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.549419 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.549376 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jklx9\" (UniqueName: \"kubernetes.io/projected/d624d5d5-499d-4717-91ef-dd021561ef2e-kube-api-access-jklx9\") pod \"perf-node-gather-daemonset-nc98n\" (UID: \"d624d5d5-499d-4717-91ef-dd021561ef2e\") " pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.692927 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.692819 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:20.916979 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:20.916947 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n"] Jun 08 21:15:20.917877 ip-10-0-135-176 kubenswrapper[2554]: W0608 21:15:20.917846 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd624d5d5_499d_4717_91ef_dd021561ef2e.slice/crio-38e71a90e15167e14756cefa92b76bdefcaad2b2b8bc82d3a03b67dbb4a7b111 WatchSource:0}: Error finding container 38e71a90e15167e14756cefa92b76bdefcaad2b2b8bc82d3a03b67dbb4a7b111: Status 404 returned error can't find the container with id 38e71a90e15167e14756cefa92b76bdefcaad2b2b8bc82d3a03b67dbb4a7b111 Jun 08 21:15:21.411670 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.410684 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" event={"ID":"d624d5d5-499d-4717-91ef-dd021561ef2e","Type":"ContainerStarted","Data":"5671ec5e94009240ddf3e960f162297a4202ab522406e6de0cd922167a03c906"} Jun 08 21:15:21.411670 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.410753 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" event={"ID":"d624d5d5-499d-4717-91ef-dd021561ef2e","Type":"ContainerStarted","Data":"38e71a90e15167e14756cefa92b76bdefcaad2b2b8bc82d3a03b67dbb4a7b111"} Jun 08 21:15:21.411670 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.411612 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:21.429409 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.429352 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" podStartSLOduration=1.4293311389999999 podStartE2EDuration="1.429331139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:15:21.427382979 +0000 UTC m=+1205.191224308" watchObservedRunningTime="2026-06-08 21:15:21.429331139 +0000 UTC m=+1205.193172467" Jun 08 21:15:21.837790 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.837759 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wp2h_7cdd4bd6-7a34-4632-b350-01f3723bd717/dns/0.log" Jun 08 21:15:21.858836 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.858810 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wp2h_7cdd4bd6-7a34-4632-b350-01f3723bd717/kube-rbac-proxy/0.log" Jun 08 21:15:21.984548 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:21.984509 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tcsbt_cd9f35b9-cbda-4437-ba6b-387ed48084cf/dns-node-resolver/0.log" Jun 08 21:15:22.596810 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:22.596777 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tlvw2_4504bb35-e317-4eea-adbc-6d6d41fdb215/node-ca/0.log" Jun 08 21:15:23.691562 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:23.691528 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4zj8z_0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71/discovery/0.log" Jun 08 21:15:23.708495 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:23.708465 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df9d9cc9-n5krj_ba820239-599b-4a21-b026-ea4850224c72/kube-auth-proxy/0.log" Jun 08 21:15:23.772356 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:23.772327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pdrlz_f071772d-afd2-473c-9e6f-03531cbc53db/payload-pre-processing/0.log" Jun 08 21:15:23.796352 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:23.796319 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:23.796540 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:23.796411 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:23.818947 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:23.818916 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fddf6b9d7-kztd5_69f20847-6a9b-495e-97e1-35dfd9bc4769/router/0.log" Jun 08 21:15:24.421477 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:24.421447 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4fpvc_7d2090cc-04ad-4881-8a47-2b2bd286daab/serve-healthcheck-canary/0.log" Jun 08 21:15:24.961801 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:24.961754 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-47z22_ec7610dd-cfc9-46f2-ace2-8f20b3adb9db/insights-operator/1.log" Jun 08 21:15:24.962394 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:24.961896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-47z22_ec7610dd-cfc9-46f2-ace2-8f20b3adb9db/insights-operator/0.log" Jun 08 21:15:25.109816 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:25.109785 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zflr2_14f20918-9afa-4399-b679-db7a0f75aa79/kube-rbac-proxy/0.log" Jun 08 21:15:25.126933 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:25.126904 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zflr2_14f20918-9afa-4399-b679-db7a0f75aa79/exporter/0.log" Jun 08 21:15:25.146271 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:25.146191 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zflr2_14f20918-9afa-4399-b679-db7a0f75aa79/extractor/0.log" Jun 08 21:15:27.520007 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.519966 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-58849dbc9d-tlzvp_e9310295-8b1c-4a22-8165-11d9ba1ba08f/nginx/0.log" Jun 08 21:15:27.619878 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.619843 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-k898d_b59e6622-8f20-4158-bafd-2f0ba9dbc5a1/manager/0.log" Jun 08 21:15:27.654763 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.654728 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-4q8j9_64c3e3fc-9d59-4e1a-99ec-65515ae01f5c/manager/0.log" Jun 08 21:15:27.694112 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.694080 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29682555-blmkk_53e82567-f738-41eb-beca-5aca13ab5300/cleanup/0.log" Jun 08 21:15:27.722869 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.722831 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c766b78f4-z6tlk_079eb374-97a7-487f-82c2-e1caa3824ef3/manager/0.log" Jun 08 21:15:27.741889 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.741859 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-kvbwq_c1885044-35d7-4fd0-bc79-66b08a611f9e/server/0.log" Jun 08 21:15:27.795901 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.795826 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-qczjs_66999ecc-ff23-4d6c-9e42-e6ae16aeb864/manager/0.log" Jun 08 21:15:27.869040 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.869012 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666ff48864-6w7zf_78bc9911-4948-45b3-aae2-d5299aa15cb3/manager/0.log" Jun 08 21:15:27.888058 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:27.888029 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666ff48864-6w7zf_78bc9911-4948-45b3-aae2-d5299aa15cb3/copy-manifests/0.log" Jun 08 21:15:28.438356 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:28.438323 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hpgc8/perf-node-gather-daemonset-nc98n" Jun 08 21:15:29.701903 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:29.701868 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d9qz5_cf4c0b5d-993e-4586-8604-9d74356cd583/openshift-lws-operator/0.log" Jun 08 21:15:33.781823 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:33.781100 2554 scope.go:117] "RemoveContainer" containerID="3dab6e40747f69b96c7a26a6fb1ca2b64c92e6111d30b72877eb1671d411908c" Jun 08 21:15:33.781823 ip-10-0-135-176 kubenswrapper[2554]: E0608 21:15:33.781414 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-qfn98_openshift-ingress(adc627f4-3e80-4ff5-b56c-02d593e8a942)\"" pod="openshift-ingress/payload-processing-7c6c859784-qfn98" podUID="adc627f4-3e80-4ff5-b56c-02d593e8a942" Jun 08 21:15:35.145148 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.145117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4zj8z_0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71/discovery/0.log" Jun 08 21:15:35.154188 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.154160 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df9d9cc9-n5krj_ba820239-599b-4a21-b026-ea4850224c72/kube-auth-proxy/0.log" Jun 08 21:15:35.197668 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.197615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pdrlz_f071772d-afd2-473c-9e6f-03531cbc53db/payload-pre-processing/0.log" Jun 08 21:15:35.215556 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.215527 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:35.215796 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.215546 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:35.229425 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.229395 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fddf6b9d7-kztd5_69f20847-6a9b-495e-97e1-35dfd9bc4769/router/0.log" Jun 08 21:15:35.591628 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.591593 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wtsv7_f82a848a-a116-4b5d-9164-d3c196f72b57/kube-storage-version-migrator-operator/1.log" Jun 08 21:15:35.592789 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:35.592758 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wtsv7_f82a848a-a116-4b5d-9164-d3c196f72b57/kube-storage-version-migrator-operator/0.log" Jun 08 21:15:36.401103 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.401068 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4zj8z_0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71/discovery/0.log" Jun 08 21:15:36.416660 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.416633 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df9d9cc9-n5krj_ba820239-599b-4a21-b026-ea4850224c72/kube-auth-proxy/0.log" Jun 08 21:15:36.457190 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.457151 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pdrlz_f071772d-afd2-473c-9e6f-03531cbc53db/payload-pre-processing/0.log" Jun 08 21:15:36.474441 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.474411 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:36.474643 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.474457 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:36.487413 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.487367 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fddf6b9d7-kztd5_69f20847-6a9b-495e-97e1-35dfd9bc4769/router/0.log" Jun 08 21:15:36.866191 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:36.866155 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5tzcw_d381a5f4-7df6-4200-8659-e6e42ec1232e/kube-multus/0.log" Jun 08 21:15:37.095128 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.095094 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/kube-multus-additional-cni-plugins/0.log" Jun 08 21:15:37.116951 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.116878 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/egress-router-binary-copy/0.log" Jun 08 21:15:37.136678 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.136636 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/cni-plugins/0.log" Jun 08 21:15:37.156441 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.156411 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/bond-cni-plugin/0.log" Jun 08 21:15:37.176280 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.176242 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/routeoverride-cni/0.log" Jun 08 21:15:37.196441 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.196414 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/whereabouts-cni-bincopy/0.log" Jun 08 21:15:37.217091 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.217064 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jpnpk_2e864677-53de-4e46-9964-638364be4d26/whereabouts-cni/0.log" Jun 08 21:15:37.424807 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.424725 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frhgs_d5f0742c-7c89-45cb-8300-90f5fd50b571/network-metrics-daemon/0.log" Jun 08 21:15:37.442619 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:37.442586 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frhgs_d5f0742c-7c89-45cb-8300-90f5fd50b571/kube-rbac-proxy/0.log" Jun 08 21:15:38.141103 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:38.141064 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4zj8z_0bffd5aa-cd5b-4bea-a12c-60eb9f0eee71/discovery/0.log" Jun 08 21:15:38.152223 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:38.152193 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-df9d9cc9-n5krj_ba820239-599b-4a21-b026-ea4850224c72/kube-auth-proxy/0.log" Jun 08 21:15:38.206413 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:38.206384 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pdrlz_f071772d-afd2-473c-9e6f-03531cbc53db/payload-pre-processing/0.log" Jun 08 21:15:38.225641 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:38.225609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:38.226677 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:38.226045 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qfn98_adc627f4-3e80-4ff5-b56c-02d593e8a942/payload-processing/2.log" Jun 08 21:15:38.242592 ip-10-0-135-176 kubenswrapper[2554]: I0608 21:15:38.242540 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fddf6b9d7-kztd5_69f20847-6a9b-495e-97e1-35dfd9bc4769/router/0.log"