Jul 07 16:46:29.000069 ip-10-0-128-144 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:46:30.852790 ip-10-0-128-144 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:46:30.852790 ip-10-0-128-144 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:46:30.852790 ip-10-0-128-144 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:46:30.852790 ip-10-0-128-144 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:46:30.852790 ip-10-0-128-144 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:46:30.854198 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.854102 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:46:30.860128 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860097 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:30.860128 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860125 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:30.860128 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860131 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:30.860128 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860136 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860141 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860145 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860150 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860154 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860158 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860163 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860167 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860171 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860174 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860179 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860183 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860187 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860191 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860195 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860199 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860203 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860207 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860211 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860216 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:30.860305 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860220 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860224 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860228 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860237 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860241 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860245 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860249 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860253 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860257 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860261 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860265 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860269 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860272 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860275 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860280 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860283 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860286 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860289 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860291 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860294 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:30.860778 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860297 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860300 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860303 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860305 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860308 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860311 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860313 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860316 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860320 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860323 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860325 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860328 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860330 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860333 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860335 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860338 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860340 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860343 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860345 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860348 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:30.861331 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860351 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860357 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860361 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860364 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860368 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860370 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860374 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860377 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860380 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860383 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860386 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860388 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860391 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860394 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860397 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860399 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860402 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860405 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860410 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:30.861813 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860414 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860418 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860421 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860424 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860427 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860431 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860435 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860438 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860441 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860443 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860446 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860449 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860451 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860454 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860457 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860460 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.860462 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861238 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861247 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:30.862309 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861250 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861253 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861256 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861259 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861262 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861265 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861267 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861270 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861273 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861275 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861278 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861280 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861283 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861286 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861288 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861291 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861294 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861296 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861299 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861301 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:30.862763 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861304 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861307 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861309 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861312 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861314 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861316 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861319 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861322 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861325 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861327 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861330 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861333 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861336 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861338 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861341 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861344 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861347 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861349 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861352 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861354 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:30.863277 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861357 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861359 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861362 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861364 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861366 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861369 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861371 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861374 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861377 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861381 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861385 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861389 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861391 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861394 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861397 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861400 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861403 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861406 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861409 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:30.863766 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861411 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861414 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861419 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861422 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861425 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861428 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861431 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861434 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861436 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861439 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861441 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861444 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861446 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861449 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861451 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861454 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861457 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861459 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861464 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:30.864245 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861467 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861470 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861476 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861479 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861482 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861485 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861488 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861490 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861493 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861496 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861499 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861502 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861504 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861507 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861509 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861513 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861516 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861518 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861522 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861909 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:30.864710 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861914 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861916 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861919 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861921 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861924 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861927 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861930 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861933 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861935 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861938 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861941 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861944 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861946 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861949 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861953 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861956 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861959 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861961 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861964 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861966 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:30.865237 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861969 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861990 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861993 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861996 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.861998 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862001 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862003 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862007 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862009 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862012 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862014 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862017 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862019 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862022 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862024 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862027 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862029 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862031 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862034 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:30.865754 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862037 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862042 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862045 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862048 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862051 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862054 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862057 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862061 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862064 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862068 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862071 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862073 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862077 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862080 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862083 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862086 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862088 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862091 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862093 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862096 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:30.866235 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862099 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862101 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862104 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862107 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862109 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862111 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862114 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862117 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862119 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862123 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862126 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862129 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862132 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862135 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862139 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862142 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862144 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862147 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862150 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:30.866817 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862153 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862156 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862158 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862161 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862164 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862166 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862169 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862171 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862173 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862176 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862179 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862181 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862183 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862186 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862190 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862194 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862196 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862199 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862202 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862205 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:30.867312 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862280 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862290 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862301 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862307 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862314 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862317 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862322 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862326 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862330 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862333 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862337 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862341 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862344 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862347 2567 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862350 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862353 2567 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862357 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862360 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862364 2567 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862367 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862370 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862373 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862376 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862380 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:46:30.867792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862383 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862385 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862389 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862392 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862395 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862398 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862401 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862403 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862407 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862411 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862414 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862416 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862419 2567 flags.go:64] FLAG: --enable-server="true" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862422 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862427 2567 flags.go:64] FLAG: --event-burst="100" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862430 2567 flags.go:64] FLAG: --event-qps="50" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862432 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862439 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862442 2567 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862446 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862449 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862452 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862455 2567 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862458 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862461 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:46:30.868388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862465 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862468 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862471 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862474 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862477 2567 flags.go:64] FLAG: --feature-gates="" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862480 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862483 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862486 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862490 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862493 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862495 2567 flags.go:64] FLAG: --help="false" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862498 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-128-144.ec2.internal" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862501 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862504 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862507 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862510 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862513 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862516 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862519 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862522 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862525 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862528 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862530 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862534 2567 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:46:30.869064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862538 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862541 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862544 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862547 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862550 2567 flags.go:64] FLAG: --lock-file="" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862553 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862556 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862559 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862564 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862567 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862570 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862573 2567 flags.go:64] FLAG: --logging-format="text" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862576 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862579 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862582 2567 flags.go:64] FLAG: --manifest-url="" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862585 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862589 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862592 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862597 2567 flags.go:64] FLAG: --max-pods="110" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862600 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862602 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862605 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862608 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862611 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862614 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:46:30.869699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862617 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862625 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862628 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862631 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862634 2567 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862637 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862643 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862646 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862650 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862653 2567 flags.go:64] FLAG: --port="10250" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862656 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862660 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa0a8df406462dcb" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862663 2567 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862666 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862668 2567 flags.go:64] FLAG: --register-node="true" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862671 2567 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862675 2567 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862678 2567 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862681 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862684 2567 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862688 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862691 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862693 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862696 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862700 2567 flags.go:64] FLAG: --runonce="false" Jul 07 16:46:30.870345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862702 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862705 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862708 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862711 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862714 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862717 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862720 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862723 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862726 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862728 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862731 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862734 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862737 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862740 2567 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862743 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862750 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862753 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862756 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862760 2567 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862763 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862766 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862769 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862773 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862776 2567 flags.go:64] FLAG: --v="2" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862780 2567 flags.go:64] FLAG: --version="false" Jul 07 16:46:30.870960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862786 2567 flags.go:64] FLAG: --vmodule="" Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862789 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.862793 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862940 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862944 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862948 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862951 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862954 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862956 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862960 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862964 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862966 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862969 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862985 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862988 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862991 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862994 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862996 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.862999 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:30.871603 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863002 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863005 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863007 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863013 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863016 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863018 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863021 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863024 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863026 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863029 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863032 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863035 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863037 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863040 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863044 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863047 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863049 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863052 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863054 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863057 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:30.872230 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863059 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863062 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863064 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863067 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863069 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863072 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863074 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863077 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863080 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863082 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863085 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863087 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863090 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863092 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863094 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863100 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863102 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863105 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863108 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863110 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:30.872711 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863113 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863116 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863118 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863121 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863124 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863126 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863129 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863132 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863134 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863137 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863140 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863142 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863145 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863148 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863152 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863155 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863157 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863160 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863162 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:30.873231 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863165 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863168 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863170 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863172 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863175 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863177 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863180 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863183 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863188 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863190 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863193 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863197 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863200 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863203 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863206 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863209 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863211 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863214 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863217 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:30.873694 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863219 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863222 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863225 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863227 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.863230 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.863751 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.870751 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.870769 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.870790 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.870795 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870859 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870864 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870868 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870871 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870874 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:30.874181 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870877 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870879 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870882 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870885 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870888 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870891 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870895 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870898 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870900 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870903 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870906 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870909 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870912 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870915 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870917 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870920 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870923 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870926 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870928 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:30.874557 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870932 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870935 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870937 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870940 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870943 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870947 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870952 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870955 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870957 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870960 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870963 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870965 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870968 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870986 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870990 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870993 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870996 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.870998 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871001 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871004 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:30.875078 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871007 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871009 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871012 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871014 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871017 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871020 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871022 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871025 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871027 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871030 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871033 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871035 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871038 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871041 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871043 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871046 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871049 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871053 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871056 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:30.875565 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871060 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871064 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871066 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871069 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871072 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871074 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871077 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871079 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871082 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871085 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871087 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871090 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871092 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871096 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871098 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871101 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871103 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871106 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871108 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871111 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:30.876097 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871113 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871116 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871118 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871121 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871123 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871126 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871129 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871132 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871135 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871137 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871141 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871144 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871147 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871151 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871154 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:30.876581 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871157 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.871164 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871280 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871285 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871288 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871292 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871295 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871298 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871303 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871305 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871309 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871311 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871314 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871316 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871319 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:30.876962 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871321 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871324 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871326 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871329 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871332 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871334 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871337 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871339 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871342 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871344 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871347 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871350 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871353 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871356 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871359 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871361 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871364 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871366 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871369 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871371 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:30.877359 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871374 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871377 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871379 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871381 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871384 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871386 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871389 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871391 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871394 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871396 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871399 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871401 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871404 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871406 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871409 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871411 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871413 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871416 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871418 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871421 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:30.877870 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871424 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871427 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871429 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871433 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871435 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871438 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871441 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871443 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871446 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871448 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871451 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871453 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871456 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871458 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871461 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871463 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871466 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871468 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871471 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:30.878379 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871475 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871478 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871481 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871484 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871487 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871490 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871492 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871494 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871497 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871500 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871502 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871505 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871507 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871510 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871512 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871515 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871518 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871522 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871524 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871527 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:30.878956 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871530 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871532 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871536 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871539 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871542 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871545 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:30.871548 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.871554 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.871686 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.873891 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.875169 2567 server.go:1019] "Starting client certificate rotation" Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.875272 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.875305 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:46:30.879527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.877805 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:46:30.882887 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.882859 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:46:30.896256 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.896228 2567 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:46:30.898568 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.898539 2567 log.go:25] "Validated CRI v1 image API" Jul 07 16:46:30.899367 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.899349 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:46:30.902639 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.902613 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a0b2453e-6956-41c3-bd5c-75c67283c0b0:/dev/nvme0n1p3 f593ada8-204e-4633-8d6e-db8d47e82613:/dev/nvme0n1p4] Jul 07 16:46:30.902716 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.902635 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:46:30.908777 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.908640 2567 manager.go:216] Machine: {Timestamp:2026-07-07 16:46:30.907441216 +0000 UTC m=+0.338109243 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099146 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22bfc03cd844c724a760e7ce087edd SystemUUID:ec22bfc0-3cd8-44c7-24a7-60e7ce087edd BootID:e183d499-d9bc-485a-9687-1ec5ae498ad9 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:6d:64:ae:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:6d:64:ae:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:92:29:49:30:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:46:30.908777 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.908762 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:46:30.908912 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.908866 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:46:30.909406 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.909387 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:46:30.912015 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.911984 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:46:30.912175 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.912021 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:46:30.912714 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.912700 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:46:30.912758 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.912717 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:46:30.912758 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.912732 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:46:30.913520 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.913506 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:46:30.915034 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.915020 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:46:30.918104 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918086 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:46:30.918246 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918235 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:46:30.918279 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918271 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:46:30.918307 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918286 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:46:30.918307 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918305 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:46:30.918373 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918318 2567 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:46:30.918373 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918331 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:46:30.918869 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918843 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:46:30.918937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.918873 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:46:30.920934 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.920913 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:46:30.922929 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.922913 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:46:30.923021 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.922945 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:46:30.924205 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924193 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924209 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924216 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924221 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924231 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924237 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924245 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924250 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924258 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924263 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924272 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:46:30.924276 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.924277 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:46:30.925010 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.925000 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:46:30.925049 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.925011 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:46:30.928296 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.928282 2567 server.go:1268] "Started kubelet" Jul 07 16:46:30.928382 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.928352 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:46:30.928479 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.928429 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:46:30.928520 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.928503 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:46:30.929325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.929291 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:46:30.929325 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.929314 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:46:30.929662 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.929644 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:46:30.930218 ip-10-0-128-144 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:46:30.932485 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.932316 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:46:30.934445 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.934418 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:46:30.935122 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.935109 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:46:30.938932 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.938909 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:46:30.938932 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.938920 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:46:30.939105 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.939048 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:30.939531 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.939494 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:46:30.939531 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.939529 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:46:30.939689 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.939500 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:46:30.939750 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.939695 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:46:30.939750 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.939704 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:46:30.940157 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940141 2567 factory.go:55] Registering systemd factory Jul 07 16:46:30.940157 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940159 2567 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:46:30.940504 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940420 2567 factory.go:153] Registering CRI-O factory Jul 07 16:46:30.940504 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940436 2567 factory.go:223] Registration of the crio container factory successfully Jul 07 16:46:30.940504 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940499 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:46:30.940752 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940527 2567 factory.go:103] Registering Raw factory Jul 07 16:46:30.940752 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.940544 2567 manager.go:1196] Started watching for new ooms in manager Jul 07 16:46:30.941265 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.941247 2567 manager.go:349] Starting recovery of all containers Jul 07 16:46:30.945024 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.944993 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 16:46:30.947593 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.947562 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:46:30.948241 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.948207 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:46:30.948581 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.947663 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-144.ec2.internal.18c00fc4ee827501 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-144.ec2.internal,UID:ip-10-0-128-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-144.ec2.internal,},FirstTimestamp:2026-07-07 16:46:30.928250113 +0000 UTC m=+0.358918182,LastTimestamp:2026-07-07 16:46:30.928250113 +0000 UTC m=+0.358918182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-144.ec2.internal,}" Jul 07 16:46:30.949567 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.949540 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bvg8" Jul 07 16:46:30.950576 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.950405 2567 manager.go:354] Recovery completed Jul 07 16:46:30.952652 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.952625 2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 16:46:30.956202 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.956181 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:30.958091 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958075 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:30.958165 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958105 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:30.958165 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958118 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:30.958687 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958672 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:46:30.958740 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958689 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:46:30.958740 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958694 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:30.958740 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.958711 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:46:30.959420 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.959406 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:30.959470 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.959432 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:30.959470 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.959443 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:30.960089 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.960078 2567 policy_none.go:49] "None policy: Start" Jul 07 16:46:30.960124 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.960094 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:46:30.960124 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.960104 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:46:30.961113 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.961099 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5bvg8" Jul 07 16:46:30.961352 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:30.961341 2567 policy_none.go:47] "Start" Jul 07 16:46:30.961729 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:30.961645 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-144.ec2.internal.18c00fc4f049ce00 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-144.ec2.internal,UID:ip-10-0-128-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-144.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-144.ec2.internal,},FirstTimestamp:2026-07-07 16:46:30.958091776 +0000 UTC m=+0.388759792,LastTimestamp:2026-07-07 16:46:30.958091776 +0000 UTC m=+0.388759792,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-144.ec2.internal,}" Jul 07 16:46:31.012664 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.012640 2567 manager.go:337] "Starting Device Plugin manager" Jul 07 16:46:31.012793 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.012700 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:46:31.012793 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.012714 2567 server.go:87] "Starting device plugin registration server" Jul 07 16:46:31.013068 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.013053 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:46:31.013121 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.013072 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:46:31.013168 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.013151 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:46:31.013241 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.013231 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:46:31.013241 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.013241 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:46:31.013846 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.013826 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:46:31.013944 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.013871 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.113493 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.113400 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:31.114742 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.114465 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:31.114742 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.114497 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:31.114742 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.114510 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:31.114742 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.114558 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.131171 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.131139 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:46:31.131285 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.131192 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:46:31.131285 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.131222 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:46:31.131285 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.131264 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:46:31.134533 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.134512 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:31.135446 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.135427 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.135534 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.135453 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-144.ec2.internal\": node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.168206 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.168173 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.231413 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.231382 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal"] Jul 07 16:46:31.231493 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.231461 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:31.232480 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.232462 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:31.232591 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.232499 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:31.232591 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.232510 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:31.234117 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234103 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:31.234250 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.234307 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234260 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:31.234887 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234869 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:31.234985 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234871 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:31.234985 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234928 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:31.234985 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234941 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:31.234985 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234902 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:31.235179 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.234992 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:31.236142 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.236127 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.236223 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.236154 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:31.237895 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.237881 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:31.238000 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.237907 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:31.238000 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.237921 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:31.241312 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.241295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cfbdbc2e1882e9bdf10f2ad6c36020f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-144.ec2.internal\" (UID: \"6cfbdbc2e1882e9bdf10f2ad6c36020f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.241366 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.241319 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64313b6136b863194f622d1b3b2a5104-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"64313b6136b863194f622d1b3b2a5104\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.241366 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.241340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64313b6136b863194f622d1b3b2a5104-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"64313b6136b863194f622d1b3b2a5104\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.251775 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.251747 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-144.ec2.internal\" not found" node="ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.255415 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.255395 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-144.ec2.internal\" not found" node="ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.268303 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.268274 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.341481 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.341450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64313b6136b863194f622d1b3b2a5104-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"64313b6136b863194f622d1b3b2a5104\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.341481 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.341483 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cfbdbc2e1882e9bdf10f2ad6c36020f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-144.ec2.internal\" (UID: \"6cfbdbc2e1882e9bdf10f2ad6c36020f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.341630 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.341499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64313b6136b863194f622d1b3b2a5104-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"64313b6136b863194f622d1b3b2a5104\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.341630 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.341558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64313b6136b863194f622d1b3b2a5104-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"64313b6136b863194f622d1b3b2a5104\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.341691 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.341632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/64313b6136b863194f622d1b3b2a5104-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal\" (UID: \"64313b6136b863194f622d1b3b2a5104\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.341691 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.341677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cfbdbc2e1882e9bdf10f2ad6c36020f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-144.ec2.internal\" (UID: \"6cfbdbc2e1882e9bdf10f2ad6c36020f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.369345 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.369269 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.470125 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.470087 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.555727 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.555694 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.558254 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.558230 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 07 16:46:31.570539 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.570515 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.671160 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.671064 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.771682 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.771647 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.845992 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.845941 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:31.872396 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.872355 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.874529 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.874508 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:46:31.874712 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.874690 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:46:31.874752 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.874690 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:46:31.963215 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.963172 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:41:30 +0000 UTC" deadline="2028-04-02 02:53:19.613631888 +0000 UTC" Jul 07 16:46:31.963391 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.963209 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15226h6m47.650426335s" Jul 07 16:46:31.973344 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:31.973317 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:31.982025 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:31.981992 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:32.005774 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.005742 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:32.007172 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.007148 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:32.007304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.007189 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:32.007304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.007203 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:32.055700 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:32.055667 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64313b6136b863194f622d1b3b2a5104.slice/crio-33a89c831fde5656640cf40aa4e3ab1a9e4322f0dc1a3b7f9d47b4eb0fade70e WatchSource:0}: Error finding container 33a89c831fde5656640cf40aa4e3ab1a9e4322f0dc1a3b7f9d47b4eb0fade70e: Status 404 returned error can't find the container with id 33a89c831fde5656640cf40aa4e3ab1a9e4322f0dc1a3b7f9d47b4eb0fade70e Jul 07 16:46:32.055886 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:32.055870 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfbdbc2e1882e9bdf10f2ad6c36020f.slice/crio-29d44f857c7cb0202843162ffffe73b8452777e27da749f1403143db2f4f60eb WatchSource:0}: Error finding container 29d44f857c7cb0202843162ffffe73b8452777e27da749f1403143db2f4f60eb: Status 404 returned error can't find the container with id 29d44f857c7cb0202843162ffffe73b8452777e27da749f1403143db2f4f60eb Jul 07 16:46:32.059558 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.059535 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:46:32.073807 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.073776 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:32.135299 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.135238 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"64313b6136b863194f622d1b3b2a5104","Type":"ContainerStarted","Data":"33a89c831fde5656640cf40aa4e3ab1a9e4322f0dc1a3b7f9d47b4eb0fade70e"} Jul 07 16:46:32.136215 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.136190 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" event={"ID":"6cfbdbc2e1882e9bdf10f2ad6c36020f","Type":"ContainerStarted","Data":"29d44f857c7cb0202843162ffffe73b8452777e27da749f1403143db2f4f60eb"} Jul 07 16:46:32.174794 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.174763 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:32.275320 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.275237 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:32.375832 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.375801 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-144.ec2.internal\" not found" Jul 07 16:46:32.461089 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.461051 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:32.539607 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.539531 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" Jul 07 16:46:32.550003 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.549958 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:46:32.551309 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.551286 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" Jul 07 16:46:32.572599 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.572567 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:46:32.686314 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.686281 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:32.919329 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.919233 2567 apiserver.go:52] "Watching apiserver" Jul 07 16:46:32.930768 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.930728 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:46:32.931238 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.931209 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rjn6b","kube-system/konnectivity-agent-m2msn","kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal","openshift-multus/multus-jktxz","openshift-multus/network-metrics-daemon-d4v72","openshift-network-diagnostics/network-check-target-ctklw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4","openshift-cluster-node-tuning-operator/tuned-w4f26","openshift-dns/node-resolver-b5rp4","openshift-image-registry/node-ca-nlkjn","openshift-multus/multus-additional-cni-plugins-mp6dk","openshift-network-operator/iptables-alerter-xc7ds","openshift-ovn-kubernetes/ovnkube-node-rq27k"] Jul 07 16:46:32.932986 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.932936 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:32.934202 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.934180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:32.935631 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.935514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.935631 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.935538 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.935631 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.935569 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.935631 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.935580 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p979k\"" Jul 07 16:46:32.936224 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.936149 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.936224 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.936211 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.936601 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.936582 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m4drx\"" Jul 07 16:46:32.936694 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.936607 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:46:32.936969 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.936942 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.938396 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.938374 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.939325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939304 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.939420 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939348 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:46:32.939526 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939508 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.939526 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939522 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:46:32.939634 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939553 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.939634 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939609 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:46:32.939634 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939620 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:46:32.939818 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.939818 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939815 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:32.939924 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.939879 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:32.939998 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.939924 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:46:32.940196 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.940175 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4w7jn\"" Jul 07 16:46:32.940264 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.940178 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rhppj\"" Jul 07 16:46:32.940317 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.940287 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:46:32.941269 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.941251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.941368 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.941352 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:46:32.941368 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.941364 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:46:32.941809 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.941720 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.941895 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.941815 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.942116 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.942099 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hkp9n\"" Jul 07 16:46:32.942765 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.942751 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:32.942832 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.942804 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:32.944141 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.944125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:32.945586 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.945564 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.946044 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.946026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:32.946396 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:32.946152 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:32.946396 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.946297 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.946713 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.946540 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:46:32.946713 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.946605 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h2hv9\"" Jul 07 16:46:32.946713 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.946539 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:46:32.946858 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.946806 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8w826\"" Jul 07 16:46:32.947824 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.947804 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:32.949537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.949520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:32.949931 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.949910 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:46:32.950033 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.949946 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:46:32.950033 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.949964 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:46:32.950033 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d388f2ee-dab7-44c1-b872-4fe5165525bf-hosts-file\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:32.950174 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-registration-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.950174 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-ovn\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.950174 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8wgv\" (UniqueName: \"kubernetes.io/projected/07c75f7c-b80f-4180-9712-9173ea97f61d-kube-api-access-f8wgv\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.950325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-cni-multus\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950213 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6s7cq\"" Jul 07 16:46:32.950325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-socket-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.950325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950260 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysctl-conf\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.950325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-systemd-units\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.950325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-kubelet\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-etc-kubernetes\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-kubernetes\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-sys\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-etc-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-ovnkube-config\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-os-release\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950602 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-conf-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-log-socket\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af920d97-b5a9-433e-a727-3f7d59b78d8c-cni-binary-copy\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-multus-certs\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950691 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-iptables-alerter-script\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d388f2ee-dab7-44c1-b872-4fe5165525bf-tmp-dir\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-run\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-netns\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.950919 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-cni-bin\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.950998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc42n\" (UniqueName: \"kubernetes.io/projected/4593a514-cfc9-4c58-a22b-cafbe7cfac94-kube-api-access-xc42n\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-run-netns\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-env-overrides\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951065 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-system-cni-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951080 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9gl\" (UniqueName: \"kubernetes.io/projected/af920d97-b5a9-433e-a727-3f7d59b78d8c-kube-api-access-kr9gl\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysconfig\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bf1baca-9926-46e7-815b-60af30ab3040-etc-tuned\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-var-lib-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-sys-fs\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-lib-modules\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951308 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-var-lib-kubelet\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jz76\" (UniqueName: \"kubernetes.io/projected/0bf1baca-9926-46e7-815b-60af30ab3040-kube-api-access-2jz76\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-kubelet\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-socket-dir-parent\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkb2m\" (UniqueName: \"kubernetes.io/projected/85752b58-34a0-4ef1-b051-3f9281c39bd9-kube-api-access-wkb2m\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64frc\" (UniqueName: \"kubernetes.io/projected/d388f2ee-dab7-44c1-b872-4fe5165525bf-kube-api-access-64frc\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-host-slash\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-modprobe-d\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-node-log\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-device-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-cni-netd\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951684 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-cni-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-k8s-cni-cncf-io\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951783 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-hostroot\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysctl-d\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.951937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-systemd\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-systemd\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951970 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951995 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hjmkd\"" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.951998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-cni-bin\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-daemon-config\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf1baca-9926-46e7-815b-60af30ab3040-tmp\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-slash\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-ovnkube-script-lib\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-cnibin\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-host\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07c75f7c-b80f-4180-9712-9173ea97f61d-ovn-node-metrics-cert\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:32.952572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.952258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57mr\" (UniqueName: \"kubernetes.io/projected/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-kube-api-access-j57mr\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:32.957713 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.957689 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:46:32.985288 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.985259 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvkt2" Jul 07 16:46:32.997460 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:32.997436 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mvkt2" Jul 07 16:46:33.040759 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.040730 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:46:33.053106 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-netns\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053106 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-cni-bin\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc42n\" (UniqueName: \"kubernetes.io/projected/4593a514-cfc9-4c58-a22b-cafbe7cfac94-kube-api-access-xc42n\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053177 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-netns\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-run-netns\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-cni-bin\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-run-netns\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053280 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-env-overrides\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053307 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.053348 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053403 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-system-cni-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9gl\" (UniqueName: \"kubernetes.io/projected/af920d97-b5a9-433e-a727-3f7d59b78d8c-kube-api-access-kr9gl\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysconfig\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bf1baca-9926-46e7-815b-60af30ab3040-etc-tuned\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053486 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053463 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-system-cni-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-var-lib-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053551 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-var-lib-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-sys-fs\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-lib-modules\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053619 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-var-lib-kubelet\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysconfig\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-sys-fs\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-var-lib-kubelet\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.053829 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jz76\" (UniqueName: \"kubernetes.io/projected/0bf1baca-9926-46e7-815b-60af30ab3040-kube-api-access-2jz76\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-kubelet\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-kubelet\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4tc\" (UniqueName: \"kubernetes.io/projected/d5f7c46e-368e-4188-a0d0-398adabefb22-kube-api-access-hv4tc\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-lib-modules\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-socket-dir-parent\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053837 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkb2m\" (UniqueName: \"kubernetes.io/projected/85752b58-34a0-4ef1-b051-3f9281c39bd9-kube-api-access-wkb2m\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-socket-dir-parent\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-env-overrides\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053859 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64frc\" (UniqueName: \"kubernetes.io/projected/d388f2ee-dab7-44c1-b872-4fe5165525bf-kube-api-access-64frc\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.053965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-host-slash\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054007 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-modprobe-d\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-host-slash\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-node-log\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.054655 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054077 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-node-log\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-device-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054107 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-cni-netd\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-modprobe-d\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054132 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-device-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/289dcbab-3775-4b26-a054-eb399c271217-dbus\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054162 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-cni-netd\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-cni-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-k8s-cni-cncf-io\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-hostroot\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054317 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-cni-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysctl-d\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-systemd\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-systemd\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054378 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-hostroot\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.055347 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-cni-bin\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-k8s-cni-cncf-io\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-daemon-config\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf1baca-9926-46e7-815b-60af30ab3040-tmp\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-slash\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054524 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-systemd\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-ovnkube-script-lib\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5nc\" (UniqueName: \"kubernetes.io/projected/e06176c0-657d-4f54-842b-1d72eb4b0ed5-kube-api-access-2l5nc\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-cnibin\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-host\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07c75f7c-b80f-4180-9712-9173ea97f61d-ovn-node-metrics-cert\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57mr\" (UniqueName: \"kubernetes.io/projected/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-kube-api-access-j57mr\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d388f2ee-dab7-44c1-b872-4fe5165525bf-hosts-file\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-registration-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-ovn\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8wgv\" (UniqueName: \"kubernetes.io/projected/07c75f7c-b80f-4180-9712-9173ea97f61d-kube-api-access-f8wgv\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.056258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054839 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e06176c0-657d-4f54-842b-1d72eb4b0ed5-host\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054865 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-cni-multus\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-socket-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysctl-conf\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054962 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-daemon-config\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.054966 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-slash\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055013 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-run-ovn\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysctl-conf\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055134 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-socket-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-ovnkube-script-lib\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055150 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-sysctl-d\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055144 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-systemd\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-cnibin\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-host\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-systemd-units\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-host-cni-bin\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057084 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d388f2ee-dab7-44c1-b872-4fe5165525bf-hosts-file\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055317 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-systemd-units\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-kubelet\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-etc-kubernetes\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-kubernetes\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055404 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-etc-kubernetes\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-sys\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055437 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-etc-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4593a514-cfc9-4c58-a22b-cafbe7cfac94-registration-dir\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055451 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-etc-kubernetes\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-kubelet\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-ovnkube-config\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055491 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-system-cni-dir\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055491 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-var-lib-cni-multus\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055508 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-etc-openvswitch\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-cnibin\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.057936 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdc99f35-3687-4595-a2ba-a99ea56d6639-agent-certs\") pod \"konnectivity-agent-m2msn\" (UID: \"bdc99f35-3687-4595-a2ba-a99ea56d6639\") " pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e06176c0-657d-4f54-842b-1d72eb4b0ed5-serviceca\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-os-release\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055583 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-sys\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-conf-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-log-socket\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-os-release\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-os-release\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055723 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-multus-conf-dir\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/07c75f7c-b80f-4180-9712-9173ea97f61d-log-socket\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af920d97-b5a9-433e-a727-3f7d59b78d8c-cni-binary-copy\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-multus-certs\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-iptables-alerter-script\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af920d97-b5a9-433e-a727-3f7d59b78d8c-host-run-multus-certs\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdc99f35-3687-4595-a2ba-a99ea56d6639-konnectivity-ca\") pod \"konnectivity-agent-m2msn\" (UID: \"bdc99f35-3687-4595-a2ba-a99ea56d6639\") " pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/289dcbab-3775-4b26-a054-eb399c271217-kubelet-config\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.058747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.055997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/07c75f7c-b80f-4180-9712-9173ea97f61d-ovnkube-config\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d388f2ee-dab7-44c1-b872-4fe5165525bf-tmp-dir\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-run\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056128 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bf1baca-9926-46e7-815b-60af30ab3040-run\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.056140 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.056298 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:33.556277031 +0000 UTC m=+2.986945051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af920d97-b5a9-433e-a727-3f7d59b78d8c-cni-binary-copy\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056418 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d388f2ee-dab7-44c1-b872-4fe5165525bf-tmp-dir\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.056510 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-iptables-alerter-script\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.057466 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bf1baca-9926-46e7-815b-60af30ab3040-etc-tuned\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.057890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/07c75f7c-b80f-4180-9712-9173ea97f61d-ovn-node-metrics-cert\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.059404 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.058697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bf1baca-9926-46e7-815b-60af30ab3040-tmp\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.064157 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.064133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc42n\" (UniqueName: \"kubernetes.io/projected/4593a514-cfc9-4c58-a22b-cafbe7cfac94-kube-api-access-xc42n\") pod \"aws-ebs-csi-driver-node-cwbc4\" (UID: \"4593a514-cfc9-4c58-a22b-cafbe7cfac94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.069565 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.069449 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64frc\" (UniqueName: \"kubernetes.io/projected/d388f2ee-dab7-44c1-b872-4fe5165525bf-kube-api-access-64frc\") pod \"node-resolver-b5rp4\" (UID: \"d388f2ee-dab7-44c1-b872-4fe5165525bf\") " pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.069565 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.069514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9gl\" (UniqueName: \"kubernetes.io/projected/af920d97-b5a9-433e-a727-3f7d59b78d8c-kube-api-access-kr9gl\") pod \"multus-jktxz\" (UID: \"af920d97-b5a9-433e-a727-3f7d59b78d8c\") " pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.071051 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.070970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jz76\" (UniqueName: \"kubernetes.io/projected/0bf1baca-9926-46e7-815b-60af30ab3040-kube-api-access-2jz76\") pod \"tuned-w4f26\" (UID: \"0bf1baca-9926-46e7-815b-60af30ab3040\") " pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.071428 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.071396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57mr\" (UniqueName: \"kubernetes.io/projected/c588c9f2-5efe-46fa-b7ec-9e5fe53c4214-kube-api-access-j57mr\") pod \"iptables-alerter-xc7ds\" (UID: \"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214\") " pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.071428 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.071424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkb2m\" (UniqueName: \"kubernetes.io/projected/85752b58-34a0-4ef1-b051-3f9281c39bd9-kube-api-access-wkb2m\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:33.071900 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.071881 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8wgv\" (UniqueName: \"kubernetes.io/projected/07c75f7c-b80f-4180-9712-9173ea97f61d-kube-api-access-f8wgv\") pod \"ovnkube-node-rq27k\" (UID: \"07c75f7c-b80f-4180-9712-9173ea97f61d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.156696 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e06176c0-657d-4f54-842b-1d72eb4b0ed5-serviceca\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.156865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-os-release\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.156865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156813 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-os-release\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.156865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdc99f35-3687-4595-a2ba-a99ea56d6639-konnectivity-ca\") pod \"konnectivity-agent-m2msn\" (UID: \"bdc99f35-3687-4595-a2ba-a99ea56d6639\") " pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.157067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/289dcbab-3775-4b26-a054-eb399c271217-kubelet-config\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.157067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.156993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:33.157067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157024 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4tc\" (UniqueName: \"kubernetes.io/projected/d5f7c46e-368e-4188-a0d0-398adabefb22-kube-api-access-hv4tc\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157077 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157110 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/289dcbab-3775-4b26-a054-eb399c271217-kubelet-config\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/289dcbab-3775-4b26-a054-eb399c271217-dbus\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5nc\" (UniqueName: \"kubernetes.io/projected/e06176c0-657d-4f54-842b-1d72eb4b0ed5-kube-api-access-2l5nc\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e06176c0-657d-4f54-842b-1d72eb4b0ed5-host\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157274 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/289dcbab-3775-4b26-a054-eb399c271217-dbus\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.157304 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157286 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e06176c0-657d-4f54-842b-1d72eb4b0ed5-serviceca\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-system-cni-dir\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157326 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-system-cni-dir\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-cnibin\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdc99f35-3687-4595-a2ba-a99ea56d6639-agent-certs\") pod \"konnectivity-agent-m2msn\" (UID: \"bdc99f35-3687-4595-a2ba-a99ea56d6639\") " pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.157373 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.157446 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:33.657428401 +0000 UTC m=+3.088096406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157492 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdc99f35-3687-4595-a2ba-a99ea56d6639-konnectivity-ca\") pod \"konnectivity-agent-m2msn\" (UID: \"bdc99f35-3687-4595-a2ba-a99ea56d6639\") " pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-cni-binary-copy\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157591 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-cnibin\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e06176c0-657d-4f54-842b-1d72eb4b0ed5-host\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.157719 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.157669 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5f7c46e-368e-4188-a0d0-398adabefb22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.158240 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.158109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5f7c46e-368e-4188-a0d0-398adabefb22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.160139 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.160112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdc99f35-3687-4595-a2ba-a99ea56d6639-agent-certs\") pod \"konnectivity-agent-m2msn\" (UID: \"bdc99f35-3687-4595-a2ba-a99ea56d6639\") " pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.166279 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.166248 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:33.166431 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.166286 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:33.166431 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.166302 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:33.166431 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.166390 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:33.666369644 +0000 UTC m=+3.097037664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:33.169617 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.169552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5nc\" (UniqueName: \"kubernetes.io/projected/e06176c0-657d-4f54-842b-1d72eb4b0ed5-kube-api-access-2l5nc\") pod \"node-ca-nlkjn\" (UID: \"e06176c0-657d-4f54-842b-1d72eb4b0ed5\") " pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.169617 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.169553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4tc\" (UniqueName: \"kubernetes.io/projected/d5f7c46e-368e-4188-a0d0-398adabefb22-kube-api-access-hv4tc\") pod \"multus-additional-cni-plugins-mp6dk\" (UID: \"d5f7c46e-368e-4188-a0d0-398adabefb22\") " pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.250879 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.250842 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b5rp4" Jul 07 16:46:33.260219 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.260191 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xc7ds" Jul 07 16:46:33.269405 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.269374 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:33.275439 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.275413 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" Jul 07 16:46:33.281518 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.281493 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jktxz" Jul 07 16:46:33.288575 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.288545 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4f26" Jul 07 16:46:33.295114 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.295087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:33.302293 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.302263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nlkjn" Jul 07 16:46:33.307144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.307112 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" Jul 07 16:46:33.560745 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.560713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:33.560937 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.560895 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:33.561038 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.561002 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:34.560964698 +0000 UTC m=+3.991632701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:33.661344 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.661307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:33.661532 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.661447 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:33.661532 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.661505 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:34.661491899 +0000 UTC m=+4.092159903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:33.762141 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:33.762095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:33.762332 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.762268 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:33.762332 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.762299 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:33.762332 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.762312 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:33.762486 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:33.762383 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:34.762363463 +0000 UTC m=+4.193031485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:33.866070 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.866040 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c75f7c_b80f_4180_9712_9173ea97f61d.slice/crio-42b27485a9bc32401295f32b33ee14e05c795843aef6bc1f319a3c5a1656af18 WatchSource:0}: Error finding container 42b27485a9bc32401295f32b33ee14e05c795843aef6bc1f319a3c5a1656af18: Status 404 returned error can't find the container with id 42b27485a9bc32401295f32b33ee14e05c795843aef6bc1f319a3c5a1656af18 Jul 07 16:46:33.868255 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.868112 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf1baca_9926_46e7_815b_60af30ab3040.slice/crio-ffb4e767ff53c6db5be500c118691de77eb4bb76c7d19ba3a57df27ccd42a97b WatchSource:0}: Error finding container ffb4e767ff53c6db5be500c118691de77eb4bb76c7d19ba3a57df27ccd42a97b: Status 404 returned error can't find the container with id ffb4e767ff53c6db5be500c118691de77eb4bb76c7d19ba3a57df27ccd42a97b Jul 07 16:46:33.871264 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.871242 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf920d97_b5a9_433e_a727_3f7d59b78d8c.slice/crio-20929c5cce9adacf393cea21ac3d12d96cab41c9b7625b60e4a7a957e95a9eec WatchSource:0}: Error finding container 20929c5cce9adacf393cea21ac3d12d96cab41c9b7625b60e4a7a957e95a9eec: Status 404 returned error can't find the container with id 20929c5cce9adacf393cea21ac3d12d96cab41c9b7625b60e4a7a957e95a9eec Jul 07 16:46:33.873211 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.873184 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc588c9f2_5efe_46fa_b7ec_9e5fe53c4214.slice/crio-9f3b5074ae351661d2df9bb7df4e8d02b05875d7cac95ae435eb2e57be81ce93 WatchSource:0}: Error finding container 9f3b5074ae351661d2df9bb7df4e8d02b05875d7cac95ae435eb2e57be81ce93: Status 404 returned error can't find the container with id 9f3b5074ae351661d2df9bb7df4e8d02b05875d7cac95ae435eb2e57be81ce93 Jul 07 16:46:33.873964 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.873946 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd388f2ee_dab7_44c1_b872_4fe5165525bf.slice/crio-7ac8d936d47e425617adc53a6d91b59f338adf406b9d46bcd7efdcf7090b92a2 WatchSource:0}: Error finding container 7ac8d936d47e425617adc53a6d91b59f338adf406b9d46bcd7efdcf7090b92a2: Status 404 returned error can't find the container with id 7ac8d936d47e425617adc53a6d91b59f338adf406b9d46bcd7efdcf7090b92a2 Jul 07 16:46:33.874904 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.874883 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f7c46e_368e_4188_a0d0_398adabefb22.slice/crio-228f99369b9029ad98fb52f4f04965cdc653d6795e3c9f744f50f7e4b127ddd6 WatchSource:0}: Error finding container 228f99369b9029ad98fb52f4f04965cdc653d6795e3c9f744f50f7e4b127ddd6: Status 404 returned error can't find the container with id 228f99369b9029ad98fb52f4f04965cdc653d6795e3c9f744f50f7e4b127ddd6 Jul 07 16:46:33.876469 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.876274 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4593a514_cfc9_4c58_a22b_cafbe7cfac94.slice/crio-c2517a3f57eeca982bcb067e80da31484417d226d808e76a060b0ef0dc5b2d4f WatchSource:0}: Error finding container c2517a3f57eeca982bcb067e80da31484417d226d808e76a060b0ef0dc5b2d4f: Status 404 returned error can't find the container with id c2517a3f57eeca982bcb067e80da31484417d226d808e76a060b0ef0dc5b2d4f Jul 07 16:46:33.878064 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.877703 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc99f35_3687_4595_a2ba_a99ea56d6639.slice/crio-33149039d5c1d19fe0b0dfc8e30a5ec6039a34195f6c3f18d0e6b5bba0f37894 WatchSource:0}: Error finding container 33149039d5c1d19fe0b0dfc8e30a5ec6039a34195f6c3f18d0e6b5bba0f37894: Status 404 returned error can't find the container with id 33149039d5c1d19fe0b0dfc8e30a5ec6039a34195f6c3f18d0e6b5bba0f37894 Jul 07 16:46:33.878518 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:46:33.878498 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06176c0_657d_4f54_842b_1d72eb4b0ed5.slice/crio-515c2944526299b0386c52482c8e9575c49a51a9c783969191dca448261bdc22 WatchSource:0}: Error finding container 515c2944526299b0386c52482c8e9575c49a51a9c783969191dca448261bdc22: Status 404 returned error can't find the container with id 515c2944526299b0386c52482c8e9575c49a51a9c783969191dca448261bdc22 Jul 07 16:46:34.000483 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.000283 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:41:32 +0000 UTC" deadline="2028-04-22 04:57:22.032046964 +0000 UTC" Jul 07 16:46:34.000483 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.000477 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15708h10m48.031573631s" Jul 07 16:46:34.131666 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.131637 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:34.131666 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.131662 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:34.131831 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.131760 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:34.131831 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.131792 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:34.131894 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.131861 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:34.131987 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.131947 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:34.140939 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.140905 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"64313b6136b863194f622d1b3b2a5104","Type":"ContainerStarted","Data":"f0b910ac0089463a2dc1983783e1bcfbc766f9b73f379454becb04bdbc921215"} Jul 07 16:46:34.142479 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.142451 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" event={"ID":"6cfbdbc2e1882e9bdf10f2ad6c36020f","Type":"ContainerStarted","Data":"f9ce37f17cf56ae04942ecaac3eabb8e7fdf974374793fa341fc3647b26d9831"} Jul 07 16:46:34.143495 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.143472 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nlkjn" event={"ID":"e06176c0-657d-4f54-842b-1d72eb4b0ed5","Type":"ContainerStarted","Data":"515c2944526299b0386c52482c8e9575c49a51a9c783969191dca448261bdc22"} Jul 07 16:46:34.144711 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.144683 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m2msn" event={"ID":"bdc99f35-3687-4595-a2ba-a99ea56d6639","Type":"ContainerStarted","Data":"33149039d5c1d19fe0b0dfc8e30a5ec6039a34195f6c3f18d0e6b5bba0f37894"} Jul 07 16:46:34.149406 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.149357 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" event={"ID":"4593a514-cfc9-4c58-a22b-cafbe7cfac94","Type":"ContainerStarted","Data":"c2517a3f57eeca982bcb067e80da31484417d226d808e76a060b0ef0dc5b2d4f"} Jul 07 16:46:34.150442 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.150415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerStarted","Data":"228f99369b9029ad98fb52f4f04965cdc653d6795e3c9f744f50f7e4b127ddd6"} Jul 07 16:46:34.151344 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.151326 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b5rp4" event={"ID":"d388f2ee-dab7-44c1-b872-4fe5165525bf","Type":"ContainerStarted","Data":"7ac8d936d47e425617adc53a6d91b59f338adf406b9d46bcd7efdcf7090b92a2"} Jul 07 16:46:34.152260 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.152241 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xc7ds" event={"ID":"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214","Type":"ContainerStarted","Data":"9f3b5074ae351661d2df9bb7df4e8d02b05875d7cac95ae435eb2e57be81ce93"} Jul 07 16:46:34.153177 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.153156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jktxz" event={"ID":"af920d97-b5a9-433e-a727-3f7d59b78d8c","Type":"ContainerStarted","Data":"20929c5cce9adacf393cea21ac3d12d96cab41c9b7625b60e4a7a957e95a9eec"} Jul 07 16:46:34.154267 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.154235 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4f26" event={"ID":"0bf1baca-9926-46e7-815b-60af30ab3040","Type":"ContainerStarted","Data":"ffb4e767ff53c6db5be500c118691de77eb4bb76c7d19ba3a57df27ccd42a97b"} Jul 07 16:46:34.155259 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.155239 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"42b27485a9bc32401295f32b33ee14e05c795843aef6bc1f319a3c5a1656af18"} Jul 07 16:46:34.174089 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.174025 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-144.ec2.internal" podStartSLOduration=2.174004589 podStartE2EDuration="2.174004589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:34.173215883 +0000 UTC m=+3.603883910" watchObservedRunningTime="2026-07-07 16:46:34.174004589 +0000 UTC m=+3.604672616" Jul 07 16:46:34.570034 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.569996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:34.570230 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.570146 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:34.570230 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.570212 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:36.570193131 +0000 UTC m=+6.000861137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:34.670741 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.670642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:34.670911 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.670797 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:34.670911 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.670861 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:36.670843306 +0000 UTC m=+6.101511310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:34.771357 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.771319 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:34.771545 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.771486 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:34.771545 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.771505 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:34.771545 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.771518 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:34.771717 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:34.771575 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:36.771557183 +0000 UTC m=+6.202225190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:34.773545 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:34.773232 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:35.001680 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:35.001526 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:41:32 +0000 UTC" deadline="2028-03-15 05:21:29.435128512 +0000 UTC" Jul 07 16:46:35.001680 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:35.001591 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14796h34m54.433541885s" Jul 07 16:46:35.180251 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:35.180214 2567 generic.go:356] "Generic (PLEG): container finished" podID="64313b6136b863194f622d1b3b2a5104" containerID="f0b910ac0089463a2dc1983783e1bcfbc766f9b73f379454becb04bdbc921215" exitCode=0 Jul 07 16:46:35.180437 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:35.180390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"64313b6136b863194f622d1b3b2a5104","Type":"ContainerDied","Data":"f0b910ac0089463a2dc1983783e1bcfbc766f9b73f379454becb04bdbc921215"} Jul 07 16:46:36.132987 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.132018 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:36.132987 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.132147 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:36.132987 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.132544 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:36.132987 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.132670 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:36.132987 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.132737 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:36.132987 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.132813 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:36.195579 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.195541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" event={"ID":"64313b6136b863194f622d1b3b2a5104","Type":"ContainerStarted","Data":"72c5d98dfff630ffe3da59f3d4421e3eda1956a5bdc8868f90ad79d237489df2"} Jul 07 16:46:36.590712 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.590104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:36.590712 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.590308 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:36.590712 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.590373 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:40.590351974 +0000 UTC m=+10.021019982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:36.691537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.690904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:36.691537 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.691106 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:36.691537 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.691171 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:40.691153537 +0000 UTC m=+10.121821548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:36.791523 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:36.791449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:36.791713 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.791631 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:36.791713 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.791651 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:36.791713 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.791683 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:36.791886 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:36.791740 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:40.791723217 +0000 UTC m=+10.222391239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:38.132049 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:38.131967 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:38.132049 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:38.132024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:38.132618 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:38.131961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:38.132618 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:38.132122 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:38.132618 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:38.132188 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:38.132618 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:38.132248 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:40.132469 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:40.131966 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:40.132469 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.132117 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:40.132469 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:40.132188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:40.132469 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.132278 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:40.132469 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:40.132303 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:40.132469 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.132376 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:40.626230 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:40.626143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:40.626419 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.626350 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:40.626419 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.626414 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:48.626395545 +0000 UTC m=+18.057063561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:40.726855 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:40.726813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:40.727077 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.726948 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:40.727077 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.727045 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:48.727024322 +0000 UTC m=+18.157692332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:40.827563 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:40.827523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:40.827760 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.827718 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:40.827760 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.827750 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:40.827760 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.827763 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:40.827946 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:40.827817 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:48.827801986 +0000 UTC m=+18.258469989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:42.132029 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:42.131956 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:42.132029 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:42.132006 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:42.132029 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:42.132006 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:42.132593 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:42.132114 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:42.132593 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:42.132246 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:42.132593 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:42.132335 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:44.132352 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:44.132210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:44.132800 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:44.132357 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:44.132800 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:44.132210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:44.132800 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:44.132210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:44.132800 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:44.132458 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:44.132800 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:44.132544 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:46.132527 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:46.132487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:46.133011 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:46.132491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:46.133011 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:46.132625 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:46.133011 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:46.132692 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:46.133011 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:46.132487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:46.133011 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:46.132771 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:48.132127 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:48.132086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:48.132127 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:48.132129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:48.132652 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:48.132127 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:48.132652 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.132222 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:48.132652 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.132313 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:48.132652 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.132396 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:48.688960 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:48.688909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:48.689150 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.689086 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:48.689214 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.689175 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:04.68915143 +0000 UTC m=+34.119819433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:48.789915 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:48.789821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:48.790105 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.789998 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:48.790105 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.790077 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:04.790055431 +0000 UTC m=+34.220723444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:48.890988 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:48.890936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:48.891153 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.891108 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:48.891153 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.891128 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:48.891153 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.891140 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:48.891307 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:48.891205 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:04.891184599 +0000 UTC m=+34.321852627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:50.132299 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:50.132263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:50.132299 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:50.132291 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:50.132299 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:50.132264 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:50.132868 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:50.132431 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:50.132868 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:50.132475 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:50.132868 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:50.132542 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:52.131913 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:52.131876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:52.132435 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:52.131944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:52.132435 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:52.132091 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:52.132435 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:52.132141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:52.132435 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:52.132343 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:52.132435 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:52.132399 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:53.242644 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:53.242392 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m2msn" event={"ID":"bdc99f35-3687-4595-a2ba-a99ea56d6639","Type":"ContainerStarted","Data":"a77b02eb4536a9b53ad47e8fe296a638eea3811304a3c4fd547abc7331ccafe1"} Jul 07 16:46:53.246242 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:53.246092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerStarted","Data":"39b45869273ef999e6ceca99c4d317dfb6526f03d82d7ff5c1d79baf4ff31ef9"} Jul 07 16:46:53.256172 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:53.256101 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4f26" event={"ID":"0bf1baca-9926-46e7-815b-60af30ab3040","Type":"ContainerStarted","Data":"8603a15f4511e61e1d8bac1b6dec58b73173b9f4dfe9d2172604a1c9b9d84840"} Jul 07 16:46:53.263571 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:53.263352 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m2msn" podStartSLOduration=7.634136777 podStartE2EDuration="22.263311099s" totalImagesPullingTime="14.629174322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:53.263138653 +0000 UTC m=+22.693806698" watchObservedRunningTime="2026-07-07 16:46:53.263311099 +0000 UTC m=+22.693979125" Jul 07 16:46:53.263901 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:53.263848 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-144.ec2.internal" podStartSLOduration=21.26383108 podStartE2EDuration="21.26383108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:36.214846848 +0000 UTC m=+5.645514874" watchObservedRunningTime="2026-07-07 16:46:53.26383108 +0000 UTC m=+22.694499114" Jul 07 16:46:53.286371 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:53.286274 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4f26" podStartSLOduration=3.113223649 podStartE2EDuration="22.286253631s" totalImagesPullingTime="19.173029982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:53.285495406 +0000 UTC m=+22.716163432" watchObservedRunningTime="2026-07-07 16:46:53.286253631 +0000 UTC m=+22.716921657" Jul 07 16:46:54.131864 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.131678 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:54.132106 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.131740 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:54.132106 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:54.131941 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:54.132106 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.131745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:54.132106 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:54.132029 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:54.132276 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:54.132144 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:54.259722 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.259682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nlkjn" event={"ID":"e06176c0-657d-4f54-842b-1d72eb4b0ed5","Type":"ContainerStarted","Data":"478fa486092dbcef3e3c77fe3253e35d8efdfac2818633cfff758afc624540e9"} Jul 07 16:46:54.261031 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.261003 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" event={"ID":"4593a514-cfc9-4c58-a22b-cafbe7cfac94","Type":"ContainerStarted","Data":"57d5028277d7c0c18ed949d7492ae6930579b29a4f931c212b6a5c41969e4231"} Jul 07 16:46:54.262265 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.262241 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5f7c46e-368e-4188-a0d0-398adabefb22" containerID="39b45869273ef999e6ceca99c4d317dfb6526f03d82d7ff5c1d79baf4ff31ef9" exitCode=0 Jul 07 16:46:54.262364 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.262291 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerDied","Data":"39b45869273ef999e6ceca99c4d317dfb6526f03d82d7ff5c1d79baf4ff31ef9"} Jul 07 16:46:54.263905 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.263878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b5rp4" event={"ID":"d388f2ee-dab7-44c1-b872-4fe5165525bf","Type":"ContainerStarted","Data":"a0a4a554876f2dbd909d9631bfa26fb3864cf665f3079bdd4c46db27734b09e5"} Jul 07 16:46:54.265603 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.265527 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jktxz" event={"ID":"af920d97-b5a9-433e-a727-3f7d59b78d8c","Type":"ContainerStarted","Data":"e15bf5718f438e969104165797766026d182de4dc2fdb0588f647a54c8418f98"} Jul 07 16:46:54.267953 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.267934 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:46:54.268399 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.268377 2567 generic.go:356] "Generic (PLEG): container finished" podID="07c75f7c-b80f-4180-9712-9173ea97f61d" containerID="b2f7a8c8c88de42a3304cceda700dad4922598dc3c91e9eb7ab54d8b57945911" exitCode=1 Jul 07 16:46:54.268475 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.268432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"6448818352a2825774f47f0947e3b1157e19285a47a721bca47f8c6ce7c5c309"} Jul 07 16:46:54.268524 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.268507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"924dc126d9d1ed318b664ddbd25ade1c485cd308d9fe35d17dc92218d494e5f9"} Jul 07 16:46:54.268563 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.268539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"451682adedbe6be0342cba7efc18d422863d4b7620a04707a8d7154c1e45742d"} Jul 07 16:46:54.268595 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.268569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerDied","Data":"b2f7a8c8c88de42a3304cceda700dad4922598dc3c91e9eb7ab54d8b57945911"} Jul 07 16:46:54.268629 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.268601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"e8e55589290eed55b4c13609f8672a30e89631985324c4348dacf138279e4b01"} Jul 07 16:46:54.275924 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.275866 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nlkjn" podStartSLOduration=4.113365482 podStartE2EDuration="23.275846273s" totalImagesPullingTime="19.162480791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:54.275699543 +0000 UTC m=+23.706367568" watchObservedRunningTime="2026-07-07 16:46:54.275846273 +0000 UTC m=+23.706514300" Jul 07 16:46:54.319267 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.319217 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jktxz" podStartSLOduration=4.130503622 podStartE2EDuration="23.319201049s" totalImagesPullingTime="19.188697427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:54.319102023 +0000 UTC m=+23.749770048" watchObservedRunningTime="2026-07-07 16:46:54.319201049 +0000 UTC m=+23.749869074" Jul 07 16:46:54.335583 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.335482 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b5rp4" podStartSLOduration=4.169907419 podStartE2EDuration="23.335466583s" totalImagesPullingTime="19.165559164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:54.33487403 +0000 UTC m=+23.765542056" watchObservedRunningTime="2026-07-07 16:46:54.335466583 +0000 UTC m=+23.766134609" Jul 07 16:46:54.602722 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:54.602692 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:46:55.024234 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.024114 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:46:54.602712934Z","UUID":"71410770-55c1-4c27-ab03-c9165197f605","Handler":null,"Name":"","Endpoint":""} Jul 07 16:46:55.026096 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.026034 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:46:55.026259 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.026117 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:46:55.274370 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.274282 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" event={"ID":"4593a514-cfc9-4c58-a22b-cafbe7cfac94","Type":"ContainerStarted","Data":"bd3d6b94d6f602b09a20d475f086fda7ed7af19a79ab0f377ebabea947209a58"} Jul 07 16:46:55.276231 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.276200 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xc7ds" event={"ID":"c588c9f2-5efe-46fa-b7ec-9e5fe53c4214","Type":"ContainerStarted","Data":"925ac9d8da3bf2786b0b57d021762f7f8b5faf642ebc255da8ddbb8f2554a336"} Jul 07 16:46:55.281015 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.280988 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:46:55.281672 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.281635 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"c554d5621e1ad66a27609c751741be81a6100b0cdbc37c85ec60e91ced552f60"} Jul 07 16:46:55.297191 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.297131 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xc7ds" podStartSLOduration=5.131288538 podStartE2EDuration="24.297106346s" totalImagesPullingTime="19.165817808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:55.297081297 +0000 UTC m=+24.727749352" watchObservedRunningTime="2026-07-07 16:46:55.297106346 +0000 UTC m=+24.727774376" Jul 07 16:46:55.864058 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:55.863736 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:56.132403 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:56.132309 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:56.132553 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:56.132317 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:56.132553 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:56.132446 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:56.132659 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:56.132555 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:56.132659 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:56.132324 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:56.132816 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:56.132675 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:56.286138 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:56.286100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" event={"ID":"4593a514-cfc9-4c58-a22b-cafbe7cfac94","Type":"ContainerStarted","Data":"07855bcf40c91984baf46d69a3e36ded759bd379a4a912fa78d1a3135eb27e0b"} Jul 07 16:46:57.291507 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:57.291470 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:46:57.292152 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:57.291867 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"6c02dec53aee25458a438c129b2591000b63f85e7dfeea0dbed3c2af4dda78ba"} Jul 07 16:46:57.755388 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:57.755344 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:57.755969 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:57.755941 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:57.775648 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:57.775590 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwbc4" podStartSLOduration=5.525204498 podStartE2EDuration="26.775569013s" totalImagesPullingTime="21.250364515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:56.308421556 +0000 UTC m=+25.739089584" watchObservedRunningTime="2026-07-07 16:46:57.775569013 +0000 UTC m=+27.206237039" Jul 07 16:46:58.132398 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:58.132306 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:46:58.132398 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:58.132357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:46:58.132612 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:58.132445 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:46:58.132612 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:58.132462 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:46:58.132612 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:58.132547 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:46:58.132748 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:46:58.132635 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:46:58.295371 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:58.295345 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m2msn" Jul 07 16:46:59.298685 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.298484 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5f7c46e-368e-4188-a0d0-398adabefb22" containerID="7b0669588b989fac04c8a40c3cc120c4ca1e084ee02aff1a68606a827ea45bfe" exitCode=0 Jul 07 16:46:59.299409 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.298532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerDied","Data":"7b0669588b989fac04c8a40c3cc120c4ca1e084ee02aff1a68606a827ea45bfe"} Jul 07 16:46:59.302488 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.302377 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:46:59.302745 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.302722 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"2569ad6891249e0aa2709f900deb73f4691b7eb190cf52e943f7caaaaf4fffb7"} Jul 07 16:46:59.303118 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.303065 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:59.303201 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.303134 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:59.303201 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.303188 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:59.303301 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.303211 2567 scope.go:117] "RemoveContainer" containerID="b2f7a8c8c88de42a3304cceda700dad4922598dc3c91e9eb7ab54d8b57945911" Jul 07 16:46:59.323204 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.323177 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:46:59.323412 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:46:59.323386 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:47:00.132069 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:00.132027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:00.132069 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:00.132052 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:00.132069 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:00.132055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:00.132382 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:00.132187 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:47:00.132382 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:00.132307 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:47:00.132382 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:00.132377 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:47:00.309137 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:00.309104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:47:00.309593 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:00.309499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" event={"ID":"07c75f7c-b80f-4180-9712-9173ea97f61d","Type":"ContainerStarted","Data":"e74ebe5f5dda33c18012e3b1e154d46f295e85468d76e2acc2664d8d0c3bc70e"} Jul 07 16:47:00.339455 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:00.339392 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" podStartSLOduration=9.881028156 podStartE2EDuration="29.339366863s" totalImagesPullingTime="19.458338707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:00.337651348 +0000 UTC m=+29.768319395" watchObservedRunningTime="2026-07-07 16:47:00.339366863 +0000 UTC m=+29.770034889" Jul 07 16:47:01.023144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.022899 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4v72"] Jul 07 16:47:01.026192 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.023654 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:01.026192 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:01.023831 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:47:01.028639 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.028606 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjn6b"] Jul 07 16:47:01.028812 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.028778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:01.028914 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:01.028888 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:47:01.029258 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.029237 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ctklw"] Jul 07 16:47:01.029362 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.029346 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:01.029458 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:01.029439 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:47:01.313642 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.313608 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5f7c46e-368e-4188-a0d0-398adabefb22" containerID="20c1be6cd3e1ec5f396160ce5fae7050cffeb3741af18539d52098c10b202eae" exitCode=0 Jul 07 16:47:01.314064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:01.313688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerDied","Data":"20c1be6cd3e1ec5f396160ce5fae7050cffeb3741af18539d52098c10b202eae"} Jul 07 16:47:02.132248 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:02.132210 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:02.132420 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:02.132321 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:47:03.132004 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:03.131957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:03.132713 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:03.132094 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:47:03.132713 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:03.132125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:03.132713 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:03.132174 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:47:03.320835 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:03.320745 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5f7c46e-368e-4188-a0d0-398adabefb22" containerID="d0ca5e3dbb11ce214c6cf51b7c36ecd2862304d4fabf792b15176ab563955166" exitCode=0 Jul 07 16:47:03.320835 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:03.320792 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerDied","Data":"d0ca5e3dbb11ce214c6cf51b7c36ecd2862304d4fabf792b15176ab563955166"} Jul 07 16:47:04.131513 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:04.131479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:04.131688 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.131593 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjn6b" podUID="289dcbab-3775-4b26-a054-eb399c271217" Jul 07 16:47:04.708557 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:04.708517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:04.709039 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.708695 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:47:04.709039 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.708766 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs podName:85752b58-34a0-4ef1-b051-3f9281c39bd9 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:36.70874762 +0000 UTC m=+66.139415623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs") pod "network-metrics-daemon-d4v72" (UID: "85752b58-34a0-4ef1-b051-3f9281c39bd9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:47:04.809618 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:04.809533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:04.809804 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.809644 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:47:04.809804 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.809695 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret podName:289dcbab-3775-4b26-a054-eb399c271217 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:36.809680529 +0000 UTC m=+66.240348533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret") pod "global-pull-secret-syncer-rjn6b" (UID: "289dcbab-3775-4b26-a054-eb399c271217") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:47:04.910362 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:04.910323 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:04.910534 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.910496 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:47:04.910534 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.910518 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:47:04.910534 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.910528 2567 projected.go:196] Error preparing data for projected volume kube-api-access-lm2lh for pod openshift-network-diagnostics/network-check-target-ctklw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:47:04.910629 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:04.910577 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh podName:50871a95-8056-497a-9fce-1c8d2ab06862 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:36.910564761 +0000 UTC m=+66.341232764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lm2lh" (UniqueName: "kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh") pod "network-check-target-ctklw" (UID: "50871a95-8056-497a-9fce-1c8d2ab06862") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:47:05.132253 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.132180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:05.132410 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.132184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:05.132410 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:05.132289 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctklw" podUID="50871a95-8056-497a-9fce-1c8d2ab06862" Jul 07 16:47:05.132410 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:05.132396 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4v72" podUID="85752b58-34a0-4ef1-b051-3f9281c39bd9" Jul 07 16:47:05.866912 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.866829 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-144.ec2.internal" event="NodeReady" Jul 07 16:47:05.867410 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.867006 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:47:05.923850 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.923819 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b5dcw"] Jul 07 16:47:05.926403 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.926374 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s6ggr"] Jul 07 16:47:05.926555 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.926487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:05.928295 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.928263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:05.930406 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:47:05.930518 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930458 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pvjc\"" Jul 07 16:47:05.930586 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930533 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:47:05.931002 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930707 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f72zk\"" Jul 07 16:47:05.931002 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930707 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:47:05.931002 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930714 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:47:05.931002 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.930784 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:47:05.940512 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.940474 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5dcw"] Jul 07 16:47:05.941353 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:05.941330 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s6ggr"] Jul 07 16:47:06.019375 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.019321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf49w\" (UniqueName: \"kubernetes.io/projected/9c163177-0dd5-45bd-a1f9-f17f5eabc630-kube-api-access-gf49w\") pod \"ingress-canary-s6ggr\" (UID: \"9c163177-0dd5-45bd-a1f9-f17f5eabc630\") " pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.019375 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.019373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac1787c-f332-4049-92b2-1b2f070f998e-config-volume\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.019592 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.019436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ac1787c-f332-4049-92b2-1b2f070f998e-tmp-dir\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.019592 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.019563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c163177-0dd5-45bd-a1f9-f17f5eabc630-cert\") pod \"ingress-canary-s6ggr\" (UID: \"9c163177-0dd5-45bd-a1f9-f17f5eabc630\") " pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.019689 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.019614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.019689 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.019639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnjfv\" (UniqueName: \"kubernetes.io/projected/9ac1787c-f332-4049-92b2-1b2f070f998e-kube-api-access-dnjfv\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.120512 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.120423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf49w\" (UniqueName: \"kubernetes.io/projected/9c163177-0dd5-45bd-a1f9-f17f5eabc630-kube-api-access-gf49w\") pod \"ingress-canary-s6ggr\" (UID: \"9c163177-0dd5-45bd-a1f9-f17f5eabc630\") " pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.120512 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.120475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac1787c-f332-4049-92b2-1b2f070f998e-config-volume\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.120512 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.120501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ac1787c-f332-4049-92b2-1b2f070f998e-tmp-dir\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.120775 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.120556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c163177-0dd5-45bd-a1f9-f17f5eabc630-cert\") pod \"ingress-canary-s6ggr\" (UID: \"9c163177-0dd5-45bd-a1f9-f17f5eabc630\") " pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.120775 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.120596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.120775 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.120617 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnjfv\" (UniqueName: \"kubernetes.io/projected/9ac1787c-f332-4049-92b2-1b2f070f998e-kube-api-access-dnjfv\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.120775 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:06.120756 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:06.121005 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:06.120844 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls podName:9ac1787c-f332-4049-92b2-1b2f070f998e nodeName:}" failed. No retries permitted until 2026-07-07 16:47:06.620822863 +0000 UTC m=+36.051490873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls") pod "dns-default-b5dcw" (UID: "9ac1787c-f332-4049-92b2-1b2f070f998e") : secret "dns-default-metrics-tls" not found Jul 07 16:47:06.121078 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.121004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ac1787c-f332-4049-92b2-1b2f070f998e-tmp-dir\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.121253 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.121220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ac1787c-f332-4049-92b2-1b2f070f998e-config-volume\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.125955 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.125756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c163177-0dd5-45bd-a1f9-f17f5eabc630-cert\") pod \"ingress-canary-s6ggr\" (UID: \"9c163177-0dd5-45bd-a1f9-f17f5eabc630\") " pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.131473 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.131437 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnjfv\" (UniqueName: \"kubernetes.io/projected/9ac1787c-f332-4049-92b2-1b2f070f998e-kube-api-access-dnjfv\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.131667 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.131649 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:06.131745 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.131660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf49w\" (UniqueName: \"kubernetes.io/projected/9c163177-0dd5-45bd-a1f9-f17f5eabc630-kube-api-access-gf49w\") pod \"ingress-canary-s6ggr\" (UID: \"9c163177-0dd5-45bd-a1f9-f17f5eabc630\") " pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.136880 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.136850 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:47:06.246244 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.246208 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s6ggr" Jul 07 16:47:06.623537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:06.623498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:06.623709 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:06.623632 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:06.623769 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:06.623711 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls podName:9ac1787c-f332-4049-92b2-1b2f070f998e nodeName:}" failed. No retries permitted until 2026-07-07 16:47:07.623687612 +0000 UTC m=+37.054355619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls") pod "dns-default-b5dcw" (UID: "9ac1787c-f332-4049-92b2-1b2f070f998e") : secret "dns-default-metrics-tls" not found Jul 07 16:47:07.132392 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.132350 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:07.132833 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.132401 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:07.135789 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.135762 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:47:07.135789 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.135770 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvb6g\"" Jul 07 16:47:07.136146 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.136126 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:47:07.136369 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.136354 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:47:07.138204 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.138183 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rsbn5\"" Jul 07 16:47:07.499628 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.499594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s6ggr"] Jul 07 16:47:07.504119 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:07.504087 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c163177_0dd5_45bd_a1f9_f17f5eabc630.slice/crio-b49f00b5458c3f5a42230c0a41d1a2c4c1ee89d9d8fb02ca2751d251ceed56b8 WatchSource:0}: Error finding container b49f00b5458c3f5a42230c0a41d1a2c4c1ee89d9d8fb02ca2751d251ceed56b8: Status 404 returned error can't find the container with id b49f00b5458c3f5a42230c0a41d1a2c4c1ee89d9d8fb02ca2751d251ceed56b8 Jul 07 16:47:07.631534 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:07.631502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:07.631649 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:07.631636 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:07.631701 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:07.631692 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls podName:9ac1787c-f332-4049-92b2-1b2f070f998e nodeName:}" failed. No retries permitted until 2026-07-07 16:47:09.631678074 +0000 UTC m=+39.062346077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls") pod "dns-default-b5dcw" (UID: "9ac1787c-f332-4049-92b2-1b2f070f998e") : secret "dns-default-metrics-tls" not found Jul 07 16:47:08.334460 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:08.334416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s6ggr" event={"ID":"9c163177-0dd5-45bd-a1f9-f17f5eabc630","Type":"ContainerStarted","Data":"b49f00b5458c3f5a42230c0a41d1a2c4c1ee89d9d8fb02ca2751d251ceed56b8"} Jul 07 16:47:08.337488 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:08.337453 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5f7c46e-368e-4188-a0d0-398adabefb22" containerID="f43e26c41c07980eb2648569d0922bbecfc2831231fe4a483a7afa1c95285556" exitCode=0 Jul 07 16:47:08.337660 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:08.337504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerDied","Data":"f43e26c41c07980eb2648569d0922bbecfc2831231fe4a483a7afa1c95285556"} Jul 07 16:47:09.344150 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:09.344115 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5f7c46e-368e-4188-a0d0-398adabefb22" containerID="aaf26e7a1802c2dde7b6702aa5664888f8da396213e4fc6a5e57cd6d9eb533b7" exitCode=0 Jul 07 16:47:09.344556 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:09.344174 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerDied","Data":"aaf26e7a1802c2dde7b6702aa5664888f8da396213e4fc6a5e57cd6d9eb533b7"} Jul 07 16:47:09.646414 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:09.646318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:09.646557 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:09.646473 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:09.646557 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:09.646549 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls podName:9ac1787c-f332-4049-92b2-1b2f070f998e nodeName:}" failed. No retries permitted until 2026-07-07 16:47:13.646528595 +0000 UTC m=+43.077196604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls") pod "dns-default-b5dcw" (UID: "9ac1787c-f332-4049-92b2-1b2f070f998e") : secret "dns-default-metrics-tls" not found Jul 07 16:47:10.350613 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:10.350579 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" event={"ID":"d5f7c46e-368e-4188-a0d0-398adabefb22","Type":"ContainerStarted","Data":"14811b91441357aca39be1bfb261474b61b5e4b76e8c4863123ac3162856ec82"} Jul 07 16:47:10.352136 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:10.352113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s6ggr" event={"ID":"9c163177-0dd5-45bd-a1f9-f17f5eabc630","Type":"ContainerStarted","Data":"5d96e2a65c39f07ef51af20f6b5a64cd27209baea1511cd9d1a0fd0107309716"} Jul 07 16:47:10.374405 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:10.374338 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mp6dk" podStartSLOduration=9.489918343 podStartE2EDuration="39.374316464s" totalImagesPullingTime="29.884398121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:10.373260115 +0000 UTC m=+39.803928141" watchObservedRunningTime="2026-07-07 16:47:10.374316464 +0000 UTC m=+39.804984492" Jul 07 16:47:10.394784 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:10.394724 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s6ggr" podStartSLOduration=2.9795100740000002 podStartE2EDuration="5.394707624s" totalImagesPullingTime="2.41519755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:10.394083066 +0000 UTC m=+39.824751094" watchObservedRunningTime="2026-07-07 16:47:10.394707624 +0000 UTC m=+39.825375648" Jul 07 16:47:12.808850 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.808814 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk"] Jul 07 16:47:12.837390 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.837357 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wkv4n"] Jul 07 16:47:12.837528 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.837479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:12.839630 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.839601 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 16:47:12.839746 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.839614 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 16:47:12.840127 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.840110 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:47:12.840176 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.840113 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m59f5\"" Jul 07 16:47:12.859498 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.859467 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk"] Jul 07 16:47:12.859685 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.859516 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wkv4n"] Jul 07 16:47:12.859685 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.859601 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:12.861693 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.861663 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 16:47:12.861693 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.861680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 16:47:12.861693 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.861670 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 16:47:12.861940 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.861686 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pc2tz\"" Jul 07 16:47:12.862064 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.862005 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:47:12.867330 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.867307 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 16:47:12.973041 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.973001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nphh2\" (UniqueName: \"kubernetes.io/projected/ec60c268-3af2-4c98-a3e8-0ea893d00375-kube-api-access-nphh2\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:12.973041 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.973046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-config\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:12.973262 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.973066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-serving-cert\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:12.973262 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.973149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdtb9\" (UniqueName: \"kubernetes.io/projected/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-kube-api-access-wdtb9\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:12.973262 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.973189 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-trusted-ca\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:12.973262 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:12.973253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:13.060753 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.060672 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65464d75b8-9l5bq"] Jul 07 16:47:13.073707 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.073677 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdtb9\" (UniqueName: \"kubernetes.io/projected/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-kube-api-access-wdtb9\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.073881 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.073733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-trusted-ca\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.073881 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.073805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:13.073881 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.073859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nphh2\" (UniqueName: \"kubernetes.io/projected/ec60c268-3af2-4c98-a3e8-0ea893d00375-kube-api-access-nphh2\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:13.074070 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.073889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-config\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.074070 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.073913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-serving-cert\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.074070 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.073968 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:47:13.074227 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.074197 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls podName:ec60c268-3af2-4c98-a3e8-0ea893d00375 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:13.574056894 +0000 UTC m=+43.004724914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bd4gk" (UID: "ec60c268-3af2-4c98-a3e8-0ea893d00375") : secret "samples-operator-tls" not found Jul 07 16:47:13.074791 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.074746 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-config\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.075376 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.075354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-trusted-ca\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.078265 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.078244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-serving-cert\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.082574 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.082550 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65464d75b8-9l5bq"] Jul 07 16:47:13.082688 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.082646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.083128 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.083085 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdtb9\" (UniqueName: \"kubernetes.io/projected/63df9e3d-31a3-44dc-927e-b3b3ef407c7a-kube-api-access-wdtb9\") pod \"console-operator-68b757fb67-wkv4n\" (UID: \"63df9e3d-31a3-44dc-927e-b3b3ef407c7a\") " pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.103010 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.083682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nphh2\" (UniqueName: \"kubernetes.io/projected/ec60c268-3af2-4c98-a3e8-0ea893d00375-kube-api-access-nphh2\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:13.103810 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.103781 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 16:47:13.104130 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.103885 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 16:47:13.104339 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.104321 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xv5k5\"" Jul 07 16:47:13.104622 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.104607 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 16:47:13.109536 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.109512 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 16:47:13.169306 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.169261 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:13.174594 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs657\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-kube-api-access-hs657\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174677 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-bound-sa-token\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174677 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174786 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-image-registry-private-configuration\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174844 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-certificates\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174844 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-installation-pull-secrets\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76d2a33-b5cc-4649-b4af-4773153b4af2-ca-trust-extracted\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.174942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.174904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-trusted-ca\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275459 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs657\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-kube-api-access-hs657\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275599 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-bound-sa-token\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275599 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275599 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-image-registry-private-configuration\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275599 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-certificates\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275599 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-installation-pull-secrets\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275769 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76d2a33-b5cc-4649-b4af-4773153b4af2-ca-trust-extracted\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.275769 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.275630 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:47:13.275769 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.275651 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65464d75b8-9l5bq: secret "image-registry-tls" not found Jul 07 16:47:13.275769 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.275711 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls podName:a76d2a33-b5cc-4649-b4af-4773153b4af2 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:13.775691508 +0000 UTC m=+43.206359526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls") pod "image-registry-65464d75b8-9l5bq" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2") : secret "image-registry-tls" not found Jul 07 16:47:13.275769 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.275635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-trusted-ca\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.276379 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.276353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76d2a33-b5cc-4649-b4af-4773153b4af2-ca-trust-extracted\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.276643 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.276622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-trusted-ca\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.276706 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.276677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-certificates\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.278219 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.278192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-installation-pull-secrets\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.278507 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.278487 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-image-registry-private-configuration\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.287619 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.287590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-bound-sa-token\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.287750 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.287664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs657\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-kube-api-access-hs657\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.340901 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.340823 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wkv4n"] Jul 07 16:47:13.344594 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:13.344564 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63df9e3d_31a3_44dc_927e_b3b3ef407c7a.slice/crio-45c688881367a22068116f21298aee1c2fa5ac95f9bdecb4accac3225a4b4666 WatchSource:0}: Error finding container 45c688881367a22068116f21298aee1c2fa5ac95f9bdecb4accac3225a4b4666: Status 404 returned error can't find the container with id 45c688881367a22068116f21298aee1c2fa5ac95f9bdecb4accac3225a4b4666 Jul 07 16:47:13.359656 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.359613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" event={"ID":"63df9e3d-31a3-44dc-927e-b3b3ef407c7a","Type":"ContainerStarted","Data":"45c688881367a22068116f21298aee1c2fa5ac95f9bdecb4accac3225a4b4666"} Jul 07 16:47:13.579603 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.579566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:13.579805 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.579751 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:47:13.579872 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.579855 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls podName:ec60c268-3af2-4c98-a3e8-0ea893d00375 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:14.579837972 +0000 UTC m=+44.010505975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bd4gk" (UID: "ec60c268-3af2-4c98-a3e8-0ea893d00375") : secret "samples-operator-tls" not found Jul 07 16:47:13.680731 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.680636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:13.680876 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.680788 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:13.680876 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.680849 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls podName:9ac1787c-f332-4049-92b2-1b2f070f998e nodeName:}" failed. No retries permitted until 2026-07-07 16:47:21.680833177 +0000 UTC m=+51.111501200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls") pod "dns-default-b5dcw" (UID: "9ac1787c-f332-4049-92b2-1b2f070f998e") : secret "dns-default-metrics-tls" not found Jul 07 16:47:13.781148 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:13.781110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:13.781306 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.781224 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:47:13.781306 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.781235 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65464d75b8-9l5bq: secret "image-registry-tls" not found Jul 07 16:47:13.781306 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:13.781284 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls podName:a76d2a33-b5cc-4649-b4af-4773153b4af2 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:14.781270913 +0000 UTC m=+44.211938916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls") pod "image-registry-65464d75b8-9l5bq" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2") : secret "image-registry-tls" not found Jul 07 16:47:14.589420 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:14.589375 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:14.589780 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:14.589554 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:47:14.589780 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:14.589632 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls podName:ec60c268-3af2-4c98-a3e8-0ea893d00375 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.589613008 +0000 UTC m=+46.020281012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bd4gk" (UID: "ec60c268-3af2-4c98-a3e8-0ea893d00375") : secret "samples-operator-tls" not found Jul 07 16:47:14.791875 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:14.791832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:14.792062 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:14.792014 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:47:14.792062 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:14.792030 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65464d75b8-9l5bq: secret "image-registry-tls" not found Jul 07 16:47:14.792174 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:14.792086 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls podName:a76d2a33-b5cc-4649-b4af-4773153b4af2 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.792069938 +0000 UTC m=+46.222737950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls") pod "image-registry-65464d75b8-9l5bq" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2") : secret "image-registry-tls" not found Jul 07 16:47:15.775488 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.775405 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pm2tz"] Jul 07 16:47:15.796897 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.796864 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pm2tz"] Jul 07 16:47:15.797066 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.797016 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:15.799373 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.799341 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:47:15.800011 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.799995 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:47:15.800011 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.800004 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:47:15.800183 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.800015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2mgsv\"" Jul 07 16:47:15.800183 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.800004 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:47:15.901912 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.901872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:15.901912 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.901913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:15.902186 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.901947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-api-access-fp2xj\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:15.902186 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.901971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c580be-0d3a-4f30-acec-c6525da8d503-data-volume\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:15.902186 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:15.902075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4c580be-0d3a-4f30-acec-c6525da8d503-crio-socket\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003387 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-api-access-fp2xj\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003387 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c580be-0d3a-4f30-acec-c6525da8d503-data-volume\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003628 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4c580be-0d3a-4f30-acec-c6525da8d503-crio-socket\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003628 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003576 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4c580be-0d3a-4f30-acec-c6525da8d503-crio-socket\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003722 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003722 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003808 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.003751 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.003808 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.003763 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:16.003808 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.003792 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.503780607 +0000 UTC m=+45.934448610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.003920 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.003748 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4c580be-0d3a-4f30-acec-c6525da8d503-data-volume\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.003920 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.003832 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.503813824 +0000 UTC m=+45.934481843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : configmap "kube-rbac-proxy" not found Jul 07 16:47:16.023887 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.023859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2xj\" (UniqueName: \"kubernetes.io/projected/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-api-access-fp2xj\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.368569 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.368540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/0.log" Jul 07 16:47:16.368733 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.368582 2567 generic.go:356] "Generic (PLEG): container finished" podID="63df9e3d-31a3-44dc-927e-b3b3ef407c7a" containerID="1ade1f10f5a44df6e24b087968c4b07b4af6279e0f28476b9bcf619386373566" exitCode=255 Jul 07 16:47:16.368733 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.368614 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" event={"ID":"63df9e3d-31a3-44dc-927e-b3b3ef407c7a","Type":"ContainerDied","Data":"1ade1f10f5a44df6e24b087968c4b07b4af6279e0f28476b9bcf619386373566"} Jul 07 16:47:16.368844 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.368830 2567 scope.go:117] "RemoveContainer" containerID="1ade1f10f5a44df6e24b087968c4b07b4af6279e0f28476b9bcf619386373566" Jul 07 16:47:16.508961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.508930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.509101 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.508987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:16.509101 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.509060 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:16.509101 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.509074 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.509218 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.509131 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:17.509113331 +0000 UTC m=+46.939781355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.509218 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.509147 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:17.509138818 +0000 UTC m=+46.939806820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : configmap "kube-rbac-proxy" not found Jul 07 16:47:16.610273 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.610237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:16.610469 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.610383 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:47:16.610469 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.610456 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls podName:ec60c268-3af2-4c98-a3e8-0ea893d00375 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:20.610441446 +0000 UTC m=+50.041109449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bd4gk" (UID: "ec60c268-3af2-4c98-a3e8-0ea893d00375") : secret "samples-operator-tls" not found Jul 07 16:47:16.812060 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:16.812024 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:16.812433 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.812153 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:47:16.812433 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.812167 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65464d75b8-9l5bq: secret "image-registry-tls" not found Jul 07 16:47:16.812433 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:16.812215 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls podName:a76d2a33-b5cc-4649-b4af-4773153b4af2 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:20.81220185 +0000 UTC m=+50.242869852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls") pod "image-registry-65464d75b8-9l5bq" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2") : secret "image-registry-tls" not found Jul 07 16:47:17.371948 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.371915 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:47:17.372303 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.372288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/0.log" Jul 07 16:47:17.372380 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.372326 2567 generic.go:356] "Generic (PLEG): container finished" podID="63df9e3d-31a3-44dc-927e-b3b3ef407c7a" containerID="94a29fbb7e9dac863283b0b94d3ece27c2b49bf1f1d2c2e2db9f0575d3de95a4" exitCode=255 Jul 07 16:47:17.372416 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.372396 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" event={"ID":"63df9e3d-31a3-44dc-927e-b3b3ef407c7a","Type":"ContainerDied","Data":"94a29fbb7e9dac863283b0b94d3ece27c2b49bf1f1d2c2e2db9f0575d3de95a4"} Jul 07 16:47:17.372467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.372455 2567 scope.go:117] "RemoveContainer" containerID="1ade1f10f5a44df6e24b087968c4b07b4af6279e0f28476b9bcf619386373566" Jul 07 16:47:17.372678 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.372650 2567 scope.go:117] "RemoveContainer" containerID="94a29fbb7e9dac863283b0b94d3ece27c2b49bf1f1d2c2e2db9f0575d3de95a4" Jul 07 16:47:17.372857 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:17.372838 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wkv4n_openshift-console-operator(63df9e3d-31a3-44dc-927e-b3b3ef407c7a)\"" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" podUID="63df9e3d-31a3-44dc-927e-b3b3ef407c7a" Jul 07 16:47:17.518530 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.518485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:17.518711 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.518538 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:17.518711 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:17.518564 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:17.518711 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:17.518639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:19.518616889 +0000 UTC m=+48.949284895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : configmap "kube-rbac-proxy" not found Jul 07 16:47:17.518711 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:17.518693 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:17.518890 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:17.518766 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:19.518747037 +0000 UTC m=+48.949415044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:17.553131 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:17.553102 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5rp4_d388f2ee-dab7-44c1-b872-4fe5165525bf/dns-node-resolver/0.log" Jul 07 16:47:18.376329 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:18.376302 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:47:18.376747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:18.376645 2567 scope.go:117] "RemoveContainer" containerID="94a29fbb7e9dac863283b0b94d3ece27c2b49bf1f1d2c2e2db9f0575d3de95a4" Jul 07 16:47:18.376810 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:18.376790 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wkv4n_openshift-console-operator(63df9e3d-31a3-44dc-927e-b3b3ef407c7a)\"" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" podUID="63df9e3d-31a3-44dc-927e-b3b3ef407c7a" Jul 07 16:47:18.753184 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:18.753156 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nlkjn_e06176c0-657d-4f54-842b-1d72eb4b0ed5/node-ca/0.log" Jul 07 16:47:19.535319 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:19.535277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:19.535319 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:19.535318 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:19.535880 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:19.535421 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:19.535880 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:19.535486 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:19.535880 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:19.535507 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:23.535485649 +0000 UTC m=+52.966153654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : configmap "kube-rbac-proxy" not found Jul 07 16:47:19.535880 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:19.535527 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:23.535516022 +0000 UTC m=+52.966184029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:19.553754 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:19.553719 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s6ggr_9c163177-0dd5-45bd-a1f9-f17f5eabc630/serve-healthcheck-canary/0.log" Jul 07 16:47:20.647574 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:20.647525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:20.647963 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:20.647727 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:47:20.647963 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:20.647792 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls podName:ec60c268-3af2-4c98-a3e8-0ea893d00375 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:28.647777808 +0000 UTC m=+58.078445811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bd4gk" (UID: "ec60c268-3af2-4c98-a3e8-0ea893d00375") : secret "samples-operator-tls" not found Jul 07 16:47:20.848610 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:20.848571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:20.848778 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:20.848682 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:47:20.848778 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:20.848692 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65464d75b8-9l5bq: secret "image-registry-tls" not found Jul 07 16:47:20.848778 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:20.848738 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls podName:a76d2a33-b5cc-4649-b4af-4773153b4af2 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:28.848727017 +0000 UTC m=+58.279395020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls") pod "image-registry-65464d75b8-9l5bq" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2") : secret "image-registry-tls" not found Jul 07 16:47:21.756227 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:21.756181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:21.756699 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:21.756347 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:21.756699 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:21.756425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls podName:9ac1787c-f332-4049-92b2-1b2f070f998e nodeName:}" failed. No retries permitted until 2026-07-07 16:47:37.756408865 +0000 UTC m=+67.187076867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls") pod "dns-default-b5dcw" (UID: "9ac1787c-f332-4049-92b2-1b2f070f998e") : secret "dns-default-metrics-tls" not found Jul 07 16:47:23.169819 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:23.169778 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:23.170281 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:23.169838 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:23.170281 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:23.170204 2567 scope.go:117] "RemoveContainer" containerID="94a29fbb7e9dac863283b0b94d3ece27c2b49bf1f1d2c2e2db9f0575d3de95a4" Jul 07 16:47:23.170351 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:23.170334 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wkv4n_openshift-console-operator(63df9e3d-31a3-44dc-927e-b3b3ef407c7a)\"" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" podUID="63df9e3d-31a3-44dc-927e-b3b3ef407c7a" Jul 07 16:47:23.571781 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:23.571743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:23.571965 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:23.571795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:23.571965 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:23.571865 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:23.571965 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:23.571920 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:23.571965 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:23.571944 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:31.57192687 +0000 UTC m=+61.002594873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : configmap "kube-rbac-proxy" not found Jul 07 16:47:23.572138 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:23.571997 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:31.571958321 +0000 UTC m=+61.002626323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:28.712051 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:28.711998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:28.714366 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:28.714330 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec60c268-3af2-4c98-a3e8-0ea893d00375-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bd4gk\" (UID: \"ec60c268-3af2-4c98-a3e8-0ea893d00375\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:28.746143 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:28.746099 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" Jul 07 16:47:28.890311 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:28.890274 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk"] Jul 07 16:47:28.913249 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:28.913215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:28.913411 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:28.913337 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:47:28.913411 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:28.913350 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65464d75b8-9l5bq: secret "image-registry-tls" not found Jul 07 16:47:28.913411 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:28.913399 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls podName:a76d2a33-b5cc-4649-b4af-4773153b4af2 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:44.913386086 +0000 UTC m=+74.344054089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls") pod "image-registry-65464d75b8-9l5bq" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2") : secret "image-registry-tls" not found Jul 07 16:47:29.407831 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:29.407785 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" event={"ID":"ec60c268-3af2-4c98-a3e8-0ea893d00375","Type":"ContainerStarted","Data":"882a4d84c54203f1e6f4e5e6b11784de9f508412c5a5ea8426364d85a3132251"} Jul 07 16:47:30.411998 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:30.411948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" event={"ID":"ec60c268-3af2-4c98-a3e8-0ea893d00375","Type":"ContainerStarted","Data":"b80f30b2a948433428d7b6a6f04efb9df2ed42c2f87ff2369a9dd337dba01f2d"} Jul 07 16:47:31.325105 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:31.325076 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rq27k" Jul 07 16:47:31.416431 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:31.416395 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" event={"ID":"ec60c268-3af2-4c98-a3e8-0ea893d00375","Type":"ContainerStarted","Data":"57d33832ef80429cf38dbf6a2224aee480877213d6252d7a451900f458da5d1c"} Jul 07 16:47:31.436797 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:31.436743 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bd4gk" podStartSLOduration=18.065111195 podStartE2EDuration="19.436726048s" totalImagesPullingTime="1.371614853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:31.436264568 +0000 UTC m=+60.866932594" watchObservedRunningTime="2026-07-07 16:47:31.436726048 +0000 UTC m=+60.867394050" Jul 07 16:47:31.639537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:31.639432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:31.639537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:31.639481 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:31.639758 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:31.639622 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:31.639758 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:47:31.639693 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls podName:d4c580be-0d3a-4f30-acec-c6525da8d503 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:47.639675573 +0000 UTC m=+77.070343594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pm2tz" (UID: "d4c580be-0d3a-4f30-acec-c6525da8d503") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:31.639997 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:31.639945 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4c580be-0d3a-4f30-acec-c6525da8d503-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:35.132234 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:35.132196 2567 scope.go:117] "RemoveContainer" containerID="94a29fbb7e9dac863283b0b94d3ece27c2b49bf1f1d2c2e2db9f0575d3de95a4" Jul 07 16:47:35.428482 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:35.428402 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:47:35.428621 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:35.428479 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" event={"ID":"63df9e3d-31a3-44dc-927e-b3b3ef407c7a","Type":"ContainerStarted","Data":"b1fac0c428e2725c86c6bfb376f50220c43ecdf237ddfc411b4ee5fb6118bc8d"} Jul 07 16:47:35.428772 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:35.428753 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:35.448152 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:35.448090 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" podStartSLOduration=21.309522589 podStartE2EDuration="23.448074164s" totalImagesPullingTime="2.138551575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:35.447446752 +0000 UTC m=+64.878114777" watchObservedRunningTime="2026-07-07 16:47:35.448074164 +0000 UTC m=+64.878742188" Jul 07 16:47:36.172395 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.172363 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-wkv4n" Jul 07 16:47:36.781287 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.781252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:36.783465 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.783447 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:47:36.794281 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.794249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85752b58-34a0-4ef1-b051-3f9281c39bd9-metrics-certs\") pod \"network-metrics-daemon-d4v72\" (UID: \"85752b58-34a0-4ef1-b051-3f9281c39bd9\") " pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:36.846055 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.846023 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rsbn5\"" Jul 07 16:47:36.854047 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.854022 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4v72" Jul 07 16:47:36.881956 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.881910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:36.884486 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.884464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:47:36.895387 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.895353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/289dcbab-3775-4b26-a054-eb399c271217-original-pull-secret\") pod \"global-pull-secret-syncer-rjn6b\" (UID: \"289dcbab-3775-4b26-a054-eb399c271217\") " pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:36.982542 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.982495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:36.984912 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.984887 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:47:36.986239 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.986212 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4v72"] Jul 07 16:47:36.989468 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:36.989443 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85752b58_34a0_4ef1_b051_3f9281c39bd9.slice/crio-3bef79f787ec6d9daa01a718d295a0d78b9aad000f4c6a79985a8a43565ef1ed WatchSource:0}: Error finding container 3bef79f787ec6d9daa01a718d295a0d78b9aad000f4c6a79985a8a43565ef1ed: Status 404 returned error can't find the container with id 3bef79f787ec6d9daa01a718d295a0d78b9aad000f4c6a79985a8a43565ef1ed Jul 07 16:47:36.995491 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:36.995470 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:47:37.006567 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.006527 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2lh\" (UniqueName: \"kubernetes.io/projected/50871a95-8056-497a-9fce-1c8d2ab06862-kube-api-access-lm2lh\") pod \"network-check-target-ctklw\" (UID: \"50871a95-8056-497a-9fce-1c8d2ab06862\") " pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:37.048402 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.048307 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjn6b" Jul 07 16:47:37.151509 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.151483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvb6g\"" Jul 07 16:47:37.160380 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.160346 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:37.182015 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.181951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjn6b"] Jul 07 16:47:37.185779 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:37.185745 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289dcbab_3775_4b26_a054_eb399c271217.slice/crio-c50ec56dc76721f8eb15d6ea569aa6c1c438c7b29023163dcec246a223691dd9 WatchSource:0}: Error finding container c50ec56dc76721f8eb15d6ea569aa6c1c438c7b29023163dcec246a223691dd9: Status 404 returned error can't find the container with id c50ec56dc76721f8eb15d6ea569aa6c1c438c7b29023163dcec246a223691dd9 Jul 07 16:47:37.293105 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.293072 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ctklw"] Jul 07 16:47:37.296345 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:37.296312 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50871a95_8056_497a_9fce_1c8d2ab06862.slice/crio-5eb7951b03544678e4044c37093d5e073efeaca40d2d64120ac4d1114263302f WatchSource:0}: Error finding container 5eb7951b03544678e4044c37093d5e073efeaca40d2d64120ac4d1114263302f: Status 404 returned error can't find the container with id 5eb7951b03544678e4044c37093d5e073efeaca40d2d64120ac4d1114263302f Jul 07 16:47:37.436543 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.436485 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ctklw" event={"ID":"50871a95-8056-497a-9fce-1c8d2ab06862","Type":"ContainerStarted","Data":"5eb7951b03544678e4044c37093d5e073efeaca40d2d64120ac4d1114263302f"} Jul 07 16:47:37.437930 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.437894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4v72" event={"ID":"85752b58-34a0-4ef1-b051-3f9281c39bd9","Type":"ContainerStarted","Data":"3bef79f787ec6d9daa01a718d295a0d78b9aad000f4c6a79985a8a43565ef1ed"} Jul 07 16:47:37.439119 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.439089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjn6b" event={"ID":"289dcbab-3775-4b26-a054-eb399c271217","Type":"ContainerStarted","Data":"c50ec56dc76721f8eb15d6ea569aa6c1c438c7b29023163dcec246a223691dd9"} Jul 07 16:47:37.790174 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.790136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:37.792537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:37.792510 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ac1787c-f332-4049-92b2-1b2f070f998e-metrics-tls\") pod \"dns-default-b5dcw\" (UID: \"9ac1787c-f332-4049-92b2-1b2f070f998e\") " pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:38.040988 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.040891 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pvjc\"" Jul 07 16:47:38.049200 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.049156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:38.220419 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.220380 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b5dcw"] Jul 07 16:47:38.224218 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:38.224183 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac1787c_f332_4049_92b2_1b2f070f998e.slice/crio-886613c282fea3e7ab9f21480f2b321baa6b84755d388fefe5810f8d066193a9 WatchSource:0}: Error finding container 886613c282fea3e7ab9f21480f2b321baa6b84755d388fefe5810f8d066193a9: Status 404 returned error can't find the container with id 886613c282fea3e7ab9f21480f2b321baa6b84755d388fefe5810f8d066193a9 Jul 07 16:47:38.449062 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.448782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4v72" event={"ID":"85752b58-34a0-4ef1-b051-3f9281c39bd9","Type":"ContainerStarted","Data":"7519b02242544017c045b25ddfcb098fce6997a960880a78207915ce47707744"} Jul 07 16:47:38.449062 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.448895 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4v72" event={"ID":"85752b58-34a0-4ef1-b051-3f9281c39bd9","Type":"ContainerStarted","Data":"1ac8780a4ac18bb79af5511b89eed1e3c8fa3ecc04391962e464cf93c6a642d2"} Jul 07 16:47:38.450345 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.450314 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5dcw" event={"ID":"9ac1787c-f332-4049-92b2-1b2f070f998e","Type":"ContainerStarted","Data":"886613c282fea3e7ab9f21480f2b321baa6b84755d388fefe5810f8d066193a9"} Jul 07 16:47:38.475330 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:38.475232 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d4v72" podStartSLOduration=66.652702047 podStartE2EDuration="1m7.475207405s" totalImagesPullingTime="822.505358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:38.474243451 +0000 UTC m=+67.904911497" watchObservedRunningTime="2026-07-07 16:47:38.475207405 +0000 UTC m=+67.905875432" Jul 07 16:47:43.470465 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.470429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ctklw" event={"ID":"50871a95-8056-497a-9fce-1c8d2ab06862","Type":"ContainerStarted","Data":"c9a19421d0335ebdd3e0e194bc3e2f72506e1b69e6739141f113c29a97386c16"} Jul 07 16:47:43.470927 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.470512 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:47:43.471952 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.471921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjn6b" event={"ID":"289dcbab-3775-4b26-a054-eb399c271217","Type":"ContainerStarted","Data":"1e176b108d589f2ebdd7fa608b488c9fcdf8f49e2edad203ed4d0a76c7f5bc76"} Jul 07 16:47:43.473472 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.473454 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5dcw" event={"ID":"9ac1787c-f332-4049-92b2-1b2f070f998e","Type":"ContainerStarted","Data":"b7f7227052fa1598b75b2d01735dd9653c3870f66602a42b7a850e526274d5cf"} Jul 07 16:47:43.473579 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.473488 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b5dcw" event={"ID":"9ac1787c-f332-4049-92b2-1b2f070f998e","Type":"ContainerStarted","Data":"42865fd5993f52c09826e6bfbdd94c977ff346de586d47b501db1482cdad4c5a"} Jul 07 16:47:43.473644 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.473583 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:43.491292 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.491178 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ctklw" podStartSLOduration=66.986512824 podStartE2EDuration="1m12.49116177s" totalImagesPullingTime="5.504648946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:43.490376017 +0000 UTC m=+72.921044041" watchObservedRunningTime="2026-07-07 16:47:43.49116177 +0000 UTC m=+72.921829795" Jul 07 16:47:43.512883 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.512821 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rjn6b" podStartSLOduration=66.890643458 podStartE2EDuration="1m12.512798901s" totalImagesPullingTime="5.622155443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:43.511429929 +0000 UTC m=+72.942097973" watchObservedRunningTime="2026-07-07 16:47:43.512798901 +0000 UTC m=+72.943466929" Jul 07 16:47:43.533366 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:43.533311 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b5dcw" podStartSLOduration=33.96521754 podStartE2EDuration="38.533293508s" totalImagesPullingTime="4.568075968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:43.532946129 +0000 UTC m=+72.963614175" watchObservedRunningTime="2026-07-07 16:47:43.533293508 +0000 UTC m=+72.963961560" Jul 07 16:47:44.952782 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:44.952740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:44.955238 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:44.955212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"image-registry-65464d75b8-9l5bq\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:45.218518 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.218427 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xv5k5\"" Jul 07 16:47:45.226268 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.226238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:45.362728 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.362695 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65464d75b8-9l5bq"] Jul 07 16:47:45.366193 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:45.366165 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76d2a33_b5cc_4649_b4af_4773153b4af2.slice/crio-2980c09e8bbd56cf2143f0fd4653ff0ae6a560856d2dca4b9126574d96b02972 WatchSource:0}: Error finding container 2980c09e8bbd56cf2143f0fd4653ff0ae6a560856d2dca4b9126574d96b02972: Status 404 returned error can't find the container with id 2980c09e8bbd56cf2143f0fd4653ff0ae6a560856d2dca4b9126574d96b02972 Jul 07 16:47:45.483284 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.483191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" event={"ID":"a76d2a33-b5cc-4649-b4af-4773153b4af2","Type":"ContainerStarted","Data":"bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8"} Jul 07 16:47:45.483284 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.483253 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" event={"ID":"a76d2a33-b5cc-4649-b4af-4773153b4af2","Type":"ContainerStarted","Data":"2980c09e8bbd56cf2143f0fd4653ff0ae6a560856d2dca4b9126574d96b02972"} Jul 07 16:47:45.483468 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.483310 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:47:45.507653 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:45.507595 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" podStartSLOduration=32.507575754 podStartE2EDuration="32.507575754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:45.506403362 +0000 UTC m=+74.937071385" watchObservedRunningTime="2026-07-07 16:47:45.507575754 +0000 UTC m=+74.938243779" Jul 07 16:47:47.676723 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:47.676686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:47.679154 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:47.679132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4c580be-0d3a-4f30-acec-c6525da8d503-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pm2tz\" (UID: \"d4c580be-0d3a-4f30-acec-c6525da8d503\") " pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:47.908424 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:47.908388 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2mgsv\"" Jul 07 16:47:47.917141 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:47.917103 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pm2tz" Jul 07 16:47:48.055889 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:48.055851 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pm2tz"] Jul 07 16:47:48.058930 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:48.058897 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c580be_0d3a_4f30_acec_c6525da8d503.slice/crio-98c3cb86ae4bcb872c2348255e3280a944646634eba4f9bd784441b0d7e79d42 WatchSource:0}: Error finding container 98c3cb86ae4bcb872c2348255e3280a944646634eba4f9bd784441b0d7e79d42: Status 404 returned error can't find the container with id 98c3cb86ae4bcb872c2348255e3280a944646634eba4f9bd784441b0d7e79d42 Jul 07 16:47:48.506673 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:48.506630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm2tz" event={"ID":"d4c580be-0d3a-4f30-acec-c6525da8d503","Type":"ContainerStarted","Data":"98c3cb86ae4bcb872c2348255e3280a944646634eba4f9bd784441b0d7e79d42"} Jul 07 16:47:49.188384 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.188351 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw"] Jul 07 16:47:49.190477 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.190455 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.197288 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.197255 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8"] Jul 07 16:47:49.197739 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.197714 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 16:47:49.198056 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.198037 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bwlz6\"" Jul 07 16:47:49.198269 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.198254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 16:47:49.200284 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.200252 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.203646 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.203571 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 16:47:49.203791 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.203647 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 16:47:49.203863 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.203822 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 16:47:49.204125 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.204107 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 16:47:49.204943 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.204921 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 16:47:49.207320 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.206300 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 16:47:49.207320 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.206939 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 16:47:49.208104 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.208082 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw"] Jul 07 16:47:49.234792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.234756 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8"] Jul 07 16:47:49.245618 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.245583 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65464d75b8-9l5bq"] Jul 07 16:47:49.289765 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.289696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.289942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.289781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ws5d\" (UniqueName: \"kubernetes.io/projected/910992c7-f9b8-4a74-a10b-d30122ed9891-kube-api-access-4ws5d\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.289942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.289816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/698f9253-f776-4090-8dc4-94b1f2302391-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mm6dw\" (UID: \"698f9253-f776-4090-8dc4-94b1f2302391\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.289942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.289842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.289942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.289912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/910992c7-f9b8-4a74-a10b-d30122ed9891-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.290145 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.290004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-ca\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.290145 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.290034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698f9253-f776-4090-8dc4-94b1f2302391-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mm6dw\" (UID: \"698f9253-f776-4090-8dc4-94b1f2302391\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.290145 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.290063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-hub\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.391019 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.390966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.391197 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ws5d\" (UniqueName: \"kubernetes.io/projected/910992c7-f9b8-4a74-a10b-d30122ed9891-kube-api-access-4ws5d\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.391197 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/698f9253-f776-4090-8dc4-94b1f2302391-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mm6dw\" (UID: \"698f9253-f776-4090-8dc4-94b1f2302391\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.391197 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391109 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.391197 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/910992c7-f9b8-4a74-a10b-d30122ed9891-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.391197 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-ca\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.391436 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698f9253-f776-4090-8dc4-94b1f2302391-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mm6dw\" (UID: \"698f9253-f776-4090-8dc4-94b1f2302391\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.391436 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.391239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-hub\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.392060 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.392002 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/698f9253-f776-4090-8dc4-94b1f2302391-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-mm6dw\" (UID: \"698f9253-f776-4090-8dc4-94b1f2302391\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.392497 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.392447 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/910992c7-f9b8-4a74-a10b-d30122ed9891-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.394389 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.394335 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-hub\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.394494 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.394408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-ca\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.394494 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.394450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.394613 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.394541 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698f9253-f776-4090-8dc4-94b1f2302391-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-mm6dw\" (UID: \"698f9253-f776-4090-8dc4-94b1f2302391\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.394962 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.394943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/910992c7-f9b8-4a74-a10b-d30122ed9891-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.415100 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.415064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ws5d\" (UniqueName: \"kubernetes.io/projected/910992c7-f9b8-4a74-a10b-d30122ed9891-kube-api-access-4ws5d\") pod \"cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8\" (UID: \"910992c7-f9b8-4a74-a10b-d30122ed9891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.504119 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.504082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" Jul 07 16:47:49.523615 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.523581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" Jul 07 16:47:49.656665 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:49.656630 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw"] Jul 07 16:47:50.865607 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:50.865572 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698f9253_f776_4090_8dc4_94b1f2302391.slice/crio-7078dbbb1256b9cf2f7118642d4f6645f9a0f78d727229c1eae8f308814c92e6 WatchSource:0}: Error finding container 7078dbbb1256b9cf2f7118642d4f6645f9a0f78d727229c1eae8f308814c92e6: Status 404 returned error can't find the container with id 7078dbbb1256b9cf2f7118642d4f6645f9a0f78d727229c1eae8f308814c92e6 Jul 07 16:47:51.519383 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:51.519338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" event={"ID":"698f9253-f776-4090-8dc4-94b1f2302391","Type":"ContainerStarted","Data":"7078dbbb1256b9cf2f7118642d4f6645f9a0f78d727229c1eae8f308814c92e6"} Jul 07 16:47:51.944149 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:51.944098 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8"] Jul 07 16:47:51.948317 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:47:51.948282 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod910992c7_f9b8_4a74_a10b_d30122ed9891.slice/crio-632f031095e2060513cf642fa59a9d4f6170a8b8d62dce5707e8e7e66ce8e183 WatchSource:0}: Error finding container 632f031095e2060513cf642fa59a9d4f6170a8b8d62dce5707e8e7e66ce8e183: Status 404 returned error can't find the container with id 632f031095e2060513cf642fa59a9d4f6170a8b8d62dce5707e8e7e66ce8e183 Jul 07 16:47:52.524537 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:52.524505 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm2tz" event={"ID":"d4c580be-0d3a-4f30-acec-c6525da8d503","Type":"ContainerStarted","Data":"58fc9d270b3f768c170d5181dad2f198197a5d208eead6c99d8d3e2c87e11191"} Jul 07 16:47:52.525540 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:52.525507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" event={"ID":"910992c7-f9b8-4a74-a10b-d30122ed9891","Type":"ContainerStarted","Data":"632f031095e2060513cf642fa59a9d4f6170a8b8d62dce5707e8e7e66ce8e183"} Jul 07 16:47:53.480898 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:53.480864 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b5dcw" Jul 07 16:47:53.536683 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:53.536636 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm2tz" event={"ID":"d4c580be-0d3a-4f30-acec-c6525da8d503","Type":"ContainerStarted","Data":"22b4595440763ac9ea96fd3d3a4e9052effa879ea6c1d3a233104ea41366e627"} Jul 07 16:47:53.539058 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:53.539026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" event={"ID":"698f9253-f776-4090-8dc4-94b1f2302391","Type":"ContainerStarted","Data":"b25c35e2e33530fe7fe871085ea600779f460460ebe0c346e0d4ba57f96f0a6f"} Jul 07 16:47:53.555667 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:53.555605 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-mm6dw" podStartSLOduration=2.877600822 podStartE2EDuration="4.55558166s" totalImagesPullingTime="1.677980838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:53.555050089 +0000 UTC m=+82.985718153" watchObservedRunningTime="2026-07-07 16:47:53.55558166 +0000 UTC m=+82.986249685" Jul 07 16:47:57.555738 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:57.555703 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pm2tz" event={"ID":"d4c580be-0d3a-4f30-acec-c6525da8d503","Type":"ContainerStarted","Data":"ec432275277e4e70bfd24dc192c983f7264a83b1895f973a534a018cea227b05"} Jul 07 16:47:57.558035 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:57.558011 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" event={"ID":"910992c7-f9b8-4a74-a10b-d30122ed9891","Type":"ContainerStarted","Data":"59be41fb749c45a2fc1eb8cc9cf2b07d7d650ffb6e88320edd6b19c2d2c3fbf5"} Jul 07 16:47:57.558129 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:57.558051 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" event={"ID":"910992c7-f9b8-4a74-a10b-d30122ed9891","Type":"ContainerStarted","Data":"ac01301b5ae1ebc107507eaabc83cf2b0a55a895e94d2b3d1a9195e553d1982d"} Jul 07 16:47:57.584000 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:57.583933 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pm2tz" podStartSLOduration=33.423268272 podStartE2EDuration="42.583914234s" totalImagesPullingTime="9.160645962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:47:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:57.582287556 +0000 UTC m=+87.012955625" watchObservedRunningTime="2026-07-07 16:47:57.583914234 +0000 UTC m=+87.014582295" Jul 07 16:47:58.563937 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:58.563897 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" event={"ID":"910992c7-f9b8-4a74-a10b-d30122ed9891","Type":"ContainerStarted","Data":"d63ca82ee6a59c5651332f27433b12d42d48067518dcbe1687c0af8ba6e463f9"} Jul 07 16:47:58.591300 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:47:58.591244 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbcb5f7c5-2v9h8" podStartSLOduration=4.157055078 podStartE2EDuration="9.591227537s" totalImagesPullingTime="5.434172459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:58.590836486 +0000 UTC m=+88.021504530" watchObservedRunningTime="2026-07-07 16:47:58.591227537 +0000 UTC m=+88.021895561" Jul 07 16:48:01.912864 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.912817 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v8gvd"] Jul 07 16:48:01.917275 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.917254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.919360 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.919334 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:48:01.919497 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.919452 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fzkwc\"" Jul 07 16:48:01.919658 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.919645 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:48:01.919750 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.919726 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:48:01.919928 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.919913 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:48:01.920034 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.919997 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:48:01.920146 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.920130 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:48:01.997659 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-tls\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.997659 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcef63e-6f49-4221-a9e9-123989c807f1-metrics-client-ca\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.997872 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42nj\" (UniqueName: \"kubernetes.io/projected/ffcef63e-6f49-4221-a9e9-123989c807f1-kube-api-access-r42nj\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.997872 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-textfile\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.997872 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-wtmp\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.997872 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-sys\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.997872 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.998058 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:01.998058 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:01.997912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-root\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099193 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099193 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099218 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-root\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-root\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-tls\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099313 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcef63e-6f49-4221-a9e9-123989c807f1-metrics-client-ca\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099329 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42nj\" (UniqueName: \"kubernetes.io/projected/ffcef63e-6f49-4221-a9e9-123989c807f1-kube-api-access-r42nj\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-textfile\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-wtmp\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099467 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-sys\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:48:02.099472 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:48:02.099533 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-tls podName:ffcef63e-6f49-4221-a9e9-123989c807f1 nodeName:}" failed. No retries permitted until 2026-07-07 16:48:02.59951444 +0000 UTC m=+92.030182454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-tls") pod "node-exporter-v8gvd" (UID: "ffcef63e-6f49-4221-a9e9-123989c807f1") : secret "node-exporter-tls" not found Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-wtmp\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099635 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffcef63e-6f49-4221-a9e9-123989c807f1-sys\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099668 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-textfile\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.099891 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.099838 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcef63e-6f49-4221-a9e9-123989c807f1-metrics-client-ca\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.101550 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.101529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.110565 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.110537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42nj\" (UniqueName: \"kubernetes.io/projected/ffcef63e-6f49-4221-a9e9-123989c807f1-kube-api-access-r42nj\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.603152 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.603111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-tls\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.605629 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.605601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffcef63e-6f49-4221-a9e9-123989c807f1-node-exporter-tls\") pod \"node-exporter-v8gvd\" (UID: \"ffcef63e-6f49-4221-a9e9-123989c807f1\") " pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.826336 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:02.826300 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v8gvd" Jul 07 16:48:02.838842 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:48:02.838814 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcef63e_6f49_4221_a9e9_123989c807f1.slice/crio-5c97257e0c985991e7b7e2f3220b57664485cd6e147784f66aff5173dfb4f476 WatchSource:0}: Error finding container 5c97257e0c985991e7b7e2f3220b57664485cd6e147784f66aff5173dfb4f476: Status 404 returned error can't find the container with id 5c97257e0c985991e7b7e2f3220b57664485cd6e147784f66aff5173dfb4f476 Jul 07 16:48:03.581479 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:03.581431 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8gvd" event={"ID":"ffcef63e-6f49-4221-a9e9-123989c807f1","Type":"ContainerStarted","Data":"5c97257e0c985991e7b7e2f3220b57664485cd6e147784f66aff5173dfb4f476"} Jul 07 16:48:04.586212 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:04.586172 2567 generic.go:356] "Generic (PLEG): container finished" podID="ffcef63e-6f49-4221-a9e9-123989c807f1" containerID="525baf76fc2b470267bb1897029447e307f539410f7ebd3d63c780a42ce70fab" exitCode=0 Jul 07 16:48:04.586576 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:04.586263 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8gvd" event={"ID":"ffcef63e-6f49-4221-a9e9-123989c807f1","Type":"ContainerDied","Data":"525baf76fc2b470267bb1897029447e307f539410f7ebd3d63c780a42ce70fab"} Jul 07 16:48:05.592998 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:05.592941 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8gvd" event={"ID":"ffcef63e-6f49-4221-a9e9-123989c807f1","Type":"ContainerStarted","Data":"937ab1923b398ec5dd669ebfc03804af2283cf107b3e6d480c51029e1df92aad"} Jul 07 16:48:05.593484 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:05.593037 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v8gvd" event={"ID":"ffcef63e-6f49-4221-a9e9-123989c807f1","Type":"ContainerStarted","Data":"a5fe9a89ac2637bfa04d7ee5118f314f3b5a512508094c0bf1e4d8259ebdbba5"} Jul 07 16:48:05.627134 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:05.627074 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v8gvd" podStartSLOduration=3.75580179 podStartE2EDuration="4.627051751s" totalImagesPullingTime="802.237375ms" totalInitContainerRuntime="69.012586ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:05.625275584 +0000 UTC m=+95.055943609" watchObservedRunningTime="2026-07-07 16:48:05.627051751 +0000 UTC m=+95.057719780" Jul 07 16:48:06.402746 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.402710 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59dc794ccb-wlbkp"] Jul 07 16:48:06.405954 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.405928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.410124 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.410092 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tvv6v\"" Jul 07 16:48:06.410124 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.410112 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 16:48:06.410331 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.410092 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 16:48:06.410331 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.410103 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 16:48:06.410773 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.410752 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 16:48:06.410901 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.410853 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7u8vbr3on78rv\"" Jul 07 16:48:06.419405 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.419362 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59dc794ccb-wlbkp"] Jul 07 16:48:06.535490 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435e5879-f8e3-4701-a453-a3d1a8de6904-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.535674 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-secret-metrics-server-tls\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.535674 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-secret-metrics-server-client-certs\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.535674 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535566 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/435e5879-f8e3-4701-a453-a3d1a8de6904-audit-log\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.535674 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzwm\" (UniqueName: \"kubernetes.io/projected/435e5879-f8e3-4701-a453-a3d1a8de6904-kube-api-access-qzzwm\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.535807 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-client-ca-bundle\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.535807 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.535739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/435e5879-f8e3-4701-a453-a3d1a8de6904-metrics-server-audit-profiles\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637165 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-client-ca-bundle\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/435e5879-f8e3-4701-a453-a3d1a8de6904-metrics-server-audit-profiles\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435e5879-f8e3-4701-a453-a3d1a8de6904-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-secret-metrics-server-tls\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-secret-metrics-server-client-certs\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/435e5879-f8e3-4701-a453-a3d1a8de6904-audit-log\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637572 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzwm\" (UniqueName: \"kubernetes.io/projected/435e5879-f8e3-4701-a453-a3d1a8de6904-kube-api-access-qzzwm\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.637876 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.637798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/435e5879-f8e3-4701-a453-a3d1a8de6904-audit-log\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.638037 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.638016 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435e5879-f8e3-4701-a453-a3d1a8de6904-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.638418 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.638394 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/435e5879-f8e3-4701-a453-a3d1a8de6904-metrics-server-audit-profiles\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.639770 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.639742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-secret-metrics-server-tls\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.640167 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.640151 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-client-ca-bundle\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.640350 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.640328 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/435e5879-f8e3-4701-a453-a3d1a8de6904-secret-metrics-server-client-certs\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.647917 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.647890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzwm\" (UniqueName: \"kubernetes.io/projected/435e5879-f8e3-4701-a453-a3d1a8de6904-kube-api-access-qzzwm\") pod \"metrics-server-59dc794ccb-wlbkp\" (UID: \"435e5879-f8e3-4701-a453-a3d1a8de6904\") " pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.716521 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.716494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:06.859086 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.859051 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59dc794ccb-wlbkp"] Jul 07 16:48:06.862368 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:48:06.862335 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435e5879_f8e3_4701_a453_a3d1a8de6904.slice/crio-7560993ac4c821c2d54a4d099533d44318f8352b6ee3d5fea345434d2bc00f59 WatchSource:0}: Error finding container 7560993ac4c821c2d54a4d099533d44318f8352b6ee3d5fea345434d2bc00f59: Status 404 returned error can't find the container with id 7560993ac4c821c2d54a4d099533d44318f8352b6ee3d5fea345434d2bc00f59 Jul 07 16:48:06.915514 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.915473 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b99b95d99-p78cw"] Jul 07 16:48:06.919849 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.919829 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:06.922126 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.922092 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:48:06.922233 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.922158 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:48:06.922233 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.922160 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:48:06.922709 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.922694 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:48:06.922914 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.922899 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:48:06.923729 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.923711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:48:06.924281 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.924264 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:48:06.924505 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.924489 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2q9xq\"" Jul 07 16:48:06.931915 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.931888 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:48:06.935662 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:06.935637 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b99b95d99-p78cw"] Jul 07 16:48:07.041151 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-config\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.041151 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7t68\" (UniqueName: \"kubernetes.io/projected/3e3d555f-8128-489d-b122-9ab9ab5045e2-kube-api-access-z7t68\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.041327 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-service-ca\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.041327 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-oauth-config\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.041327 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-oauth-serving-cert\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.041424 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-trusted-ca-bundle\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.041424 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.041362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-serving-cert\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142691 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-service-ca\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142691 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-oauth-config\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142947 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-oauth-serving-cert\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142947 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-trusted-ca-bundle\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142947 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-serving-cert\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142947 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-config\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.142947 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.142830 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7t68\" (UniqueName: \"kubernetes.io/projected/3e3d555f-8128-489d-b122-9ab9ab5045e2-kube-api-access-z7t68\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.143568 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.143539 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-oauth-serving-cert\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.143682 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.143573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-config\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.143682 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.143626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-service-ca\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.143896 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.143873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-trusted-ca-bundle\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.145233 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.145202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-oauth-config\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.145316 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.145301 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-serving-cert\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.156061 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.156040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7t68\" (UniqueName: \"kubernetes.io/projected/3e3d555f-8128-489d-b122-9ab9ab5045e2-kube-api-access-z7t68\") pod \"console-6b99b95d99-p78cw\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.233618 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.233574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:07.380208 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.380173 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b99b95d99-p78cw"] Jul 07 16:48:07.383320 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:48:07.383287 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3d555f_8128_489d_b122_9ab9ab5045e2.slice/crio-23dee6829a28d06082c5d52c223460ae553d34b7b51de4ec436f708e5ba01fc0 WatchSource:0}: Error finding container 23dee6829a28d06082c5d52c223460ae553d34b7b51de4ec436f708e5ba01fc0: Status 404 returned error can't find the container with id 23dee6829a28d06082c5d52c223460ae553d34b7b51de4ec436f708e5ba01fc0 Jul 07 16:48:07.602763 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.602672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99b95d99-p78cw" event={"ID":"3e3d555f-8128-489d-b122-9ab9ab5045e2","Type":"ContainerStarted","Data":"23dee6829a28d06082c5d52c223460ae553d34b7b51de4ec436f708e5ba01fc0"} Jul 07 16:48:07.604027 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:07.603992 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" event={"ID":"435e5879-f8e3-4701-a453-a3d1a8de6904","Type":"ContainerStarted","Data":"7560993ac4c821c2d54a4d099533d44318f8352b6ee3d5fea345434d2bc00f59"} Jul 07 16:48:08.609717 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:08.609628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" event={"ID":"435e5879-f8e3-4701-a453-a3d1a8de6904","Type":"ContainerStarted","Data":"72562dd29454dd5745958c7d332cac02b1709ecde3eb4c6f73d004ab7344d5f0"} Jul 07 16:48:08.631319 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:08.631253 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" podStartSLOduration=1.165522813 podStartE2EDuration="2.631230696s" totalImagesPullingTime="1.465707883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:08.629143588 +0000 UTC m=+98.059811614" watchObservedRunningTime="2026-07-07 16:48:08.631230696 +0000 UTC m=+98.061898721" Jul 07 16:48:09.251286 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:09.251253 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:48:10.619194 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:10.619158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99b95d99-p78cw" event={"ID":"3e3d555f-8128-489d-b122-9ab9ab5045e2","Type":"ContainerStarted","Data":"4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757"} Jul 07 16:48:10.642913 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:10.642859 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b99b95d99-p78cw" podStartSLOduration=1.4799149790000001 podStartE2EDuration="4.642841912s" totalImagesPullingTime="3.162926933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:10.641366621 +0000 UTC m=+100.072034669" watchObservedRunningTime="2026-07-07 16:48:10.642841912 +0000 UTC m=+100.073509938" Jul 07 16:48:12.806701 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:12.806664 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b99b95d99-p78cw"] Jul 07 16:48:14.270228 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.270168 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" podUID="a76d2a33-b5cc-4649-b4af-4773153b4af2" containerName="registry" containerID="cri-o://bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8" gracePeriod=30 Jul 07 16:48:14.480230 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.480199 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ctklw" Jul 07 16:48:14.551671 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.551594 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:48:14.604871 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.604835 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.604893 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-image-registry-private-configuration\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.604920 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-installation-pull-secrets\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605067 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.604959 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-trusted-ca\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605346 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.605312 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-bound-sa-token\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605447 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.605399 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76d2a33-b5cc-4649-b4af-4773153b4af2-ca-trust-extracted\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605447 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.605404 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:48:14.605447 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.605431 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs657\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-kube-api-access-hs657\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.605672 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.605641 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-trusted-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.608086 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.608030 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:48:14.608191 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.608081 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-kube-api-access-hs657" (OuterVolumeSpecName: "kube-api-access-hs657") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "kube-api-access-hs657". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:48:14.608191 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.608086 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:48:14.608191 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.608128 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:48:14.608191 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.608138 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:48:14.613495 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.613458 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76d2a33-b5cc-4649-b4af-4773153b4af2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:48:14.634945 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.634909 2567 generic.go:356] "Generic (PLEG): container finished" podID="a76d2a33-b5cc-4649-b4af-4773153b4af2" containerID="bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8" exitCode=0 Jul 07 16:48:14.635144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.634955 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" Jul 07 16:48:14.635144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.635013 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" event={"ID":"a76d2a33-b5cc-4649-b4af-4773153b4af2","Type":"ContainerDied","Data":"bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8"} Jul 07 16:48:14.635144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.635063 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65464d75b8-9l5bq" event={"ID":"a76d2a33-b5cc-4649-b4af-4773153b4af2","Type":"ContainerDied","Data":"2980c09e8bbd56cf2143f0fd4653ff0ae6a560856d2dca4b9126574d96b02972"} Jul 07 16:48:14.635144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.635084 2567 scope.go:117] "RemoveContainer" containerID="bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8" Jul 07 16:48:14.644762 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.644430 2567 scope.go:117] "RemoveContainer" containerID="bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8" Jul 07 16:48:14.645206 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:48:14.645171 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8\": container with ID starting with bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8 not found: ID does not exist" containerID="bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8" Jul 07 16:48:14.645299 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.645214 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8"} err="failed to get container status \"bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8\": rpc error: code = NotFound desc = could not find container \"bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8\": container with ID starting with bd7a00353cd44f0510831f601e5561e2d6b93201e6e14af9d3b908b51c6821a8 not found: ID does not exist" Jul 07 16:48:14.706622 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706583 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-certificates\") pod \"a76d2a33-b5cc-4649-b4af-4773153b4af2\" (UID: \"a76d2a33-b5cc-4649-b4af-4773153b4af2\") " Jul 07 16:48:14.706766 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706755 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-image-registry-private-configuration\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.706826 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706775 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a76d2a33-b5cc-4649-b4af-4773153b4af2-installation-pull-secrets\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.706826 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706789 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-bound-sa-token\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.706826 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706801 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a76d2a33-b5cc-4649-b4af-4773153b4af2-ca-trust-extracted\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.706826 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706814 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs657\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-kube-api-access-hs657\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.706939 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.706827 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-tls\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.707045 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.707026 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a76d2a33-b5cc-4649-b4af-4773153b4af2" (UID: "a76d2a33-b5cc-4649-b4af-4773153b4af2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:48:14.807966 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.807882 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a76d2a33-b5cc-4649-b4af-4773153b4af2-registry-certificates\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:14.961965 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.961930 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65464d75b8-9l5bq"] Jul 07 16:48:14.965579 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:14.965554 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65464d75b8-9l5bq"] Jul 07 16:48:15.136619 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:15.136528 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76d2a33-b5cc-4649-b4af-4773153b4af2" path="/var/lib/kubelet/pods/a76d2a33-b5cc-4649-b4af-4773153b4af2/volumes" Jul 07 16:48:17.234746 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:17.234701 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:26.717426 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:26.717382 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:26.717926 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:26.717479 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:37.827610 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:37.827544 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b99b95d99-p78cw" podUID="3e3d555f-8128-489d-b122-9ab9ab5045e2" containerName="console" containerID="cri-o://4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757" gracePeriod=15 Jul 07 16:48:38.079165 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.079103 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:38.187230 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187188 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7t68\" (UniqueName: \"kubernetes.io/projected/3e3d555f-8128-489d-b122-9ab9ab5045e2-kube-api-access-z7t68\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187230 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187233 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-serving-cert\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187443 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187276 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-oauth-serving-cert\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187443 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187395 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-config\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187443 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187435 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-service-ca\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187581 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187465 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-oauth-config\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187581 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187494 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-trusted-ca-bundle\") pod \"3e3d555f-8128-489d-b122-9ab9ab5045e2\" (UID: \"3e3d555f-8128-489d-b122-9ab9ab5045e2\") " Jul 07 16:48:38.187757 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187707 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:48:38.187757 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187734 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:48:38.188017 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.187785 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-config" (OuterVolumeSpecName: "console-config") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:48:38.188108 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.188080 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:48:38.189646 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.189622 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3d555f-8128-489d-b122-9ab9ab5045e2-kube-api-access-z7t68" (OuterVolumeSpecName: "kube-api-access-z7t68") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "kube-api-access-z7t68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:48:38.189751 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.189628 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:48:38.189751 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.189666 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e3d555f-8128-489d-b122-9ab9ab5045e2" (UID: "3e3d555f-8128-489d-b122-9ab9ab5045e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:48:38.288865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288817 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-oauth-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.288865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288851 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.288865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288861 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-service-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.288865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288870 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-oauth-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.288865 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288878 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e3d555f-8128-489d-b122-9ab9ab5045e2-trusted-ca-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.289196 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288887 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7t68\" (UniqueName: \"kubernetes.io/projected/3e3d555f-8128-489d-b122-9ab9ab5045e2-kube-api-access-z7t68\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.289196 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.288897 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e3d555f-8128-489d-b122-9ab9ab5045e2-console-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:48:38.726077 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.726043 2567 generic.go:356] "Generic (PLEG): container finished" podID="3e3d555f-8128-489d-b122-9ab9ab5045e2" containerID="4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757" exitCode=0 Jul 07 16:48:38.726246 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.726092 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99b95d99-p78cw" Jul 07 16:48:38.726246 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.726106 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99b95d99-p78cw" event={"ID":"3e3d555f-8128-489d-b122-9ab9ab5045e2","Type":"ContainerDied","Data":"4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757"} Jul 07 16:48:38.726246 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.726148 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99b95d99-p78cw" event={"ID":"3e3d555f-8128-489d-b122-9ab9ab5045e2","Type":"ContainerDied","Data":"23dee6829a28d06082c5d52c223460ae553d34b7b51de4ec436f708e5ba01fc0"} Jul 07 16:48:38.726246 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.726167 2567 scope.go:117] "RemoveContainer" containerID="4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757" Jul 07 16:48:38.734533 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.734511 2567 scope.go:117] "RemoveContainer" containerID="4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757" Jul 07 16:48:38.734853 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:48:38.734829 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757\": container with ID starting with 4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757 not found: ID does not exist" containerID="4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757" Jul 07 16:48:38.734900 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.734863 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757"} err="failed to get container status \"4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757\": rpc error: code = NotFound desc = could not find container \"4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757\": container with ID starting with 4ab79a508496418a5c4e3c023e2c50f6ea54c8acb455a217d0788091a469d757 not found: ID does not exist" Jul 07 16:48:38.748802 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.748772 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b99b95d99-p78cw"] Jul 07 16:48:38.750813 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:38.750789 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b99b95d99-p78cw"] Jul 07 16:48:39.136245 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:39.136160 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e3d555f-8128-489d-b122-9ab9ab5045e2" path="/var/lib/kubelet/pods/3e3d555f-8128-489d-b122-9ab9ab5045e2/volumes" Jul 07 16:48:46.722448 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:46.722411 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:48:46.726408 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:48:46.726382 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59dc794ccb-wlbkp" Jul 07 16:49:36.580227 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580190 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8666bc7b95-nsxq7"] Jul 07 16:49:36.580654 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580434 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76d2a33-b5cc-4649-b4af-4773153b4af2" containerName="registry" Jul 07 16:49:36.580654 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580445 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76d2a33-b5cc-4649-b4af-4773153b4af2" containerName="registry" Jul 07 16:49:36.580654 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580461 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3d555f-8128-489d-b122-9ab9ab5045e2" containerName="console" Jul 07 16:49:36.580654 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580467 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3d555f-8128-489d-b122-9ab9ab5045e2" containerName="console" Jul 07 16:49:36.580654 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580508 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3d555f-8128-489d-b122-9ab9ab5045e2" containerName="console" Jul 07 16:49:36.580654 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.580517 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a76d2a33-b5cc-4649-b4af-4773153b4af2" containerName="registry" Jul 07 16:49:36.582658 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.582628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.585286 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.585261 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:49:36.585386 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.585269 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:49:36.586010 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.585971 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:49:36.586126 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.585971 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2q9xq\"" Jul 07 16:49:36.586126 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.586070 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:49:36.586126 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.586091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:49:36.586126 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.586110 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:49:36.586317 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.586091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:49:36.593968 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.593943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:49:36.603251 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.603217 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666bc7b95-nsxq7"] Jul 07 16:49:36.722363 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-trusted-ca-bundle\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.722540 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-serving-cert\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.722540 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-oauth-serving-cert\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.722540 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcz8h\" (UniqueName: \"kubernetes.io/projected/592d7dcd-fa03-499d-b388-8eb54e4afa85-kube-api-access-hcz8h\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.722540 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-config\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.722540 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-oauth-config\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.722703 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.722585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-service-ca\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.822988 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.822944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-oauth-serving-cert\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823166 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcz8h\" (UniqueName: \"kubernetes.io/projected/592d7dcd-fa03-499d-b388-8eb54e4afa85-kube-api-access-hcz8h\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823166 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-config\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823166 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-oauth-config\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823166 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823148 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-service-ca\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823361 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-trusted-ca-bundle\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823361 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-serving-cert\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823800 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-oauth-serving-cert\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823932 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-config\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.823932 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.823823 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-service-ca\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.824143 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.824123 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-trusted-ca-bundle\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.825677 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.825648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-oauth-config\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.825791 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.825740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-serving-cert\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.833690 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.833609 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcz8h\" (UniqueName: \"kubernetes.io/projected/592d7dcd-fa03-499d-b388-8eb54e4afa85-kube-api-access-hcz8h\") pod \"console-8666bc7b95-nsxq7\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:36.895406 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:36.895366 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:37.057927 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:37.057895 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666bc7b95-nsxq7"] Jul 07 16:49:37.061261 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:49:37.061236 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592d7dcd_fa03_499d_b388_8eb54e4afa85.slice/crio-91eceb5a2abbe01ea32fe1ee263396a554ab9a0d80e223583a0abc9a17824086 WatchSource:0}: Error finding container 91eceb5a2abbe01ea32fe1ee263396a554ab9a0d80e223583a0abc9a17824086: Status 404 returned error can't find the container with id 91eceb5a2abbe01ea32fe1ee263396a554ab9a0d80e223583a0abc9a17824086 Jul 07 16:49:37.936450 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:37.936409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666bc7b95-nsxq7" event={"ID":"592d7dcd-fa03-499d-b388-8eb54e4afa85","Type":"ContainerStarted","Data":"5c73e3221f8286bf527330dfeaba5bb98478791cd554c6bdc4be2c8ebd07a410"} Jul 07 16:49:37.936841 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:37.936476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666bc7b95-nsxq7" event={"ID":"592d7dcd-fa03-499d-b388-8eb54e4afa85","Type":"ContainerStarted","Data":"91eceb5a2abbe01ea32fe1ee263396a554ab9a0d80e223583a0abc9a17824086"} Jul 07 16:49:37.959520 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:37.959467 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8666bc7b95-nsxq7" podStartSLOduration=1.959447472 podStartE2EDuration="1.959447472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:49:37.958414097 +0000 UTC m=+187.389082137" watchObservedRunningTime="2026-07-07 16:49:37.959447472 +0000 UTC m=+187.390115496" Jul 07 16:49:46.896482 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:46.896421 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:46.897029 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:46.896519 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:46.901446 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:46.901418 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:49:46.973432 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:49:46.973400 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:50:50.573346 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.573312 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm"] Jul 07 16:50:50.575700 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.575680 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.582229 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.582008 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 16:50:50.582229 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.582108 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 16:50:50.582721 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.582702 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rt7zq\"" Jul 07 16:50:50.595077 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.595047 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm"] Jul 07 16:50:50.678103 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.678063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cvz\" (UniqueName: \"kubernetes.io/projected/0f9f2055-3011-46c3-8fbc-35b306aa03e3-kube-api-access-f4cvz\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.678283 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.678123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.678283 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.678226 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.779446 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.779398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.779446 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.779451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cvz\" (UniqueName: \"kubernetes.io/projected/0f9f2055-3011-46c3-8fbc-35b306aa03e3-kube-api-access-f4cvz\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.779665 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.779492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.779838 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.779816 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.779896 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.779830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.790566 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.790530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cvz\" (UniqueName: \"kubernetes.io/projected/0f9f2055-3011-46c3-8fbc-35b306aa03e3-kube-api-access-f4cvz\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:50.885720 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:50.885635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:50:51.023068 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:51.023042 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm"] Jul 07 16:50:51.025363 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:50:51.025332 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9f2055_3011_46c3_8fbc_35b306aa03e3.slice/crio-de2cb9468fc957654b618815e6f7fb0e233803d2689ed5324833b644c205d028 WatchSource:0}: Error finding container de2cb9468fc957654b618815e6f7fb0e233803d2689ed5324833b644c205d028: Status 404 returned error can't find the container with id de2cb9468fc957654b618815e6f7fb0e233803d2689ed5324833b644c205d028 Jul 07 16:50:51.195327 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:51.195243 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" event={"ID":"0f9f2055-3011-46c3-8fbc-35b306aa03e3","Type":"ContainerStarted","Data":"de2cb9468fc957654b618815e6f7fb0e233803d2689ed5324833b644c205d028"} Jul 07 16:50:59.227408 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:59.227368 2567 generic.go:356] "Generic (PLEG): container finished" podID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerID="a0d053832e86e7cab9e8c5db126c590c504339dc1ceb2d859ada0cdbbf07ff40" exitCode=0 Jul 07 16:50:59.227818 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:50:59.227464 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" event={"ID":"0f9f2055-3011-46c3-8fbc-35b306aa03e3","Type":"ContainerDied","Data":"a0d053832e86e7cab9e8c5db126c590c504339dc1ceb2d859ada0cdbbf07ff40"} Jul 07 16:51:02.240051 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:02.240014 2567 generic.go:356] "Generic (PLEG): container finished" podID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerID="ffb7ed2d38521e625c553e28c1a280c3f7f31b04cf4748b68702574ffdd597a9" exitCode=0 Jul 07 16:51:02.240509 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:02.240108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" event={"ID":"0f9f2055-3011-46c3-8fbc-35b306aa03e3","Type":"ContainerDied","Data":"ffb7ed2d38521e625c553e28c1a280c3f7f31b04cf4748b68702574ffdd597a9"} Jul 07 16:51:10.273866 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:10.273828 2567 generic.go:356] "Generic (PLEG): container finished" podID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerID="6eb08335918ba6bc96c89b57c01aaa9ce68f595134e0838bafb694f5f89d2a82" exitCode=0 Jul 07 16:51:10.274274 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:10.273876 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" event={"ID":"0f9f2055-3011-46c3-8fbc-35b306aa03e3","Type":"ContainerDied","Data":"6eb08335918ba6bc96c89b57c01aaa9ce68f595134e0838bafb694f5f89d2a82"} Jul 07 16:51:11.398850 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.398823 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:51:11.450026 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.449968 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-util\") pod \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " Jul 07 16:51:11.450213 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.450039 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4cvz\" (UniqueName: \"kubernetes.io/projected/0f9f2055-3011-46c3-8fbc-35b306aa03e3-kube-api-access-f4cvz\") pod \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " Jul 07 16:51:11.450213 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.450096 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-bundle\") pod \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\" (UID: \"0f9f2055-3011-46c3-8fbc-35b306aa03e3\") " Jul 07 16:51:11.450683 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.450659 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-bundle" (OuterVolumeSpecName: "bundle") pod "0f9f2055-3011-46c3-8fbc-35b306aa03e3" (UID: "0f9f2055-3011-46c3-8fbc-35b306aa03e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:51:11.452223 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.452198 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9f2055-3011-46c3-8fbc-35b306aa03e3-kube-api-access-f4cvz" (OuterVolumeSpecName: "kube-api-access-f4cvz") pod "0f9f2055-3011-46c3-8fbc-35b306aa03e3" (UID: "0f9f2055-3011-46c3-8fbc-35b306aa03e3"). InnerVolumeSpecName "kube-api-access-f4cvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:51:11.455053 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.455033 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-util" (OuterVolumeSpecName: "util") pod "0f9f2055-3011-46c3-8fbc-35b306aa03e3" (UID: "0f9f2055-3011-46c3-8fbc-35b306aa03e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:51:11.551585 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.551481 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-util\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:51:11.551585 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.551527 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4cvz\" (UniqueName: \"kubernetes.io/projected/0f9f2055-3011-46c3-8fbc-35b306aa03e3-kube-api-access-f4cvz\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:51:11.551585 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:11.551537 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9f2055-3011-46c3-8fbc-35b306aa03e3-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:51:12.282369 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:12.282327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" event={"ID":"0f9f2055-3011-46c3-8fbc-35b306aa03e3","Type":"ContainerDied","Data":"de2cb9468fc957654b618815e6f7fb0e233803d2689ed5324833b644c205d028"} Jul 07 16:51:12.282369 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:12.282349 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb58949hzm" Jul 07 16:51:12.282369 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:12.282377 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de2cb9468fc957654b618815e6f7fb0e233803d2689ed5324833b644c205d028" Jul 07 16:51:18.997178 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997136 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd"] Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997479 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="util" Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997499 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="util" Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997515 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="extract" Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997527 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="extract" Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997542 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="pull" Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997549 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="pull" Jul 07 16:51:18.997806 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:18.997624 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f9f2055-3011-46c3-8fbc-35b306aa03e3" containerName="extract" Jul 07 16:51:19.000962 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.000937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:19.032931 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:19.032891 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kedaorg-certs\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" type="*v1.Secret" Jul 07 16:51:19.033132 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:19.032929 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 07 16:51:19.033132 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:19.032932 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"custom-metrics-autoscaler-operator-dockercfg-xhcvr\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-xhcvr\"" type="*v1.Secret" Jul 07 16:51:19.033132 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:19.032999 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" podUID="df33e824-1fd7-481e-8387-63bf2b2671fc" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:19.033132 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:19.033014 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 07 16:51:19.042433 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.042403 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd"] Jul 07 16:51:19.108213 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.108171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8q88\" (UniqueName: \"kubernetes.io/projected/df33e824-1fd7-481e-8387-63bf2b2671fc-kube-api-access-j8q88\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:19.108213 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.108209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df33e824-1fd7-481e-8387-63bf2b2671fc-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:19.208879 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.208838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8q88\" (UniqueName: \"kubernetes.io/projected/df33e824-1fd7-481e-8387-63bf2b2671fc-kube-api-access-j8q88\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:19.208879 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.208877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df33e824-1fd7-481e-8387-63bf2b2671fc-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:19.901206 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.901172 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 07 16:51:19.926492 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.926460 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 07 16:51:19.927287 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.927269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-xhcvr\"" Jul 07 16:51:19.936382 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:19.936359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8q88\" (UniqueName: \"kubernetes.io/projected/df33e824-1fd7-481e-8387-63bf2b2671fc-kube-api-access-j8q88\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:20.209317 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:20.209281 2567 secret.go:189] Couldn't get secret openshift-keda/kedaorg-certs: failed to sync secret cache: timed out waiting for the condition Jul 07 16:51:20.209710 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:20.209379 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df33e824-1fd7-481e-8387-63bf2b2671fc-certificates podName:df33e824-1fd7-481e-8387-63bf2b2671fc nodeName:}" failed. No retries permitted until 2026-07-07 16:51:20.709363485 +0000 UTC m=+290.140031489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/secret/df33e824-1fd7-481e-8387-63bf2b2671fc-certificates") pod "custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" (UID: "df33e824-1fd7-481e-8387-63bf2b2671fc") : failed to sync secret cache: timed out waiting for the condition Jul 07 16:51:20.515376 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:20.515288 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 07 16:51:20.719760 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:20.719709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df33e824-1fd7-481e-8387-63bf2b2671fc-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:20.722009 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:20.721970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/df33e824-1fd7-481e-8387-63bf2b2671fc-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd\" (UID: \"df33e824-1fd7-481e-8387-63bf2b2671fc\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:20.811434 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:20.811338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:20.974837 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:20.974806 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd"] Jul 07 16:51:20.980284 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:51:20.980256 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf33e824_1fd7_481e_8387_63bf2b2671fc.slice/crio-828f7021a5b42b79be7a214b2645716f2a1f66fb106a428ff39c602b72f14ee7 WatchSource:0}: Error finding container 828f7021a5b42b79be7a214b2645716f2a1f66fb106a428ff39c602b72f14ee7: Status 404 returned error can't find the container with id 828f7021a5b42b79be7a214b2645716f2a1f66fb106a428ff39c602b72f14ee7 Jul 07 16:51:21.316792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:21.316760 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" event={"ID":"df33e824-1fd7-481e-8387-63bf2b2671fc","Type":"ContainerStarted","Data":"828f7021a5b42b79be7a214b2645716f2a1f66fb106a428ff39c602b72f14ee7"} Jul 07 16:51:24.331182 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.331143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" event={"ID":"df33e824-1fd7-481e-8387-63bf2b2671fc","Type":"ContainerStarted","Data":"bc0cb60523e373d9e58b67bc2f49cea9f5c93effac5253f9b2849814fa0cbca9"} Jul 07 16:51:24.331568 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.331218 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:24.357716 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.357656 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" podStartSLOduration=3.699975919 podStartE2EDuration="6.357636379s" totalImagesPullingTime="2.65766046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:51:24.355782569 +0000 UTC m=+293.786450594" watchObservedRunningTime="2026-07-07 16:51:24.357636379 +0000 UTC m=+293.788304404" Jul 07 16:51:24.591272 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.591190 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-rvx2x"] Jul 07 16:51:24.593330 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.593312 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.595792 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.595762 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 07 16:51:24.595967 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.595951 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 07 16:51:24.596149 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.596015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8hwtw\"" Jul 07 16:51:24.611271 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.611234 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-rvx2x"] Jul 07 16:51:24.752945 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.752901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/fa46f332-9410-43f3-b5f2-7d0c9e593052-cabundle0\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.753158 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.753031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.753158 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.753100 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgn2\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-kube-api-access-zrgn2\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.853914 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.853801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.853914 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.853875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgn2\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-kube-api-access-zrgn2\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.853914 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.853904 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/fa46f332-9410-43f3-b5f2-7d0c9e593052-cabundle0\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.854166 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:24.853986 2567 secret.go:281] references non-existent secret key: ca.crt Jul 07 16:51:24.854166 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:24.854007 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 07 16:51:24.854166 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:24.854016 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-rvx2x: references non-existent secret key: ca.crt Jul 07 16:51:24.854166 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:24.854081 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates podName:fa46f332-9410-43f3-b5f2-7d0c9e593052 nodeName:}" failed. No retries permitted until 2026-07-07 16:51:25.354065687 +0000 UTC m=+294.784733691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates") pod "keda-operator-68bff59c-rvx2x" (UID: "fa46f332-9410-43f3-b5f2-7d0c9e593052") : references non-existent secret key: ca.crt Jul 07 16:51:24.854576 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.854558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/fa46f332-9410-43f3-b5f2-7d0c9e593052-cabundle0\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:24.874135 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:24.874098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgn2\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-kube-api-access-zrgn2\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:25.357639 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:25.357601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:25.358080 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:25.357756 2567 secret.go:281] references non-existent secret key: ca.crt Jul 07 16:51:25.358080 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:25.357776 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 07 16:51:25.358080 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:25.357785 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-rvx2x: references non-existent secret key: ca.crt Jul 07 16:51:25.358080 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:51:25.357843 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates podName:fa46f332-9410-43f3-b5f2-7d0c9e593052 nodeName:}" failed. No retries permitted until 2026-07-07 16:51:26.357826244 +0000 UTC m=+295.788494269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates") pod "keda-operator-68bff59c-rvx2x" (UID: "fa46f332-9410-43f3-b5f2-7d0c9e593052") : references non-existent secret key: ca.crt Jul 07 16:51:26.367190 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:26.367151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:26.369585 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:26.369555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fa46f332-9410-43f3-b5f2-7d0c9e593052-certificates\") pod \"keda-operator-68bff59c-rvx2x\" (UID: \"fa46f332-9410-43f3-b5f2-7d0c9e593052\") " pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:26.403325 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:26.403290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:26.552440 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:26.552403 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-rvx2x"] Jul 07 16:51:26.556336 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:51:26.556301 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa46f332_9410_43f3_b5f2_7d0c9e593052.slice/crio-50c3c8e3e5349f321536c4764334db1b7224231dbb31d273965eca55e7effae6 WatchSource:0}: Error finding container 50c3c8e3e5349f321536c4764334db1b7224231dbb31d273965eca55e7effae6: Status 404 returned error can't find the container with id 50c3c8e3e5349f321536c4764334db1b7224231dbb31d273965eca55e7effae6 Jul 07 16:51:27.346458 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:27.346415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-rvx2x" event={"ID":"fa46f332-9410-43f3-b5f2-7d0c9e593052","Type":"ContainerStarted","Data":"50c3c8e3e5349f321536c4764334db1b7224231dbb31d273965eca55e7effae6"} Jul 07 16:51:30.361215 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.361125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-rvx2x" event={"ID":"fa46f332-9410-43f3-b5f2-7d0c9e593052","Type":"ContainerStarted","Data":"2edbe1d4ac78c054c6dbebe24d749d0aaed1519de08a904a3284d919d59c7c21"} Jul 07 16:51:30.361215 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.361201 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:51:30.379681 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.379616 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-rvx2x" podStartSLOduration=2.833959658 podStartE2EDuration="6.379594401s" totalImagesPullingTime="3.545634743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:51:30.378893307 +0000 UTC m=+299.809561329" watchObservedRunningTime="2026-07-07 16:51:30.379594401 +0000 UTC m=+299.810262424" Jul 07 16:51:30.950616 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.950591 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:51:30.953706 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.953680 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:51:30.957701 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.957662 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:51:30.961160 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.961127 2567 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:51:30.961721 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:30.961706 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:51:45.338136 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:45.338100 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-cbfqd" Jul 07 16:51:51.367035 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:51:51.366996 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-rvx2x" Jul 07 16:52:36.496069 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.496029 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-85768989b-nv6jz"] Jul 07 16:52:36.498177 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.498158 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:36.500592 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.500565 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 07 16:52:36.500942 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.500924 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 16:52:36.501163 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.500948 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 16:52:36.501667 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.501645 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-zt6sb\"" Jul 07 16:52:36.515740 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.515698 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85768989b-nv6jz"] Jul 07 16:52:36.516848 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.516819 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-m5z6d"] Jul 07 16:52:36.519109 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.519092 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:36.523020 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.522995 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 07 16:52:36.523184 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.522997 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-9wpdx\"" Jul 07 16:52:36.542365 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.542336 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-m5z6d"] Jul 07 16:52:36.585161 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.585124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5b9h\" (UniqueName: \"kubernetes.io/projected/f8accb1a-8912-448f-b266-0b553a6e615d-kube-api-access-w5b9h\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:36.585161 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.585174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:36.585419 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.585231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n84dm\" (UniqueName: \"kubernetes.io/projected/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-kube-api-access-n84dm\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:36.585419 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.585321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8accb1a-8912-448f-b266-0b553a6e615d-cert\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:36.685930 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.685884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5b9h\" (UniqueName: \"kubernetes.io/projected/f8accb1a-8912-448f-b266-0b553a6e615d-kube-api-access-w5b9h\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:36.685930 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.685936 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:36.686211 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.686020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n84dm\" (UniqueName: \"kubernetes.io/projected/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-kube-api-access-n84dm\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:36.686211 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.686056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8accb1a-8912-448f-b266-0b553a6e615d-cert\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:36.686211 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:52:36.686086 2567 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 16:52:36.686211 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:52:36.686156 2567 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 16:52:36.686211 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:52:36.686166 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert podName:ff3ad797-15fe-47eb-9f0f-b670dccdfbaa nodeName:}" failed. No retries permitted until 2026-07-07 16:52:37.186143787 +0000 UTC m=+366.616811805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert") pod "kserve-controller-manager-85768989b-nv6jz" (UID: "ff3ad797-15fe-47eb-9f0f-b670dccdfbaa") : secret "kserve-webhook-server-cert" not found Jul 07 16:52:36.686211 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:52:36.686203 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8accb1a-8912-448f-b266-0b553a6e615d-cert podName:f8accb1a-8912-448f-b266-0b553a6e615d nodeName:}" failed. No retries permitted until 2026-07-07 16:52:37.186187835 +0000 UTC m=+366.616855855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8accb1a-8912-448f-b266-0b553a6e615d-cert") pod "llmisvc-controller-manager-67d95fdc48-m5z6d" (UID: "f8accb1a-8912-448f-b266-0b553a6e615d") : secret "llmisvc-webhook-server-cert" not found Jul 07 16:52:36.698267 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.698233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n84dm\" (UniqueName: \"kubernetes.io/projected/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-kube-api-access-n84dm\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:36.698439 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:36.698416 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5b9h\" (UniqueName: \"kubernetes.io/projected/f8accb1a-8912-448f-b266-0b553a6e615d-kube-api-access-w5b9h\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:37.191576 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.191540 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:37.191794 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.191592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8accb1a-8912-448f-b266-0b553a6e615d-cert\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:37.194119 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.194091 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8accb1a-8912-448f-b266-0b553a6e615d-cert\") pod \"llmisvc-controller-manager-67d95fdc48-m5z6d\" (UID: \"f8accb1a-8912-448f-b266-0b553a6e615d\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:37.194244 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.194141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert\") pod \"kserve-controller-manager-85768989b-nv6jz\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:37.408961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.408919 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:37.429908 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.429869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:37.558144 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.558099 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85768989b-nv6jz"] Jul 07 16:52:37.562396 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:52:37.562364 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3ad797_15fe_47eb_9f0f_b670dccdfbaa.slice/crio-e96109096be0fbf6b2ca03b38c76c5bd69e85f184b5e593ea09e480856027eca WatchSource:0}: Error finding container e96109096be0fbf6b2ca03b38c76c5bd69e85f184b5e593ea09e480856027eca: Status 404 returned error can't find the container with id e96109096be0fbf6b2ca03b38c76c5bd69e85f184b5e593ea09e480856027eca Jul 07 16:52:37.563609 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.563594 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:52:37.583994 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.582059 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-m5z6d"] Jul 07 16:52:37.584804 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:52:37.584775 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf8accb1a_8912_448f_b266_0b553a6e615d.slice/crio-275299f3c56c934898f7b36814a4ee874f4fbd0dc9e47a12ab1ddf1a53b6d46f WatchSource:0}: Error finding container 275299f3c56c934898f7b36814a4ee874f4fbd0dc9e47a12ab1ddf1a53b6d46f: Status 404 returned error can't find the container with id 275299f3c56c934898f7b36814a4ee874f4fbd0dc9e47a12ab1ddf1a53b6d46f Jul 07 16:52:37.606017 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.605985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" event={"ID":"f8accb1a-8912-448f-b266-0b553a6e615d","Type":"ContainerStarted","Data":"275299f3c56c934898f7b36814a4ee874f4fbd0dc9e47a12ab1ddf1a53b6d46f"} Jul 07 16:52:37.607047 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:37.607014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85768989b-nv6jz" event={"ID":"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa","Type":"ContainerStarted","Data":"e96109096be0fbf6b2ca03b38c76c5bd69e85f184b5e593ea09e480856027eca"} Jul 07 16:52:41.627618 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:41.627578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85768989b-nv6jz" event={"ID":"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa","Type":"ContainerStarted","Data":"c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c"} Jul 07 16:52:41.628063 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:41.627728 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:52:41.629101 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:41.629078 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" event={"ID":"f8accb1a-8912-448f-b266-0b553a6e615d","Type":"ContainerStarted","Data":"c2cac1a702c8ab50f575e39af11b2b47360775013edb8fa2c6cd2c48d6e8762d"} Jul 07 16:52:41.629219 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:41.629208 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:52:41.649984 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:41.649919 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-85768989b-nv6jz" podStartSLOduration=2.245296938 podStartE2EDuration="5.649902391s" totalImagesPullingTime="3.404605453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:41.647596749 +0000 UTC m=+371.078264775" watchObservedRunningTime="2026-07-07 16:52:41.649902391 +0000 UTC m=+371.080570416" Jul 07 16:52:41.683164 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:52:41.683109 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" podStartSLOduration=2.346015884 podStartE2EDuration="5.68309061s" totalImagesPullingTime="3.337074726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:41.682384913 +0000 UTC m=+371.113052939" watchObservedRunningTime="2026-07-07 16:52:41.68309061 +0000 UTC m=+371.113758636" Jul 07 16:53:12.635256 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:12.635225 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-m5z6d" Jul 07 16:53:12.638464 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:12.638434 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:53:14.314389 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.314354 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-85768989b-nv6jz"] Jul 07 16:53:14.314818 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.314536 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-85768989b-nv6jz" podUID="ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" containerName="manager" containerID="cri-o://c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c" gracePeriod=10 Jul 07 16:53:14.351316 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.351285 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-85768989b-msl7f"] Jul 07 16:53:14.376747 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.376701 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85768989b-msl7f"] Jul 07 16:53:14.376894 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.376822 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.386761 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.386722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9cee787-1278-4564-b6b9-2a5c6e4b6392-cert\") pod \"kserve-controller-manager-85768989b-msl7f\" (UID: \"e9cee787-1278-4564-b6b9-2a5c6e4b6392\") " pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.386930 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.386775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd2mt\" (UniqueName: \"kubernetes.io/projected/e9cee787-1278-4564-b6b9-2a5c6e4b6392-kube-api-access-dd2mt\") pod \"kserve-controller-manager-85768989b-msl7f\" (UID: \"e9cee787-1278-4564-b6b9-2a5c6e4b6392\") " pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.488097 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.488059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9cee787-1278-4564-b6b9-2a5c6e4b6392-cert\") pod \"kserve-controller-manager-85768989b-msl7f\" (UID: \"e9cee787-1278-4564-b6b9-2a5c6e4b6392\") " pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.488298 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.488117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd2mt\" (UniqueName: \"kubernetes.io/projected/e9cee787-1278-4564-b6b9-2a5c6e4b6392-kube-api-access-dd2mt\") pod \"kserve-controller-manager-85768989b-msl7f\" (UID: \"e9cee787-1278-4564-b6b9-2a5c6e4b6392\") " pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.490559 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.490531 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9cee787-1278-4564-b6b9-2a5c6e4b6392-cert\") pod \"kserve-controller-manager-85768989b-msl7f\" (UID: \"e9cee787-1278-4564-b6b9-2a5c6e4b6392\") " pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.500408 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.499917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd2mt\" (UniqueName: \"kubernetes.io/projected/e9cee787-1278-4564-b6b9-2a5c6e4b6392-kube-api-access-dd2mt\") pod \"kserve-controller-manager-85768989b-msl7f\" (UID: \"e9cee787-1278-4564-b6b9-2a5c6e4b6392\") " pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.583180 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.583089 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:53:14.588954 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.588930 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n84dm\" (UniqueName: \"kubernetes.io/projected/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-kube-api-access-n84dm\") pod \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " Jul 07 16:53:14.589107 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.588999 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert\") pod \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\" (UID: \"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa\") " Jul 07 16:53:14.591186 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.591158 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert" (OuterVolumeSpecName: "cert") pod "ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" (UID: "ff3ad797-15fe-47eb-9f0f-b670dccdfbaa"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:53:14.591300 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.591205 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-kube-api-access-n84dm" (OuterVolumeSpecName: "kube-api-access-n84dm") pod "ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" (UID: "ff3ad797-15fe-47eb-9f0f-b670dccdfbaa"). InnerVolumeSpecName "kube-api-access-n84dm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:53:14.689923 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.689887 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n84dm\" (UniqueName: \"kubernetes.io/projected/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-kube-api-access-n84dm\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:53:14.689923 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.689919 2567 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:53:14.745458 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.745419 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:14.754139 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.754105 2567 generic.go:356] "Generic (PLEG): container finished" podID="ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" containerID="c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c" exitCode=0 Jul 07 16:53:14.754316 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.754158 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-85768989b-nv6jz" Jul 07 16:53:14.754316 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.754187 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85768989b-nv6jz" event={"ID":"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa","Type":"ContainerDied","Data":"c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c"} Jul 07 16:53:14.754316 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.754237 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85768989b-nv6jz" event={"ID":"ff3ad797-15fe-47eb-9f0f-b670dccdfbaa","Type":"ContainerDied","Data":"e96109096be0fbf6b2ca03b38c76c5bd69e85f184b5e593ea09e480856027eca"} Jul 07 16:53:14.754316 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.754259 2567 scope.go:117] "RemoveContainer" containerID="c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c" Jul 07 16:53:14.762963 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.762945 2567 scope.go:117] "RemoveContainer" containerID="c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c" Jul 07 16:53:14.763311 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:53:14.763291 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c\": container with ID starting with c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c not found: ID does not exist" containerID="c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c" Jul 07 16:53:14.763393 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.763315 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c"} err="failed to get container status \"c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c\": rpc error: code = NotFound desc = could not find container \"c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c\": container with ID starting with c6879806f41e5ba2ad371966a56721892bd79d52f93c9360a426da02134e9d3c not found: ID does not exist" Jul 07 16:53:14.788900 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.788865 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-85768989b-nv6jz"] Jul 07 16:53:14.791914 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.791881 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-85768989b-nv6jz"] Jul 07 16:53:14.909518 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:14.909480 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-85768989b-msl7f"] Jul 07 16:53:14.912651 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:53:14.912621 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cee787_1278_4564_b6b9_2a5c6e4b6392.slice/crio-69947fdb7bdb08199b0933f3fe2666538678ab28fde5f256e451f1682f2be46a WatchSource:0}: Error finding container 69947fdb7bdb08199b0933f3fe2666538678ab28fde5f256e451f1682f2be46a: Status 404 returned error can't find the container with id 69947fdb7bdb08199b0933f3fe2666538678ab28fde5f256e451f1682f2be46a Jul 07 16:53:15.139510 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:15.139430 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" path="/var/lib/kubelet/pods/ff3ad797-15fe-47eb-9f0f-b670dccdfbaa/volumes" Jul 07 16:53:15.760379 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:15.760345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85768989b-msl7f" event={"ID":"e9cee787-1278-4564-b6b9-2a5c6e4b6392","Type":"ContainerStarted","Data":"f97f5a6d22c580b677a4a02173d5c31573a6b031f0372fb83a7f23f34b2d6bf7"} Jul 07 16:53:15.760802 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:15.760394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-85768989b-msl7f" event={"ID":"e9cee787-1278-4564-b6b9-2a5c6e4b6392","Type":"ContainerStarted","Data":"69947fdb7bdb08199b0933f3fe2666538678ab28fde5f256e451f1682f2be46a"} Jul 07 16:53:15.760802 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:15.760446 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:15.796019 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:15.795949 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-85768989b-msl7f" podStartSLOduration=1.344335331 podStartE2EDuration="1.795929933s" totalImagesPullingTime="451.594602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:15.791385865 +0000 UTC m=+405.222053892" watchObservedRunningTime="2026-07-07 16:53:15.795929933 +0000 UTC m=+405.226597975" Jul 07 16:53:46.772203 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:46.772171 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-85768989b-msl7f" Jul 07 16:53:47.819922 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:53:47.819877 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666bc7b95-nsxq7"] Jul 07 16:54:12.840556 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:12.840507 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8666bc7b95-nsxq7" podUID="592d7dcd-fa03-499d-b388-8eb54e4afa85" containerName="console" containerID="cri-o://5c73e3221f8286bf527330dfeaba5bb98478791cd554c6bdc4be2c8ebd07a410" gracePeriod=15 Jul 07 16:54:12.985270 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:12.985231 2567 generic.go:356] "Generic (PLEG): container finished" podID="592d7dcd-fa03-499d-b388-8eb54e4afa85" containerID="5c73e3221f8286bf527330dfeaba5bb98478791cd554c6bdc4be2c8ebd07a410" exitCode=0 Jul 07 16:54:12.985434 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:12.985287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666bc7b95-nsxq7" event={"ID":"592d7dcd-fa03-499d-b388-8eb54e4afa85","Type":"ContainerDied","Data":"5c73e3221f8286bf527330dfeaba5bb98478791cd554c6bdc4be2c8ebd07a410"} Jul 07 16:54:13.098807 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.098738 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:54:13.228423 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228379 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcz8h\" (UniqueName: \"kubernetes.io/projected/592d7dcd-fa03-499d-b388-8eb54e4afa85-kube-api-access-hcz8h\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.228423 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228421 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-serving-cert\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.228641 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228445 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-service-ca\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.228641 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228488 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-config\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.228641 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228513 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-oauth-serving-cert\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.228641 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228550 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-oauth-config\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.228641 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.228594 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-trusted-ca-bundle\") pod \"592d7dcd-fa03-499d-b388-8eb54e4afa85\" (UID: \"592d7dcd-fa03-499d-b388-8eb54e4afa85\") " Jul 07 16:54:13.229049 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.229006 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-service-ca" (OuterVolumeSpecName: "service-ca") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:54:13.229049 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.229017 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-config" (OuterVolumeSpecName: "console-config") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:54:13.229442 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.229381 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:54:13.229563 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.229519 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:54:13.230910 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.230891 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:54:13.231097 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.231078 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:54:13.231245 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.231225 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592d7dcd-fa03-499d-b388-8eb54e4afa85-kube-api-access-hcz8h" (OuterVolumeSpecName: "kube-api-access-hcz8h") pod "592d7dcd-fa03-499d-b388-8eb54e4afa85" (UID: "592d7dcd-fa03-499d-b388-8eb54e4afa85"). InnerVolumeSpecName "kube-api-access-hcz8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:54:13.330100 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330059 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-oauth-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.330100 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330091 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-oauth-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.330100 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330100 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-trusted-ca-bundle\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.330100 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330109 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcz8h\" (UniqueName: \"kubernetes.io/projected/592d7dcd-fa03-499d-b388-8eb54e4afa85-kube-api-access-hcz8h\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.330358 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330118 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-serving-cert\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.330358 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330128 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-service-ca\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.330358 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.330137 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/592d7dcd-fa03-499d-b388-8eb54e4afa85-console-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 16:54:13.994699 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.994658 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666bc7b95-nsxq7" event={"ID":"592d7dcd-fa03-499d-b388-8eb54e4afa85","Type":"ContainerDied","Data":"91eceb5a2abbe01ea32fe1ee263396a554ab9a0d80e223583a0abc9a17824086"} Jul 07 16:54:13.995152 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.994748 2567 scope.go:117] "RemoveContainer" containerID="5c73e3221f8286bf527330dfeaba5bb98478791cd554c6bdc4be2c8ebd07a410" Jul 07 16:54:13.995152 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:13.994672 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666bc7b95-nsxq7" Jul 07 16:54:14.021945 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:14.021913 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666bc7b95-nsxq7"] Jul 07 16:54:14.024140 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:14.024116 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8666bc7b95-nsxq7"] Jul 07 16:54:15.136627 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:54:15.136592 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592d7dcd-fa03-499d-b388-8eb54e4afa85" path="/var/lib/kubelet/pods/592d7dcd-fa03-499d-b388-8eb54e4afa85/volumes" Jul 07 16:56:30.975138 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:56:30.975108 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:56:30.977213 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:56:30.977187 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 16:56:30.981454 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:56:30.981432 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:56:30.983694 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:56:30.983674 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 16:59:34.636526 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636491 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5"] Jul 07 16:59:34.636961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636749 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592d7dcd-fa03-499d-b388-8eb54e4afa85" containerName="console" Jul 07 16:59:34.636961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636759 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="592d7dcd-fa03-499d-b388-8eb54e4afa85" containerName="console" Jul 07 16:59:34.636961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636768 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" containerName="manager" Jul 07 16:59:34.636961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636774 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" containerName="manager" Jul 07 16:59:34.636961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636829 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="592d7dcd-fa03-499d-b388-8eb54e4afa85" containerName="console" Jul 07 16:59:34.636961 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.636838 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3ad797-15fe-47eb-9f0f-b670dccdfbaa" containerName="manager" Jul 07 16:59:34.638706 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.638685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.670442 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:34.670404 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"message-dumper-predictor-serving-cert\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\"" type="*v1.Secret" Jul 07 16:59:34.670647 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:34.670601 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 07 16:59:34.670647 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:34.670601 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-7526s\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7526s\"" type="*v1.Secret" Jul 07 16:59:34.670747 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:34.670638 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 07 16:59:34.670747 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:34.670637 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"message-dumper-predictor-6575bcfdfd-lg8m5\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.670747 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:34.670640 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"message-dumper-kube-rbac-proxy-sar-config\" is forbidden: User \"system:node:ip-10-0-128-144.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-128-144.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\"" type="*v1.ConfigMap" Jul 07 16:59:34.738225 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.738177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.738225 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.738228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkh7l\" (UniqueName: \"kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.738447 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.738322 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09908eee-2e9f-4131-94de-ad420dc7723b-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.750227 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.750193 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5"] Jul 07 16:59:34.839646 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.839605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09908eee-2e9f-4131-94de-ad420dc7723b-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.839855 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.839672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:34.839855 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:34.839699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkh7l\" (UniqueName: \"kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:35.494691 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:35.494656 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\"" Jul 07 16:59:35.500384 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:35.500354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09908eee-2e9f-4131-94de-ad420dc7723b-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:35.613080 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:35.613049 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7526s\"" Jul 07 16:59:35.840837 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:35.840721 2567 secret.go:189] Couldn't get secret kserve-ci-e2e-test/message-dumper-predictor-serving-cert: failed to sync secret cache: timed out waiting for the condition Jul 07 16:59:35.841330 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:35.840867 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls podName:09908eee-2e9f-4131-94de-ad420dc7723b nodeName:}" failed. No retries permitted until 2026-07-07 16:59:36.340844604 +0000 UTC m=+785.771512617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls") pod "message-dumper-predictor-6575bcfdfd-lg8m5" (UID: "09908eee-2e9f-4131-94de-ad420dc7723b") : failed to sync secret cache: timed out waiting for the condition Jul 07 16:59:35.889488 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:35.889449 2567 projected.go:291] Couldn't get configMap kserve-ci-e2e-test/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 07 16:59:35.964893 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:35.964861 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 07 16:59:35.969929 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:35.969905 2567 projected.go:196] Error preparing data for projected volume kube-api-access-dkh7l for pod kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5: failed to sync configmap cache: timed out waiting for the condition Jul 07 16:59:35.970075 ip-10-0-128-144 kubenswrapper[2567]: E0707 16:59:35.970024 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l podName:09908eee-2e9f-4131-94de-ad420dc7723b nodeName:}" failed. No retries permitted until 2026-07-07 16:59:36.470000156 +0000 UTC m=+785.900668160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dkh7l" (UniqueName: "kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l") pod "message-dumper-predictor-6575bcfdfd-lg8m5" (UID: "09908eee-2e9f-4131-94de-ad420dc7723b") : failed to sync configmap cache: timed out waiting for the condition Jul 07 16:59:36.106742 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.106650 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 07 16:59:36.260274 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.260245 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\"" Jul 07 16:59:36.351062 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.351022 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:36.353482 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.353453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:36.552322 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.552285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkh7l\" (UniqueName: \"kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:36.554984 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.554947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkh7l\" (UniqueName: \"kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l\") pod \"message-dumper-predictor-6575bcfdfd-lg8m5\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:36.748765 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.748728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:36.909036 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.908996 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5"] Jul 07 16:59:36.912940 ip-10-0-128-144 kubenswrapper[2567]: W0707 16:59:36.912911 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09908eee_2e9f_4131_94de_ad420dc7723b.slice/crio-4c7959cd5097b9f46d25b046b14a62f06f1aa32566db940ffb00d7b61beac56f WatchSource:0}: Error finding container 4c7959cd5097b9f46d25b046b14a62f06f1aa32566db940ffb00d7b61beac56f: Status 404 returned error can't find the container with id 4c7959cd5097b9f46d25b046b14a62f06f1aa32566db940ffb00d7b61beac56f Jul 07 16:59:36.914900 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:36.914884 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:59:37.192666 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:37.192572 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" event={"ID":"09908eee-2e9f-4131-94de-ad420dc7723b","Type":"ContainerStarted","Data":"4c7959cd5097b9f46d25b046b14a62f06f1aa32566db940ffb00d7b61beac56f"} Jul 07 16:59:39.204188 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:39.204141 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" event={"ID":"09908eee-2e9f-4131-94de-ad420dc7723b","Type":"ContainerStarted","Data":"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc"} Jul 07 16:59:41.214257 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:41.214223 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" event={"ID":"09908eee-2e9f-4131-94de-ad420dc7723b","Type":"ContainerStarted","Data":"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27"} Jul 07 16:59:41.214650 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:41.214380 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:41.238179 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:41.238124 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" podStartSLOduration=3.414157743 podStartE2EDuration="7.238105736s" totalImagesPullingTime="3.823947993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:59:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:59:41.235954774 +0000 UTC m=+790.666622810" watchObservedRunningTime="2026-07-07 16:59:41.238105736 +0000 UTC m=+790.668773761" Jul 07 16:59:42.218474 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:42.218439 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:42.220571 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:42.220550 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 16:59:49.230501 ip-10-0-128-144 kubenswrapper[2567]: I0707 16:59:49.230465 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 17:01:29.512699 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:29.512614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-lg8m5_09908eee-2e9f-4131-94de-ad420dc7723b/kserve-container/0.log" Jul 07 17:01:29.946481 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:29.946392 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5"] Jul 07 17:01:29.946675 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:29.946650 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kserve-container" containerID="cri-o://1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc" gracePeriod=30 Jul 07 17:01:29.946755 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:29.946702 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kube-rbac-proxy" containerID="cri-o://b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27" gracePeriod=30 Jul 07 17:01:30.191621 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.191591 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 17:01:30.212624 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.212592 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09908eee-2e9f-4131-94de-ad420dc7723b-kube-rbac-proxy-sar-config\") pod \"09908eee-2e9f-4131-94de-ad420dc7723b\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " Jul 07 17:01:30.212779 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.212638 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls\") pod \"09908eee-2e9f-4131-94de-ad420dc7723b\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " Jul 07 17:01:30.212779 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.212667 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkh7l\" (UniqueName: \"kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l\") pod \"09908eee-2e9f-4131-94de-ad420dc7723b\" (UID: \"09908eee-2e9f-4131-94de-ad420dc7723b\") " Jul 07 17:01:30.213077 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.213047 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09908eee-2e9f-4131-94de-ad420dc7723b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "09908eee-2e9f-4131-94de-ad420dc7723b" (UID: "09908eee-2e9f-4131-94de-ad420dc7723b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:01:30.215018 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.214961 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "09908eee-2e9f-4131-94de-ad420dc7723b" (UID: "09908eee-2e9f-4131-94de-ad420dc7723b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:01:30.215018 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.214967 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l" (OuterVolumeSpecName: "kube-api-access-dkh7l") pod "09908eee-2e9f-4131-94de-ad420dc7723b" (UID: "09908eee-2e9f-4131-94de-ad420dc7723b"). InnerVolumeSpecName "kube-api-access-dkh7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:01:30.313172 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.313130 2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/09908eee-2e9f-4131-94de-ad420dc7723b-proxy-tls\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 17:01:30.313172 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.313162 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkh7l\" (UniqueName: \"kubernetes.io/projected/09908eee-2e9f-4131-94de-ad420dc7723b-kube-api-access-dkh7l\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 17:01:30.313172 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.313173 2567 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/09908eee-2e9f-4131-94de-ad420dc7723b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-144.ec2.internal\" DevicePath \"\"" Jul 07 17:01:30.638020 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.637987 2567 generic.go:356] "Generic (PLEG): container finished" podID="09908eee-2e9f-4131-94de-ad420dc7723b" containerID="b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27" exitCode=2 Jul 07 17:01:30.638020 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.638013 2567 generic.go:356] "Generic (PLEG): container finished" podID="09908eee-2e9f-4131-94de-ad420dc7723b" containerID="1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc" exitCode=2 Jul 07 17:01:30.638524 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.638045 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" Jul 07 17:01:30.638524 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.638066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" event={"ID":"09908eee-2e9f-4131-94de-ad420dc7723b","Type":"ContainerDied","Data":"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27"} Jul 07 17:01:30.638524 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.638128 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" event={"ID":"09908eee-2e9f-4131-94de-ad420dc7723b","Type":"ContainerDied","Data":"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc"} Jul 07 17:01:30.638524 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.638149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5" event={"ID":"09908eee-2e9f-4131-94de-ad420dc7723b","Type":"ContainerDied","Data":"4c7959cd5097b9f46d25b046b14a62f06f1aa32566db940ffb00d7b61beac56f"} Jul 07 17:01:30.638524 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.638176 2567 scope.go:117] "RemoveContainer" containerID="b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27" Jul 07 17:01:30.646406 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.646384 2567 scope.go:117] "RemoveContainer" containerID="1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc" Jul 07 17:01:30.654406 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.654386 2567 scope.go:117] "RemoveContainer" containerID="b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27" Jul 07 17:01:30.654685 ip-10-0-128-144 kubenswrapper[2567]: E0707 17:01:30.654652 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27\": container with ID starting with b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27 not found: ID does not exist" containerID="b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27" Jul 07 17:01:30.654734 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.654684 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27"} err="failed to get container status \"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27\": rpc error: code = NotFound desc = could not find container \"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27\": container with ID starting with b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27 not found: ID does not exist" Jul 07 17:01:30.654734 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.654709 2567 scope.go:117] "RemoveContainer" containerID="1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc" Jul 07 17:01:30.654942 ip-10-0-128-144 kubenswrapper[2567]: E0707 17:01:30.654926 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc\": container with ID starting with 1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc not found: ID does not exist" containerID="1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc" Jul 07 17:01:30.654997 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.654946 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc"} err="failed to get container status \"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc\": rpc error: code = NotFound desc = could not find container \"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc\": container with ID starting with 1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc not found: ID does not exist" Jul 07 17:01:30.654997 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.654963 2567 scope.go:117] "RemoveContainer" containerID="b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27" Jul 07 17:01:30.655184 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.655168 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27"} err="failed to get container status \"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27\": rpc error: code = NotFound desc = could not find container \"b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27\": container with ID starting with b3cad8bb308d5f2bfa791b270feba0243d8e03a1adf51a0ec4169bfba3408d27 not found: ID does not exist" Jul 07 17:01:30.655226 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.655186 2567 scope.go:117] "RemoveContainer" containerID="1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc" Jul 07 17:01:30.655437 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.655410 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc"} err="failed to get container status \"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc\": rpc error: code = NotFound desc = could not find container \"1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc\": container with ID starting with 1ea65ce73f4afbd77d77e33b20470e14540b34bd7502325dac7bfb04dc2b1afc not found: ID does not exist" Jul 07 17:01:30.670020 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.669988 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5"] Jul 07 17:01:30.672597 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.672570 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-lg8m5"] Jul 07 17:01:30.998544 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.998514 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:01:30.998768 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:30.998753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:01:31.006603 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:31.006577 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 17:01:31.006879 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:31.006716 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 17:01:31.137375 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:01:31.137343 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" path="/var/lib/kubelet/pods/09908eee-2e9f-4131-94de-ad420dc7723b/volumes" Jul 07 17:06:31.032258 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:06:31.032169 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:06:31.033259 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:06:31.033236 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:06:31.038781 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:06:31.038745 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 17:06:31.039947 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:06:31.039930 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 17:11:31.053352 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:11:31.053319 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:11:31.055881 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:11:31.055856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:11:31.060036 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:11:31.060010 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 17:11:31.062420 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:11:31.062394 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rq27k_07c75f7c-b80f-4180-9712-9173ea97f61d/ovn-acl-logging/0.log" Jul 07 17:12:36.239558 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:36.239525 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rjn6b_289dcbab-3775-4b26-a054-eb399c271217/global-pull-secret-syncer/0.log" Jul 07 17:12:36.341175 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:36.341133 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m2msn_bdc99f35-3687-4595-a2ba-a99ea56d6639/konnectivity-agent/0.log" Jul 07 17:12:36.415771 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:36.415731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-144.ec2.internal_6cfbdbc2e1882e9bdf10f2ad6c36020f/haproxy/0.log" Jul 07 17:12:40.666914 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:40.666881 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59dc794ccb-wlbkp_435e5879-f8e3-4701-a453-a3d1a8de6904/metrics-server/0.log" Jul 07 17:12:40.903466 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:40.903436 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8gvd_ffcef63e-6f49-4221-a9e9-123989c807f1/node-exporter/0.log" Jul 07 17:12:40.926948 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:40.926882 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8gvd_ffcef63e-6f49-4221-a9e9-123989c807f1/kube-rbac-proxy/0.log" Jul 07 17:12:40.952358 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:40.952333 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v8gvd_ffcef63e-6f49-4221-a9e9-123989c807f1/init-textfile/0.log" Jul 07 17:12:43.152616 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.152588 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-mm6dw_698f9253-f776-4090-8dc4-94b1f2302391/networking-console-plugin/0.log" Jul 07 17:12:43.729919 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.729892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/1.log" Jul 07 17:12:43.734475 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.734458 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wkv4n_63df9e3d-31a3-44dc-927e-b3b3ef407c7a/console-operator/2.log" Jul 07 17:12:43.980577 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980489 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9"] Jul 07 17:12:43.980777 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980764 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kserve-container" Jul 07 17:12:43.980818 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980780 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kserve-container" Jul 07 17:12:43.980818 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980797 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kube-rbac-proxy" Jul 07 17:12:43.980818 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980803 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kube-rbac-proxy" Jul 07 17:12:43.980910 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980848 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kube-rbac-proxy" Jul 07 17:12:43.980910 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.980857 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09908eee-2e9f-4131-94de-ad420dc7723b" containerName="kserve-container" Jul 07 17:12:43.982955 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.982939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:43.993630 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.993606 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s9nz9\"/\"kube-root-ca.crt\"" Jul 07 17:12:43.994405 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.994389 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s9nz9\"/\"default-dockercfg-thlq4\"" Jul 07 17:12:43.994454 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:43.994391 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s9nz9\"/\"openshift-service-ca.crt\"" Jul 07 17:12:44.008038 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.008005 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9"] Jul 07 17:12:44.087740 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.087705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p44zx\" (UniqueName: \"kubernetes.io/projected/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-kube-api-access-p44zx\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.087740 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.087746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-sys\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.087955 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.087775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-podres\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.087955 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.087832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-lib-modules\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.087955 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.087859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-proc\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189309 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-lib-modules\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-proc\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189356 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p44zx\" (UniqueName: \"kubernetes.io/projected/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-kube-api-access-p44zx\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-sys\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-podres\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-proc\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-lib-modules\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-sys\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.189712 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.189553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-podres\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.203922 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.203894 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p44zx\" (UniqueName: \"kubernetes.io/projected/f42f4273-e94b-47b8-b7de-ae4fa17e76eb-kube-api-access-p44zx\") pod \"perf-node-gather-daemonset-kl4t9\" (UID: \"f42f4273-e94b-47b8-b7de-ae4fa17e76eb\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.292870 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.292778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:44.434954 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:44.434912 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9"] Jul 07 17:12:44.438675 ip-10-0-128-144 kubenswrapper[2567]: W0707 17:12:44.438638 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf42f4273_e94b_47b8_b7de_ae4fa17e76eb.slice/crio-2f9d945786f860bb685fd7028912db3b13d4adaa7f2d51f5cf7cc806b0731048 WatchSource:0}: Error finding container 2f9d945786f860bb685fd7028912db3b13d4adaa7f2d51f5cf7cc806b0731048: Status 404 returned error can't find the container with id 2f9d945786f860bb685fd7028912db3b13d4adaa7f2d51f5cf7cc806b0731048 Jul 07 17:12:45.171150 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:45.171116 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" event={"ID":"f42f4273-e94b-47b8-b7de-ae4fa17e76eb","Type":"ContainerStarted","Data":"82ce5719ad177fc561250867f994fde687bd1d4a203bbf2427c7c96cb77d9b2a"} Jul 07 17:12:45.171330 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:45.171169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" event={"ID":"f42f4273-e94b-47b8-b7de-ae4fa17e76eb","Type":"ContainerStarted","Data":"2f9d945786f860bb685fd7028912db3b13d4adaa7f2d51f5cf7cc806b0731048"} Jul 07 17:12:45.171330 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:45.171235 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:45.192788 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:45.192728 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" podStartSLOduration=2.192707293 podStartE2EDuration="2.192707293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:12:45.191627776 +0000 UTC m=+1574.622295803" watchObservedRunningTime="2026-07-07 17:12:45.192707293 +0000 UTC m=+1574.623375317" Jul 07 17:12:45.878823 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:45.878796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5dcw_9ac1787c-f332-4049-92b2-1b2f070f998e/dns/0.log" Jul 07 17:12:45.903835 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:45.903810 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b5dcw_9ac1787c-f332-4049-92b2-1b2f070f998e/kube-rbac-proxy/0.log" Jul 07 17:12:46.053351 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:46.053323 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b5rp4_d388f2ee-dab7-44c1-b872-4fe5165525bf/dns-node-resolver/0.log" Jul 07 17:12:46.792871 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:46.792839 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nlkjn_e06176c0-657d-4f54-842b-1d72eb4b0ed5/node-ca/0.log" Jul 07 17:12:48.263378 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:48.263350 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s6ggr_9c163177-0dd5-45bd-a1f9-f17f5eabc630/serve-healthcheck-canary/0.log" Jul 07 17:12:48.904020 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:48.903967 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pm2tz_d4c580be-0d3a-4f30-acec-c6525da8d503/kube-rbac-proxy/0.log" Jul 07 17:12:48.939086 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:48.939054 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pm2tz_d4c580be-0d3a-4f30-acec-c6525da8d503/exporter/0.log" Jul 07 17:12:48.965840 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:48.965815 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pm2tz_d4c580be-0d3a-4f30-acec-c6525da8d503/extractor/0.log" Jul 07 17:12:51.184928 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:51.184897 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-kl4t9" Jul 07 17:12:51.409189 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:51.409159 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-85768989b-msl7f_e9cee787-1278-4564-b6b9-2a5c6e4b6392/manager/0.log" Jul 07 17:12:51.460177 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:51.460149 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-m5z6d_f8accb1a-8912-448f-b266-0b553a6e615d/manager/0.log" Jul 07 17:12:58.900574 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:58.900546 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/kube-multus-additional-cni-plugins/0.log" Jul 07 17:12:58.936740 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:58.936710 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/egress-router-binary-copy/0.log" Jul 07 17:12:58.970625 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:58.970599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/cni-plugins/0.log" Jul 07 17:12:58.998803 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:58.998778 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/bond-cni-plugin/0.log" Jul 07 17:12:59.029051 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:59.029025 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/routeoverride-cni/0.log" Jul 07 17:12:59.072171 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:59.072141 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/whereabouts-cni-bincopy/0.log" Jul 07 17:12:59.121250 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:59.121211 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mp6dk_d5f7c46e-368e-4188-a0d0-398adabefb22/whereabouts-cni/0.log" Jul 07 17:12:59.753037 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:12:59.752999 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jktxz_af920d97-b5a9-433e-a727-3f7d59b78d8c/kube-multus/0.log" Jul 07 17:13:00.003386 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:13:00.003299 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d4v72_85752b58-34a0-4ef1-b051-3f9281c39bd9/network-metrics-daemon/0.log" Jul 07 17:13:00.053638 ip-10-0-128-144 kubenswrapper[2567]: I0707 17:13:00.053597 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d4v72_85752b58-34a0-4ef1-b051-3f9281c39bd9/kube-rbac-proxy/0.log"