Jul 05 14:54:49.143710 ip-10-0-128-154 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 05 14:54:49.143722 ip-10-0-128-154 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 05 14:54:49.143731 ip-10-0-128-154 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 05 14:54:49.144044 ip-10-0-128-154 systemd[1]: Failed to start Kubernetes Kubelet. Jul 05 14:54:59.325092 ip-10-0-128-154 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 05 14:54:59.325113 ip-10-0-128-154 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot bc5ef2c49a3f4910b38ab2b5565cec47 -- Jul 05 14:56:45.376940 ip-10-0-128-154 systemd[1]: Starting Kubernetes Kubelet... Jul 05 14:56:45.724714 ip-10-0-128-154 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 14:56:45.724714 ip-10-0-128-154 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 14:56:45.724714 ip-10-0-128-154 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 14:56:45.724714 ip-10-0-128-154 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 14:56:45.724714 ip-10-0-128-154 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 14:56:45.725579 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.725504 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 14:56:45.732335 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732315 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 14:56:45.732335 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732332 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 14:56:45.732335 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732336 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 14:56:45.732335 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732340 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 14:56:45.732335 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732343 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732346 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732349 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732352 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732355 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732357 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732360 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732362 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732365 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732367 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732370 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732372 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732375 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732377 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732380 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732382 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732385 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732387 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732389 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732392 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 14:56:45.732516 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732394 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732397 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732399 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732401 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732409 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732412 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732414 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732417 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732419 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732421 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732424 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732426 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732429 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732432 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732436 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732439 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732442 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732444 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732447 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732449 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 14:56:45.733006 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732452 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732454 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732457 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732459 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732462 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732464 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732467 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732469 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732472 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732474 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732477 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732479 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732481 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732484 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732486 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732489 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732491 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732494 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732496 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732499 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 14:56:45.733485 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732501 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732504 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732506 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732509 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732511 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732513 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732517 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732520 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732523 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732526 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732528 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732531 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732534 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732537 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732539 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732541 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732544 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732548 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732552 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 14:56:45.733981 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732557 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732561 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732564 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732567 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732569 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732572 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732574 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732577 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732579 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732581 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732585 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732588 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732591 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732594 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732611 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.732614 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733325 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733332 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733336 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 14:56:45.734432 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733340 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733344 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733347 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733350 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733353 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733356 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733359 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733362 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733365 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733367 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733370 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733372 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733375 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733377 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733380 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733383 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733385 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733388 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733390 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733393 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 14:56:45.734944 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733395 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733397 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733400 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733402 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733404 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733407 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733410 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733412 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733414 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733417 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733419 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733422 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733426 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733428 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733431 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733434 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733438 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733441 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733444 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 14:56:45.735428 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733447 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733449 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733452 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733454 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733457 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733459 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733461 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733464 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733466 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733470 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733473 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733475 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733478 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733480 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733482 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733485 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733488 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733490 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733496 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 14:56:45.735924 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733498 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733501 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733503 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733506 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733508 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733511 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733514 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733516 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733519 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733521 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733524 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733527 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733530 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733533 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733535 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733538 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733540 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733542 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733545 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733547 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 14:56:45.736409 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733549 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733552 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733555 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733557 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733560 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733562 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733564 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733567 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733570 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733572 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733574 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733577 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733581 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733585 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733589 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733591 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733618 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733973 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733978 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 14:56:45.736914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733981 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733986 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733990 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733993 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733995 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.733998 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734001 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734004 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734006 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734009 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734011 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734014 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734016 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734019 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734022 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734025 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734028 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734031 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734033 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 14:56:45.737372 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734036 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734038 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734041 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734043 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734046 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734048 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734051 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734053 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734056 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734058 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734065 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734069 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734072 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734074 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734077 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734079 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734082 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734084 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734087 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734089 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 14:56:45.737838 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734092 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734094 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734096 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734099 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734101 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734103 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734106 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734108 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734111 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734114 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734116 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734119 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734121 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734124 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734126 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734128 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734131 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734133 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734136 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 14:56:45.738311 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734138 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734140 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734143 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734147 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734150 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734153 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734155 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734158 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734160 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734163 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734166 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734168 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734170 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734173 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734175 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734178 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734181 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734185 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734188 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 14:56:45.738883 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734191 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734194 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734196 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734200 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734202 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734205 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734208 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734210 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734213 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734215 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734218 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734221 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734223 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734225 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734228 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734230 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734234 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734237 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734240 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734242 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 14:56:45.739336 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734310 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734317 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734323 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734327 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734331 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734334 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734338 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734342 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734345 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734348 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734351 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734354 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734357 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734360 2578 flags.go:64] FLAG: --cgroup-root="" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734362 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734365 2578 flags.go:64] FLAG: --client-ca-file="" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734372 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734375 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734379 2578 flags.go:64] FLAG: --cluster-domain="" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734382 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734385 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734388 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734391 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734395 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 14:56:45.739874 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734398 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734400 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734403 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734406 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734410 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734414 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734417 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734420 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734424 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734426 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734429 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734432 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734435 2578 flags.go:64] FLAG: --enable-server="true" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734437 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734442 2578 flags.go:64] FLAG: --event-burst="100" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734445 2578 flags.go:64] FLAG: --event-qps="50" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734447 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734450 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734453 2578 flags.go:64] FLAG: --eviction-hard="" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734457 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734460 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734462 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734465 2578 flags.go:64] FLAG: --eviction-soft="" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734468 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734471 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 14:56:45.740483 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734474 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734477 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734479 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734482 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734484 2578 flags.go:64] FLAG: --feature-gates="" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734490 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734493 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734496 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734499 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734502 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734505 2578 flags.go:64] FLAG: --help="false" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734508 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-154.ec2.internal" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734512 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734514 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734517 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734520 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734523 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734526 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734528 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734531 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734534 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734536 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734539 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734542 2578 flags.go:64] FLAG: --kube-reserved="" Jul 05 14:56:45.741128 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734544 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734547 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734550 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734552 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734555 2578 flags.go:64] FLAG: --lock-file="" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734557 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734560 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734563 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734568 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734576 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734579 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734582 2578 flags.go:64] FLAG: --logging-format="text" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734584 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734588 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734590 2578 flags.go:64] FLAG: --manifest-url="" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734592 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734612 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734615 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734619 2578 flags.go:64] FLAG: --max-pods="110" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734622 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734633 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734636 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734639 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734642 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734645 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 14:56:45.741729 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734648 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734654 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734657 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734660 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734663 2578 flags.go:64] FLAG: --pod-cidr="" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734665 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734670 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734673 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734676 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734678 2578 flags.go:64] FLAG: --port="10250" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734681 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734684 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076d3f976d1a4a10e" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734687 2578 flags.go:64] FLAG: --qos-reserved="" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734690 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734693 2578 flags.go:64] FLAG: --register-node="true" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734695 2578 flags.go:64] FLAG: --register-with-taints="" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734699 2578 flags.go:64] FLAG: --registry-burst="10" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734702 2578 flags.go:64] FLAG: --registry-qps="5" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734705 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734707 2578 flags.go:64] FLAG: --reserved-memory="" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734711 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734714 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734716 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734719 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734722 2578 flags.go:64] FLAG: --runonce="false" Jul 05 14:56:45.742343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734724 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734727 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734730 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734732 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734735 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734737 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734740 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734743 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734745 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734748 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734750 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734753 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734756 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734758 2578 flags.go:64] FLAG: --system-cgroups="" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734761 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734766 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734768 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734771 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734774 2578 flags.go:64] FLAG: --tls-min-version="" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734776 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734779 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734782 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734785 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734787 2578 flags.go:64] FLAG: --v="2" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734791 2578 flags.go:64] FLAG: --version="false" Jul 05 14:56:45.742966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734795 2578 flags.go:64] FLAG: --vmodule="" Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734799 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.734802 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734906 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734910 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734912 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734915 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734917 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734920 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734922 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734925 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734927 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734929 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734932 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734935 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734937 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734939 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734942 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734944 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734947 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 14:56:45.743682 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734949 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734952 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734954 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734957 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734959 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734962 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734964 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734966 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734970 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734974 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734978 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734981 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734983 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734988 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734992 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734995 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.734998 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735000 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735003 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 14:56:45.744171 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735005 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735008 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735010 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735013 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735015 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735017 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735020 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735022 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735025 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735027 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735029 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735032 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735034 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735036 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735039 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735041 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735044 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735047 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735049 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735051 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 14:56:45.744645 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735054 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735058 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735061 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735063 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735066 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735068 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735070 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735074 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735077 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735079 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735081 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735084 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735086 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735089 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735091 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735093 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735096 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735098 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735101 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 14:56:45.745136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735103 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735107 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735110 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735113 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735115 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735118 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735120 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735123 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735125 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735128 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735130 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735133 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735135 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735138 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735141 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735144 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735147 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735149 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735151 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 14:56:45.745586 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735154 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735157 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735160 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735163 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.735165 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.735174 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.741806 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.741822 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.741839 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.741844 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741913 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741919 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741923 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741926 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 14:56:45.746064 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741929 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741932 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741934 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741937 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741940 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741943 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741945 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741948 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741950 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741952 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741955 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741958 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741960 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741963 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741966 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741968 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741971 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741973 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741976 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741978 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 14:56:45.746410 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741981 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741983 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741986 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741990 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741993 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741997 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.741999 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742002 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742004 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742006 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742009 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742011 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742013 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742016 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742018 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742020 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742023 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742025 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742028 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742030 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 14:56:45.746975 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742033 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742035 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742038 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742041 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742043 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742046 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742048 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742051 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742053 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742055 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742058 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742060 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742063 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742065 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742068 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742070 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742072 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742075 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742077 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742080 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 14:56:45.747471 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742082 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742084 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742087 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742089 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742092 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742094 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742097 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742099 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742102 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742106 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742109 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742113 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742115 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742118 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742121 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742124 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742126 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742129 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742131 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 14:56:45.747969 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742133 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742136 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742138 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742140 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742143 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742145 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742147 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742156 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742158 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742161 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742163 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742166 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742168 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742170 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742173 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 14:56:45.748416 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742175 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.742180 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742334 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742338 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742341 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742344 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742347 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742350 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742352 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742355 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742358 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742360 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742363 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742365 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742367 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 14:56:45.748797 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742370 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742372 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742375 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742377 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742379 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742382 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742384 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742386 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742388 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742391 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742400 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742402 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742404 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742407 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742409 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742412 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742414 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742416 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742418 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742421 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 14:56:45.749160 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742423 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742426 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742428 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742430 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742433 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742435 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742437 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742440 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742442 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742445 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742447 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742449 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742453 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742456 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742459 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742462 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742464 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742467 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742469 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 14:56:45.749680 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742472 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742474 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742476 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742479 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742486 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742489 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742491 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742494 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742496 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742498 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742501 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742503 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742505 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742508 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742511 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742514 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742517 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742520 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742522 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742525 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 14:56:45.750136 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742527 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742529 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742532 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742534 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742542 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742545 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742547 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742549 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742552 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742554 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742556 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742559 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742561 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742564 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742567 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742570 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742573 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742581 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742587 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 14:56:45.750628 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742589 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742592 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742613 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742617 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742620 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742622 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742625 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:45.742627 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.742632 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.742722 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.745567 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.747023 2578 server.go:1019] "Starting client certificate rotation" Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.747123 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 14:56:45.751091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.747149 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 14:56:45.751404 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.749553 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 14:56:45.754193 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.753977 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 14:56:45.765236 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.765217 2578 log.go:25] "Validated CRI v1 runtime API" Jul 05 14:56:45.768001 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.767982 2578 log.go:25] "Validated CRI v1 image API" Jul 05 14:56:45.768831 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.768815 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 14:56:45.771019 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.771003 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7d6b1b6d-9116-40c5-adf2-9629d9eaad98:/dev/nvme0n1p4 f5ed6c86-b06b-47fc-a601-f8d59e918869:/dev/nvme0n1p3] Jul 05 14:56:45.771087 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.771019 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 14:56:45.772629 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.772587 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 14:56:45.775995 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.775891 2578 manager.go:216] Machine: {Timestamp:2026-07-05 14:56:45.774662196 +0000 UTC m=+0.291857105 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097330 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a870601064c4f9dbe110a6b528d18 SystemUUID:ec2a8706-0106-4c4f-9dbe-110a6b528d18 BootID:bc5ef2c4-9a3f-4910-b38a-b2b5565cec47 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:0d:57:7b:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:0d:57:7b:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:0b:0e:58:22:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 14:56:45.775995 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.775991 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 14:56:45.776115 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.776055 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 14:56:45.779085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.779061 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 14:56:45.779214 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.779088 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-154.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 14:56:45.780323 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.780313 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 14:56:45.780356 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.780326 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 14:56:45.780356 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.780337 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 14:56:45.780356 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.780350 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 14:56:45.781767 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.781757 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 14:56:45.785851 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.785840 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 05 14:56:45.786103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786093 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 14:56:45.786141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786121 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 05 14:56:45.786141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786131 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 14:56:45.786201 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786142 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 14:56:45.786201 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786150 2578 kubelet.go:398] "Adding apiserver pod source" Jul 05 14:56:45.786201 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786159 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 14:56:45.786851 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786819 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 14:56:45.786851 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.786851 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 14:56:45.788848 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.788833 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 14:56:45.790728 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.790714 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 14:56:45.790784 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.790744 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 14:56:45.791938 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791927 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791943 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791949 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791954 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791962 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791967 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791975 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791980 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791985 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 14:56:45.791988 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791990 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 14:56:45.792208 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.791998 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 14:56:45.792208 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.792004 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 14:56:45.793355 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.793341 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 14:56:45.793355 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.793351 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 14:56:45.798046 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.797866 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9j6fh" Jul 05 14:56:45.799428 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.799412 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-154.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 14:56:45.799697 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.799683 2578 server.go:1268] "Started kubelet" Jul 05 14:56:45.799778 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.799752 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 14:56:45.800067 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.800010 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 14:56:45.800067 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.800002 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 14:56:45.800498 ip-10-0-128-154 systemd[1]: Started Kubernetes Kubelet. Jul 05 14:56:45.800636 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.800560 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 14:56:45.800750 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.800643 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 14:56:45.801650 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.801636 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 05 14:56:45.801837 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.801822 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 14:56:45.804984 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.804958 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 14:56:45.804984 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.804107 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-154.ec2.internal.18bf6c9e93a42df1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-154.ec2.internal,UID:ip-10-0-128-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-154.ec2.internal,},FirstTimestamp:2026-07-05 14:56:45.799648753 +0000 UTC m=+0.316843664,LastTimestamp:2026-07-05 14:56:45.799648753 +0000 UTC m=+0.316843664,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-154.ec2.internal,}" Jul 05 14:56:45.805121 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.805066 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9j6fh" Jul 05 14:56:45.808967 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.808954 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 14:56:45.809069 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.809046 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 14:56:45.809157 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.809127 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:45.809663 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.809643 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 14:56:45.809756 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.809674 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 14:56:45.809756 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.809687 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 14:56:45.809860 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.809834 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 05 14:56:45.809860 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.809845 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 05 14:56:45.810099 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810086 2578 factory.go:153] Registering CRI-O factory Jul 05 14:56:45.810165 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810102 2578 factory.go:223] Registration of the crio container factory successfully Jul 05 14:56:45.810165 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810149 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 14:56:45.810165 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810158 2578 factory.go:55] Registering systemd factory Jul 05 14:56:45.810165 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810166 2578 factory.go:223] Registration of the systemd container factory successfully Jul 05 14:56:45.810351 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810199 2578 factory.go:103] Registering Raw factory Jul 05 14:56:45.810351 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810213 2578 manager.go:1196] Started watching for new ooms in manager Jul 05 14:56:45.810685 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.810672 2578 manager.go:349] Starting recovery of all containers Jul 05 14:56:45.814884 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.814851 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 14:56:45.818105 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.817996 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-154.ec2.internal\" not found" node="ip-10-0-128-154.ec2.internal" Jul 05 14:56:45.822662 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.822649 2578 manager.go:354] Recovery completed Jul 05 14:56:45.828754 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.828738 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:45.830964 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.830950 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:45.831032 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.830979 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:45.831032 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.830993 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:45.831509 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.831491 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 14:56:45.831509 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.831509 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 14:56:45.831625 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.831516 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:45.831625 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.831524 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 05 14:56:45.832191 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.832174 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:45.832257 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.832208 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:45.832257 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.832220 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:45.833654 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.833643 2578 policy_none.go:49] "None policy: Start" Jul 05 14:56:45.833693 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.833658 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 14:56:45.833693 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.833668 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 14:56:45.835656 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.835646 2578 policy_none.go:47] "Start" Jul 05 14:56:45.869493 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869480 2578 manager.go:337] "Starting Device Plugin manager" Jul 05 14:56:45.869545 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.869507 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 14:56:45.869545 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869518 2578 server.go:87] "Starting device plugin registration server" Jul 05 14:56:45.869778 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869765 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 14:56:45.869818 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869781 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 14:56:45.869906 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869865 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 14:56:45.869958 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869929 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 14:56:45.869958 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.869938 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 14:56:45.870396 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.870376 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 14:56:45.870467 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.870428 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:45.911588 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.911549 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 14:56:45.919426 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.912871 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 14:56:45.919426 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.912900 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 14:56:45.919426 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.912919 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 14:56:45.919426 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.912959 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 14:56:45.919426 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.915446 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 14:56:45.970611 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.970573 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:45.971576 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.971554 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:45.971704 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.971592 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:45.971704 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.971630 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:45.971704 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.971654 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-154.ec2.internal" Jul 05 14:56:45.980620 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:45.980564 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-154.ec2.internal" Jul 05 14:56:45.980620 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.980591 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-154.ec2.internal\": node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:45.996946 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:45.996930 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.013319 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.013300 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal"] Jul 05 14:56:46.013404 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.013367 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:46.014743 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.014728 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:46.014816 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.014756 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:46.014816 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.014766 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:46.017091 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017079 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:46.017221 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.017221 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017220 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:46.017701 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017689 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:46.017771 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017710 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:46.017771 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017724 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:46.017771 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017744 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:46.017771 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017767 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:46.017905 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.017777 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:46.019982 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.019967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.020058 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.019990 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 14:56:46.020580 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.020566 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientMemory" Jul 05 14:56:46.020660 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.020613 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 14:56:46.020660 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.020624 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeHasSufficientPID" Jul 05 14:56:46.043122 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.043099 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-154.ec2.internal\" not found" node="ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.047497 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.047483 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-154.ec2.internal\" not found" node="ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.097818 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.097803 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.111148 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.111130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd80959fde4a48effd87e2c278dadfc9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal\" (UID: \"fd80959fde4a48effd87e2c278dadfc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.111227 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.111156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be5c8aa657a1c0c2e2171dae8c1ff8b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-154.ec2.internal\" (UID: \"2be5c8aa657a1c0c2e2171dae8c1ff8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.111227 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.111173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd80959fde4a48effd87e2c278dadfc9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal\" (UID: \"fd80959fde4a48effd87e2c278dadfc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.198749 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.198711 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.212082 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.212058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd80959fde4a48effd87e2c278dadfc9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal\" (UID: \"fd80959fde4a48effd87e2c278dadfc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.212135 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.212091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd80959fde4a48effd87e2c278dadfc9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal\" (UID: \"fd80959fde4a48effd87e2c278dadfc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.212135 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.212108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be5c8aa657a1c0c2e2171dae8c1ff8b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-154.ec2.internal\" (UID: \"2be5c8aa657a1c0c2e2171dae8c1ff8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.212194 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.212160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd80959fde4a48effd87e2c278dadfc9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal\" (UID: \"fd80959fde4a48effd87e2c278dadfc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.212194 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.212168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd80959fde4a48effd87e2c278dadfc9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal\" (UID: \"fd80959fde4a48effd87e2c278dadfc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.212255 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.212151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be5c8aa657a1c0c2e2171dae8c1ff8b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-154.ec2.internal\" (UID: \"2be5c8aa657a1c0c2e2171dae8c1ff8b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.299538 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.299475 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.347022 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.346994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.350880 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.350862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" Jul 05 14:56:46.399857 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.399830 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.500359 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.500318 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.600965 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.600893 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.701382 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.701352 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.746889 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.746861 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 14:56:46.747447 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.747000 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 14:56:46.747447 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.747053 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 14:56:46.801937 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.801912 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:46.812470 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.812439 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 14:51:47 +0000 UTC" deadline="2027-12-27 02:59:02.356335058 +0000 UTC" Jul 05 14:56:46.812470 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:46.812463 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12948h2m15.543874286s" Jul 05 14:56:46.902415 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:46.902353 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:48.418087 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:48.418059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be5c8aa657a1c0c2e2171dae8c1ff8b.slice/crio-a2c34bc2f6dd9b91098185de1fdbcadeb6b0cc85e8eb2da511695ad528a8c3bc WatchSource:0}: Error finding container a2c34bc2f6dd9b91098185de1fdbcadeb6b0cc85e8eb2da511695ad528a8c3bc: Status 404 returned error can't find the container with id a2c34bc2f6dd9b91098185de1fdbcadeb6b0cc85e8eb2da511695ad528a8c3bc Jul 05 14:56:48.418323 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:48.418301 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd80959fde4a48effd87e2c278dadfc9.slice/crio-ef473d35a4ee2a418066b6e2d2103de28d16f751c132245ebbc75b69dd4790e0 WatchSource:0}: Error finding container ef473d35a4ee2a418066b6e2d2103de28d16f751c132245ebbc75b69dd4790e0: Status 404 returned error can't find the container with id ef473d35a4ee2a418066b6e2d2103de28d16f751c132245ebbc75b69dd4790e0 Jul 05 14:56:48.423668 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.423649 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 14:56:48.459688 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:48.459667 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:48.470201 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.470180 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 14:56:48.559982 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:48.559952 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:48.660525 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:48.660437 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-154.ec2.internal\" not found" Jul 05 14:56:48.697962 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.697933 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 14:56:48.766923 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.766896 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" Jul 05 14:56:48.777979 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.777961 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 14:56:48.779051 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.779040 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" Jul 05 14:56:48.784428 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:48.784412 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 14:56:49.241242 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.241215 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 14:56:49.244869 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.244847 2578 apiserver.go:52] "Watching apiserver" Jul 05 14:56:49.253025 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.253000 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 14:56:49.255016 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.254576 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-6wzxm","openshift-multus/network-metrics-daemon-q5c8q","kube-system/konnectivity-agent-h6x8p","openshift-dns/node-resolver-dpgh5","openshift-image-registry/node-ca-zczxh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal","openshift-multus/multus-additional-cni-plugins-f6qq4","openshift-network-diagnostics/network-check-target-ssjm4","openshift-network-operator/iptables-alerter-ckjq4","openshift-ovn-kubernetes/ovnkube-node-dfhn6","kube-system/global-pull-secret-syncer-6x6gm","kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f","openshift-cluster-node-tuning-operator/tuned-8ft62"] Jul 05 14:56:49.257336 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.257313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.259494 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.259477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.260047 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.260030 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 14:56:49.260047 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.260040 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 14:56:49.260210 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.260051 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.260210 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.260080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 14:56:49.260342 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.260241 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l2r8m\"" Jul 05 14:56:49.260417 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.260393 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.261223 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.261202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.261340 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.261300 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.261438 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.261202 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v6dq7\"" Jul 05 14:56:49.261485 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.261463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 14:56:49.264155 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.264134 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.266715 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.265924 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 14:56:49.266715 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.266115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 14:56:49.266715 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.266291 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9fpq2\"" Jul 05 14:56:49.266715 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.266682 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 14:56:49.266715 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.266691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.268285 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.268263 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.268486 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.268469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.269292 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.268726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9pk69\"" Jul 05 14:56:49.269292 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.268763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.270679 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.270620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.270904 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.270882 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ww9kb\"" Jul 05 14:56:49.270982 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.270926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.271079 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.270892 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 14:56:49.271319 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.271300 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.273325 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.273069 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.273325 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.273140 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8gsz6\"" Jul 05 14:56:49.273473 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.273373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.274103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.274085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.275755 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.275738 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.275921 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.275902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.275993 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.275943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.275993 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.275972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-sys-fs\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.275992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-system-cni-dir\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-registration-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/78c93761-12ad-45cc-8378-54b3e1dd22a3-agent-certs\") pod \"konnectivity-agent-h6x8p\" (UID: \"78c93761-12ad-45cc-8378-54b3e1dd22a3\") " pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276060 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/78c93761-12ad-45cc-8378-54b3e1dd22a3-konnectivity-ca\") pod \"konnectivity-agent-h6x8p\" (UID: \"78c93761-12ad-45cc-8378-54b3e1dd22a3\") " pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-knl25\"" Jul 05 14:56:49.276103 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd4ea5a6-0938-4704-a704-5d9a29d9abae-hosts-file\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv2gc\" (UniqueName: \"kubernetes.io/projected/fd4ea5a6-0938-4704-a704-5d9a29d9abae-kube-api-access-jv2gc\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-serviceca\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqvxj\" (UniqueName: \"kubernetes.io/projected/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-kube-api-access-sqvxj\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-socket-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-device-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276300 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cnibin\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shst\" (UniqueName: \"kubernetes.io/projected/cf69e56c-748f-4fa4-99b1-ecad1714df4e-kube-api-access-5shst\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd4ea5a6-0938-4704-a704-5d9a29d9abae-tmp-dir\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blkgf\" (UniqueName: \"kubernetes.io/projected/4c59ee82-412a-471a-9c94-a4b8f04f2d82-kube-api-access-blkgf\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-host\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.276474 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-os-release\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.277200 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.276492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.279399 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.278711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.279399 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.278805 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:56:49.279399 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.278828 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 14:56:49.279399 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.279206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bl8l\"" Jul 05 14:56:49.279823 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.279804 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 14:56:49.281351 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.281335 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.283557 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.283530 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.283656 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.283615 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:56:49.284085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.284066 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 14:56:49.284220 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.284200 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s8ww8\"" Jul 05 14:56:49.284307 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.284246 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 14:56:49.284399 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.284384 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 14:56:49.284463 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.284393 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 14:56:49.284733 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.284711 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 14:56:49.286024 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.286004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:49.286135 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.286107 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:56:49.286430 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.286408 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 14:56:49.301435 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.301414 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mrfcc" Jul 05 14:56:49.309574 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.309552 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mrfcc" Jul 05 14:56:49.346364 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.346345 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 14:56:49.368151 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.368123 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 14:56:49.374288 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.374243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" event={"ID":"2be5c8aa657a1c0c2e2171dae8c1ff8b","Type":"ContainerStarted","Data":"a2c34bc2f6dd9b91098185de1fdbcadeb6b0cc85e8eb2da511695ad528a8c3bc"} Jul 05 14:56:49.375533 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.375509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" event={"ID":"fd80959fde4a48effd87e2c278dadfc9","Type":"ContainerStarted","Data":"ef473d35a4ee2a418066b6e2d2103de28d16f751c132245ebbc75b69dd4790e0"} Jul 05 14:56:49.377173 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.377261 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-serviceca\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.377261 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-device-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.377261 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-lib-modules\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.377368 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-kubelet\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.377368 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cnibin\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.377368 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd4ea5a6-0938-4704-a704-5d9a29d9abae-tmp-dir\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.377368 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.377502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-os-release\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.377502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.377502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-var-lib-kubelet\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.377502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9546w\" (UniqueName: \"kubernetes.io/projected/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-kube-api-access-9546w\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.377502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-cni-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.377502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-conf-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-cni-bin\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-system-cni-dir\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-registration-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-modprobe-d\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/151b0838-bc2f-4690-bafd-b8a8028d36f3-cni-binary-copy\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.377725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-etc-kubernetes\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-kubelet\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-run-netns\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2da13b87-0ce6-4976-93dc-5568774436ea-iptables-alerter-script\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997tj\" (UniqueName: \"kubernetes.io/projected/2fd29184-9ded-433b-8f51-412f90541242-kube-api-access-997tj\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c31a2572-862e-4711-9eba-668336d76999-dbus\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysctl-conf\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.377996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-socket-dir-parent\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-daemon-config\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-ovn\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovn-node-metrics-cert\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-host\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.378118 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-sys-fs\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-netns\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-serviceca\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-cni-bin\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-device-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-hostroot\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmsn\" (UniqueName: \"kubernetes.io/projected/151b0838-bc2f-4690-bafd-b8a8028d36f3-kube-api-access-tfmsn\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-system-cni-dir\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378364 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cnibin\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/78c93761-12ad-45cc-8378-54b3e1dd22a3-agent-certs\") pod \"konnectivity-agent-h6x8p\" (UID: \"78c93761-12ad-45cc-8378-54b3e1dd22a3\") " pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-slash\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovnkube-script-lib\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5shst\" (UniqueName: \"kubernetes.io/projected/cf69e56c-748f-4fa4-99b1-ecad1714df4e-kube-api-access-5shst\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-k8s-cni-cncf-io\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-var-lib-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.378617 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2da13b87-0ce6-4976-93dc-5568774436ea-host-slash\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c31a2572-862e-4711-9eba-668336d76999-kubelet-config\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-multus-certs\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-systemd-units\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kd5p\" (UniqueName: \"kubernetes.io/projected/7b40bf3d-ad9c-437f-aefd-55c991a1726c-kube-api-access-9kd5p\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wk9q\" (UniqueName: \"kubernetes.io/projected/2da13b87-0ce6-4976-93dc-5568774436ea-kube-api-access-4wk9q\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-sys\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-etc-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysconfig\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-run\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-system-cni-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cni-binary-copy\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.378983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd4ea5a6-0938-4704-a704-5d9a29d9abae-tmp-dir\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.379085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-registration-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-cnibin\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-host\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-log-socket\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovnkube-config\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqvxj\" (UniqueName: \"kubernetes.io/projected/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-kube-api-access-sqvxj\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-socket-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379308 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-host\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-os-release\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-cni-multus\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-socket-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.379553 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c59ee82-412a-471a-9c94-a4b8f04f2d82-os-release\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-systemd\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-kubernetes\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysctl-d\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-env-overrides\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf69e56c-748f-4fa4-99b1-ecad1714df4e-sys-fs\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blkgf\" (UniqueName: \"kubernetes.io/projected/4c59ee82-412a-471a-9c94-a4b8f04f2d82-kube-api-access-blkgf\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-node-log\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c59ee82-412a-471a-9c94-a4b8f04f2d82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-cni-netd\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/78c93761-12ad-45cc-8378-54b3e1dd22a3-konnectivity-ca\") pod \"konnectivity-agent-h6x8p\" (UID: \"78c93761-12ad-45cc-8378-54b3e1dd22a3\") " pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.379991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd4ea5a6-0938-4704-a704-5d9a29d9abae-hosts-file\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.380044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv2gc\" (UniqueName: \"kubernetes.io/projected/fd4ea5a6-0938-4704-a704-5d9a29d9abae-kube-api-access-jv2gc\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.380046 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd4ea5a6-0938-4704-a704-5d9a29d9abae-hosts-file\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.380095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-systemd\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.380202 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.380192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-tuned\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.380922 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.380233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-tmp\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.380922 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.380634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/78c93761-12ad-45cc-8378-54b3e1dd22a3-konnectivity-ca\") pod \"konnectivity-agent-h6x8p\" (UID: \"78c93761-12ad-45cc-8378-54b3e1dd22a3\") " pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.383211 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.383186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/78c93761-12ad-45cc-8378-54b3e1dd22a3-agent-certs\") pod \"konnectivity-agent-h6x8p\" (UID: \"78c93761-12ad-45cc-8378-54b3e1dd22a3\") " pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.390112 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.390092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv2gc\" (UniqueName: \"kubernetes.io/projected/fd4ea5a6-0938-4704-a704-5d9a29d9abae-kube-api-access-jv2gc\") pod \"node-resolver-dpgh5\" (UID: \"fd4ea5a6-0938-4704-a704-5d9a29d9abae\") " pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.391632 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.391566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blkgf\" (UniqueName: \"kubernetes.io/projected/4c59ee82-412a-471a-9c94-a4b8f04f2d82-kube-api-access-blkgf\") pod \"multus-additional-cni-plugins-f6qq4\" (UID: \"4c59ee82-412a-471a-9c94-a4b8f04f2d82\") " pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.392263 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.392245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shst\" (UniqueName: \"kubernetes.io/projected/cf69e56c-748f-4fa4-99b1-ecad1714df4e-kube-api-access-5shst\") pod \"aws-ebs-csi-driver-node-2g82f\" (UID: \"cf69e56c-748f-4fa4-99b1-ecad1714df4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.392545 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.392527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqvxj\" (UniqueName: \"kubernetes.io/projected/9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0-kube-api-access-sqvxj\") pod \"node-ca-zczxh\" (UID: \"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0\") " pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.481510 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kd5p\" (UniqueName: \"kubernetes.io/projected/7b40bf3d-ad9c-437f-aefd-55c991a1726c-kube-api-access-9kd5p\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.481510 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wk9q\" (UniqueName: \"kubernetes.io/projected/2da13b87-0ce6-4976-93dc-5568774436ea-kube-api-access-4wk9q\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-sys\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-etc-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysconfig\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-run\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-system-cni-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-cnibin\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-log-socket\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovnkube-config\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-host\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-os-release\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.481769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-cni-multus\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-systemd\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-kubernetes\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysctl-d\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-env-overrides\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-node-log\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-cni-netd\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-systemd\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-tuned\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.481983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-tmp\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-lib-modules\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.482011 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-kubelet\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.482086 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:49.982064079 +0000 UTC m=+3.042260036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-var-lib-kubelet\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9546w\" (UniqueName: \"kubernetes.io/projected/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-kube-api-access-9546w\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-host\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-cni-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-conf-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-os-release\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-cni-bin\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482251 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-cni-bin\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-modprobe-d\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-etc-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/151b0838-bc2f-4690-bafd-b8a8028d36f3-cni-binary-copy\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysconfig\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-etc-kubernetes\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-run\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-kubelet\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-run-netns\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-system-cni-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.482919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2da13b87-0ce6-4976-93dc-5568774436ea-iptables-alerter-script\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997tj\" (UniqueName: \"kubernetes.io/projected/2fd29184-9ded-433b-8f51-412f90541242-kube-api-access-997tj\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c31a2572-862e-4711-9eba-668336d76999-dbus\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-log-socket\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysctl-conf\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-socket-dir-parent\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-daemon-config\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-ovn\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovn-node-metrics-cert\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-netns\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-cni-bin\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-hostroot\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmsn\" (UniqueName: \"kubernetes.io/projected/151b0838-bc2f-4690-bafd-b8a8028d36f3-kube-api-access-tfmsn\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-slash\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovnkube-script-lib\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-k8s-cni-cncf-io\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-var-lib-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.483658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2da13b87-0ce6-4976-93dc-5568774436ea-host-slash\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c31a2572-862e-4711-9eba-668336d76999-kubelet-config\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-multus-certs\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-systemd-units\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovnkube-config\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483075 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-systemd-units\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-cni-multus\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-systemd\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-kubernetes\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483252 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-var-lib-kubelet\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysctl-d\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-cni-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-conf-dir\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-env-overrides\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c31a2572-862e-4711-9eba-668336d76999-dbus\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-node-log\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.484287 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-cni-netd\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-systemd\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-ovn\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-socket-dir-parent\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-run-netns\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-kubelet\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484254 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-run-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/151b0838-bc2f-4690-bafd-b8a8028d36f3-multus-daemon-config\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-kubelet\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.482465 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-cnibin\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.483767 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-sysctl-conf\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-sys\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-lib-modules\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-etc-kubernetes\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.484574 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484575 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/151b0838-bc2f-4690-bafd-b8a8028d36f3-cni-binary-copy\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.484646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:49.984629796 +0000 UTC m=+3.044825739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484699 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-k8s-cni-cncf-io\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.485141 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-modprobe-d\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-hostroot\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484782 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-netns\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-var-lib-cni-bin\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c31a2572-862e-4711-9eba-668336d76999-kubelet-config\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-var-lib-openvswitch\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2da13b87-0ce6-4976-93dc-5568774436ea-host-slash\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.484960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/151b0838-bc2f-4690-bafd-b8a8028d36f3-host-run-multus-certs\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.485111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b40bf3d-ad9c-437f-aefd-55c991a1726c-host-slash\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.485202 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovnkube-script-lib\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.486183 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.485328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2da13b87-0ce6-4976-93dc-5568774436ea-iptables-alerter-script\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.486842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.486825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-tmp\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.486931 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.486911 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b40bf3d-ad9c-437f-aefd-55c991a1726c-ovn-node-metrics-cert\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.487233 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.487217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-etc-tuned\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.490960 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.490939 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:56:49.490960 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.490963 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:56:49.491150 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.490976 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:49.491150 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.491026 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:49.991011481 +0000 UTC m=+3.051207433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:49.492754 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.492685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wk9q\" (UniqueName: \"kubernetes.io/projected/2da13b87-0ce6-4976-93dc-5568774436ea-kube-api-access-4wk9q\") pod \"iptables-alerter-ckjq4\" (UID: \"2da13b87-0ce6-4976-93dc-5568774436ea\") " pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.492824 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.492768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kd5p\" (UniqueName: \"kubernetes.io/projected/7b40bf3d-ad9c-437f-aefd-55c991a1726c-kube-api-access-9kd5p\") pod \"ovnkube-node-dfhn6\" (UID: \"7b40bf3d-ad9c-437f-aefd-55c991a1726c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.493342 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.493323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmsn\" (UniqueName: \"kubernetes.io/projected/151b0838-bc2f-4690-bafd-b8a8028d36f3-kube-api-access-tfmsn\") pod \"multus-6wzxm\" (UID: \"151b0838-bc2f-4690-bafd-b8a8028d36f3\") " pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.493904 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.493886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9546w\" (UniqueName: \"kubernetes.io/projected/3c0f8466-e4f0-45ac-a0ea-2a739d72b915-kube-api-access-9546w\") pod \"tuned-8ft62\" (UID: \"3c0f8466-e4f0-45ac-a0ea-2a739d72b915\") " pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.493990 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.493942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-997tj\" (UniqueName: \"kubernetes.io/projected/2fd29184-9ded-433b-8f51-412f90541242-kube-api-access-997tj\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.578656 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.578631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" Jul 05 14:56:49.587000 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.586976 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" Jul 05 14:56:49.596593 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.596571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:56:49.603162 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.603148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpgh5" Jul 05 14:56:49.610692 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.610665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zczxh" Jul 05 14:56:49.619253 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.619233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8ft62" Jul 05 14:56:49.627868 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.627848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ckjq4" Jul 05 14:56:49.636347 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.636331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wzxm" Jul 05 14:56:49.642926 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.642911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:56:49.986278 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.986252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:49.986458 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:49.986319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:49.986458 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.986401 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:49.986458 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.986451 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:49.986458 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.986457 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:50.986443395 +0000 UTC m=+4.046639334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:49.986641 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:49.986500 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:50.986484653 +0000 UTC m=+4.046680594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:50.087204 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:50.087178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:50.087363 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.087346 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:56:50.087406 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.087370 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:56:50.087406 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.087380 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:50.087466 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.087428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:51.087414231 +0000 UTC m=+4.147610169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:50.313862 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:50.313778 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 14:51:49 +0000 UTC" deadline="2028-04-14 16:09:54.369271368 +0000 UTC" Jul 05 14:56:50.313862 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:50.313824 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15577h13m4.055462955s" Jul 05 14:56:50.445493 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.445459 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b40bf3d_ad9c_437f_aefd_55c991a1726c.slice/crio-11457abc409f1d0213f58b9930eb4fca6c60118f5f792cf3d1416a9ee9413793 WatchSource:0}: Error finding container 11457abc409f1d0213f58b9930eb4fca6c60118f5f792cf3d1416a9ee9413793: Status 404 returned error can't find the container with id 11457abc409f1d0213f58b9930eb4fca6c60118f5f792cf3d1416a9ee9413793 Jul 05 14:56:50.446218 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.446198 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151b0838_bc2f_4690_bafd_b8a8028d36f3.slice/crio-d5a0cb6f9a7db20eb31fa3151803e312854d3cac016da451ac36554c7610d069 WatchSource:0}: Error finding container d5a0cb6f9a7db20eb31fa3151803e312854d3cac016da451ac36554c7610d069: Status 404 returned error can't find the container with id d5a0cb6f9a7db20eb31fa3151803e312854d3cac016da451ac36554c7610d069 Jul 05 14:56:50.447575 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.447549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0f8466_e4f0_45ac_a0ea_2a739d72b915.slice/crio-8daeb2d78249b64a3338fcec8d458c720f653f7eb659bf1184202b06186b84ae WatchSource:0}: Error finding container 8daeb2d78249b64a3338fcec8d458c720f653f7eb659bf1184202b06186b84ae: Status 404 returned error can't find the container with id 8daeb2d78249b64a3338fcec8d458c720f653f7eb659bf1184202b06186b84ae Jul 05 14:56:50.449467 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.449446 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2dc84f_f22c_4dc4_89fa_d627bb1c85a0.slice/crio-d6f6c02372a00850d4e37d943849eb91a5c48921e22bcd1c803d37c80d312635 WatchSource:0}: Error finding container d6f6c02372a00850d4e37d943849eb91a5c48921e22bcd1c803d37c80d312635: Status 404 returned error can't find the container with id d6f6c02372a00850d4e37d943849eb91a5c48921e22bcd1c803d37c80d312635 Jul 05 14:56:50.453441 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.453404 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c93761_12ad_45cc_8378_54b3e1dd22a3.slice/crio-a2f3220301924d49632c3ff8b2c1ba1eed6d60c8b690128f4afd1b8a27aea9f2 WatchSource:0}: Error finding container a2f3220301924d49632c3ff8b2c1ba1eed6d60c8b690128f4afd1b8a27aea9f2: Status 404 returned error can't find the container with id a2f3220301924d49632c3ff8b2c1ba1eed6d60c8b690128f4afd1b8a27aea9f2 Jul 05 14:56:50.455250 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.455222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c59ee82_412a_471a_9c94_a4b8f04f2d82.slice/crio-25cd17c334050149129dbb53f0afc9b1afd87f3032b91801086c19a6d2829c3a WatchSource:0}: Error finding container 25cd17c334050149129dbb53f0afc9b1afd87f3032b91801086c19a6d2829c3a: Status 404 returned error can't find the container with id 25cd17c334050149129dbb53f0afc9b1afd87f3032b91801086c19a6d2829c3a Jul 05 14:56:50.457220 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:56:50.457177 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da13b87_0ce6_4976_93dc_5568774436ea.slice/crio-c322d321d317610f68f45ef446dc49bcc26b1bdd47adb7ed999cdd42e967b4a9 WatchSource:0}: Error finding container c322d321d317610f68f45ef446dc49bcc26b1bdd47adb7ed999cdd42e967b4a9: Status 404 returned error can't find the container with id c322d321d317610f68f45ef446dc49bcc26b1bdd47adb7ed999cdd42e967b4a9 Jul 05 14:56:50.993981 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:50.993181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:50.993981 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:50.993469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:50.993981 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.993485 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:50.993981 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.993570 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:52.993550077 +0000 UTC m=+6.053746021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:50.993981 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.993637 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:50.993981 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:50.993690 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:52.993673622 +0000 UTC m=+6.053869566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:51.094841 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.094804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:51.095057 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.095038 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:56:51.095121 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.095063 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:56:51.095121 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.095076 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:51.095235 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.095131 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:53.095113862 +0000 UTC m=+6.155309805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:51.314350 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.314195 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 14:51:49 +0000 UTC" deadline="2028-02-09 19:47:52.396566501 +0000 UTC" Jul 05 14:56:51.314350 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.314227 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14020h51m1.082343649s" Jul 05 14:56:51.379681 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.377843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:51.379681 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.378025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:56:51.379681 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.378220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:51.379681 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.378501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:56:51.379681 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.377856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:51.379681 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:51.378853 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:56:51.395335 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.395299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" event={"ID":"2be5c8aa657a1c0c2e2171dae8c1ff8b","Type":"ContainerStarted","Data":"37d11625bd8fffe37443f71c8c2d4ae188fa25883f0e69555308c0303a92bfa3"} Jul 05 14:56:51.401989 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.401959 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd80959fde4a48effd87e2c278dadfc9" containerID="db1ba04df94c3f60ff4e9c9b6c05aae51f3a17de7f43d6070a47eb00473b0f35" exitCode=0 Jul 05 14:56:51.402131 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.402041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" event={"ID":"fd80959fde4a48effd87e2c278dadfc9","Type":"ContainerDied","Data":"db1ba04df94c3f60ff4e9c9b6c05aae51f3a17de7f43d6070a47eb00473b0f35"} Jul 05 14:56:51.408953 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.408525 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-154.ec2.internal" podStartSLOduration=3.40850704 podStartE2EDuration="3.40850704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:56:51.407916193 +0000 UTC m=+4.468112154" watchObservedRunningTime="2026-07-05 14:56:51.40850704 +0000 UTC m=+4.468703003" Jul 05 14:56:51.415545 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.415520 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ckjq4" event={"ID":"2da13b87-0ce6-4976-93dc-5568774436ea","Type":"ContainerStarted","Data":"c322d321d317610f68f45ef446dc49bcc26b1bdd47adb7ed999cdd42e967b4a9"} Jul 05 14:56:51.444308 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.444282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerStarted","Data":"25cd17c334050149129dbb53f0afc9b1afd87f3032b91801086c19a6d2829c3a"} Jul 05 14:56:51.482839 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.482805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6x8p" event={"ID":"78c93761-12ad-45cc-8378-54b3e1dd22a3","Type":"ContainerStarted","Data":"a2f3220301924d49632c3ff8b2c1ba1eed6d60c8b690128f4afd1b8a27aea9f2"} Jul 05 14:56:51.491482 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.490870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" event={"ID":"cf69e56c-748f-4fa4-99b1-ecad1714df4e","Type":"ContainerStarted","Data":"2b6f70e672e436637ff4bd8958657ce93e89c30a6046f6994dedddf45342300a"} Jul 05 14:56:51.494503 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.494475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zczxh" event={"ID":"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0","Type":"ContainerStarted","Data":"d6f6c02372a00850d4e37d943849eb91a5c48921e22bcd1c803d37c80d312635"} Jul 05 14:56:51.513234 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.513201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8ft62" event={"ID":"3c0f8466-e4f0-45ac-a0ea-2a739d72b915","Type":"ContainerStarted","Data":"8daeb2d78249b64a3338fcec8d458c720f653f7eb659bf1184202b06186b84ae"} Jul 05 14:56:51.523431 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.523400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpgh5" event={"ID":"fd4ea5a6-0938-4704-a704-5d9a29d9abae","Type":"ContainerStarted","Data":"04c9290e404d85beedb47a4bcfb3e9cfb0567d1d29ac1fd759d5f2242f0ce4aa"} Jul 05 14:56:51.536966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.536940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wzxm" event={"ID":"151b0838-bc2f-4690-bafd-b8a8028d36f3","Type":"ContainerStarted","Data":"d5a0cb6f9a7db20eb31fa3151803e312854d3cac016da451ac36554c7610d069"} Jul 05 14:56:51.541702 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:51.541677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"11457abc409f1d0213f58b9930eb4fca6c60118f5f792cf3d1416a9ee9413793"} Jul 05 14:56:52.561533 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:52.561465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" event={"ID":"fd80959fde4a48effd87e2c278dadfc9","Type":"ContainerStarted","Data":"6d375bd1319ee9665efb91c389ce21c91a88849cf3e9c5a8a301ceee555f8339"} Jul 05 14:56:53.009153 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:53.009063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:53.009153 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:53.009137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:53.009397 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.009276 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:53.009397 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.009340 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:57.009321629 +0000 UTC m=+10.069517770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:53.009782 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.009762 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:53.009892 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.009817 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:57.009801894 +0000 UTC m=+10.069997836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:53.110786 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:53.110637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:53.110950 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.110804 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:56:53.110950 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.110827 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:56:53.110950 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.110840 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:53.110950 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.110900 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:56:57.110882097 +0000 UTC m=+10.171078038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:53.373295 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:53.373217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:53.373446 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.373356 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:56:53.373779 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:53.373755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:53.373874 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.373850 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:56:53.373933 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:53.373909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:53.374003 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:53.373980 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:56:55.370616 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:55.370565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:55.371097 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:55.370764 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:56:55.371097 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:55.371016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:55.371220 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:55.371132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:56:55.371541 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:55.371513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:55.371665 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:55.371641 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:56:57.044923 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:57.044699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:57.044923 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:57.044775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:57.044923 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.044812 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:57.044923 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.044862 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:57.044923 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.044883 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:05.044862316 +0000 UTC m=+18.105058259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:56:57.044923 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.044899 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:05.044890134 +0000 UTC m=+18.105086099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:56:57.145685 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:57.145650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:57.145886 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.145863 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:56:57.145963 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.145888 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:56:57.145963 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.145902 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:57.145963 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.145957 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:05.145938527 +0000 UTC m=+18.206134482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:56:57.373347 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:57.371721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:57.373347 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.371862 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:56:57.373347 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:57.372249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:57.373347 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.372340 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:56:57.373624 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:57.373385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:57.373624 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:57.373460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:56:59.371804 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:59.371159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:56:59.371804 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:59.371277 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:56:59.371804 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:59.371661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:56:59.371804 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:59.371760 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:56:59.372433 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:56:59.372400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:56:59.372535 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:56:59.372516 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:01.371150 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:01.371120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:01.371481 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:01.371129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:01.371481 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:01.371213 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:01.371481 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:01.371288 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:01.371481 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:01.371334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:01.371481 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:01.371385 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:03.370977 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:03.370457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:03.370977 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:03.370500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:03.370977 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:03.370470 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:03.370977 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:03.370617 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:03.370977 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:03.370681 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:03.370977 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:03.370776 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:05.107789 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:05.107743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:05.108292 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:05.107821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:05.108292 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.107901 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:57:05.108292 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.107927 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:57:05.108292 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.107974 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:21.107959012 +0000 UTC m=+34.168154953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:57:05.108292 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.107993 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:21.107982498 +0000 UTC m=+34.168178439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:57:05.208481 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:05.208447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:05.208671 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.208624 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:57:05.208671 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.208643 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:57:05.208671 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.208655 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:57:05.208833 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.208714 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:21.208695213 +0000 UTC m=+34.268891154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:57:05.370960 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:05.370879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:05.370960 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:05.370897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:05.370960 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:05.370894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:05.371212 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.370999 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:05.371212 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.371053 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:05.371212 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:05.371099 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:07.374027 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:07.373993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:07.374471 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:07.374107 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:07.374471 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:07.374221 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:07.374471 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:07.374323 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:07.374471 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:07.374357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:07.374471 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:07.374425 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:09.370950 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:09.370907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:09.371504 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:09.370907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:09.371504 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:09.371051 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:09.371504 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:09.370919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:09.371504 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:09.371099 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:09.371504 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:09.371184 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:10.604212 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.603910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"5877818b43a2970995a27e007e9672d115527faeff035690bd688fbbc35326cc"} Jul 05 14:57:10.604899 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.604301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"96260a12f69768b828d959c8d2939a673ee68e5cf4e15a104424dc68329b4792"} Jul 05 14:57:10.604899 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.604349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"18a24b8a70079dfed6f3b1b574d4c8206df6f62c98fae15d53f2161456c700d6"} Jul 05 14:57:10.604899 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.604389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"6a73c820bbff25a61abe5543b8872bfbed1d7ac56696ae386c4e6d8f677d3b54"} Jul 05 14:57:10.604899 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.604441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"cb89b5bbeed2e021a49f1c77a858411a8177c36f4777126bd97b1e35feea7f08"} Jul 05 14:57:10.604899 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.604492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"4126a02b0521edbe2cb4489257df67d31791b71dd44c50c983ca7c516ceb89bd"} Jul 05 14:57:10.605182 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.605161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ckjq4" event={"ID":"2da13b87-0ce6-4976-93dc-5568774436ea","Type":"ContainerStarted","Data":"13f40ab4322bd670cffc921417698a837bc94406081f2ac08954b4077de86900"} Jul 05 14:57:10.606573 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.606547 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c59ee82-412a-471a-9c94-a4b8f04f2d82" containerID="55c5e1bc3ca8ea51f0030b1eebf2f09dc012f5cc8ebd56dfe46357d966a33a2a" exitCode=0 Jul 05 14:57:10.606670 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.606622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerDied","Data":"55c5e1bc3ca8ea51f0030b1eebf2f09dc012f5cc8ebd56dfe46357d966a33a2a"} Jul 05 14:57:10.608101 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.608073 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h6x8p" event={"ID":"78c93761-12ad-45cc-8378-54b3e1dd22a3","Type":"ContainerStarted","Data":"96da09159df7808659408c07e489cdd90419734fe140118a7e1bf43a816dae74"} Jul 05 14:57:10.609531 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.609484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" event={"ID":"cf69e56c-748f-4fa4-99b1-ecad1714df4e","Type":"ContainerStarted","Data":"d0864b499de44d012ac9b2564f93007387c3b45122c6e77112ee8d0ec7a3296e"} Jul 05 14:57:10.610726 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.610705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zczxh" event={"ID":"9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0","Type":"ContainerStarted","Data":"4bf34c3a6400ca943a56ca1c55b52c95f2007445261a3a4d682ecba14be11998"} Jul 05 14:57:10.612057 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.612035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8ft62" event={"ID":"3c0f8466-e4f0-45ac-a0ea-2a739d72b915","Type":"ContainerStarted","Data":"cf161397951b6da63b6678f94b92e9526fd147568a635794c4f159ecdf8e7747"} Jul 05 14:57:10.613493 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.613473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpgh5" event={"ID":"fd4ea5a6-0938-4704-a704-5d9a29d9abae","Type":"ContainerStarted","Data":"0bf4f9d389ffd55296f05401cd05f8e4d84344de52ad659d6bd3dd17f8399cb0"} Jul 05 14:57:10.614783 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.614765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wzxm" event={"ID":"151b0838-bc2f-4690-bafd-b8a8028d36f3","Type":"ContainerStarted","Data":"6cdc989295fa4f453a1fb0e896daddab0082f805a9fa01d2ad81f710af62b74e"} Jul 05 14:57:10.617383 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.617352 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ckjq4" podStartSLOduration=4.612707112 podStartE2EDuration="23.617342182s" totalImagesPullingTime="19.00463507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:10.617188148 +0000 UTC m=+23.677384108" watchObservedRunningTime="2026-07-05 14:57:10.617342182 +0000 UTC m=+23.677538141" Jul 05 14:57:10.617961 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.617907 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-154.ec2.internal" podStartSLOduration=22.617897394 podStartE2EDuration="22.617897394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:56:52.58828961 +0000 UTC m=+5.648485572" watchObservedRunningTime="2026-07-05 14:57:10.617897394 +0000 UTC m=+23.678093353" Jul 05 14:57:10.667333 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.667297 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h6x8p" podStartSLOduration=4.688705236 podStartE2EDuration="23.667286928s" totalImagesPullingTime="18.978581692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:10.653369623 +0000 UTC m=+23.713565583" watchObservedRunningTime="2026-07-05 14:57:10.667286928 +0000 UTC m=+23.727482887" Jul 05 14:57:10.667418 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.667360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpgh5" podStartSLOduration=4.656601356 podStartE2EDuration="23.66735619s" totalImagesPullingTime="19.010754834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:10.666953469 +0000 UTC m=+23.727149429" watchObservedRunningTime="2026-07-05 14:57:10.66735619 +0000 UTC m=+23.727552150" Jul 05 14:57:10.681129 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.681097 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zczxh" podStartSLOduration=4.671857687 podStartE2EDuration="23.681086528s" totalImagesPullingTime="19.009228841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:10.68075857 +0000 UTC m=+23.740954533" watchObservedRunningTime="2026-07-05 14:57:10.681086528 +0000 UTC m=+23.741282487" Jul 05 14:57:10.698658 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.698628 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8ft62" podStartSLOduration=4.673325863 podStartE2EDuration="23.698617944s" totalImagesPullingTime="19.025292081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:10.698327921 +0000 UTC m=+23.758523880" watchObservedRunningTime="2026-07-05 14:57:10.698617944 +0000 UTC m=+23.758813900" Jul 05 14:57:10.716095 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.716058 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6wzxm" podStartSLOduration=4.637047268 podStartE2EDuration="23.716047244s" totalImagesPullingTime="19.078999976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:10.7156644 +0000 UTC m=+23.775860360" watchObservedRunningTime="2026-07-05 14:57:10.716047244 +0000 UTC m=+23.776243201" Jul 05 14:57:10.961728 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:10.961704 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 14:57:11.338497 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.338389 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T14:57:10.961721724Z","UUID":"bc996457-962c-4a8c-a7e8-053987f878cc","Handler":null,"Name":"","Endpoint":""} Jul 05 14:57:11.340077 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.340055 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 14:57:11.340189 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.340089 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 14:57:11.370293 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.370263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:11.370442 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:11.370385 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:11.370508 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.370481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:11.370618 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:11.370578 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:11.370689 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.370662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:11.370762 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:11.370737 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:11.619995 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:11.619920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" event={"ID":"cf69e56c-748f-4fa4-99b1-ecad1714df4e","Type":"ContainerStarted","Data":"e1aebd2d5b7bae3ae1dbeb2c4d456e10bc7b5047b3b5feefcee971fbd97f1b60"} Jul 05 14:57:12.624333 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:12.624253 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" event={"ID":"cf69e56c-748f-4fa4-99b1-ecad1714df4e","Type":"ContainerStarted","Data":"bb7b8111972bcc843a88863f9d3d506cb95ace307e657ad09c6a3c47464cd294"} Jul 05 14:57:12.627978 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:12.627947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"52eee6bd5162f49a5bbc58529b5572e3026100951a80e47939953d2863753341"} Jul 05 14:57:12.645447 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:12.645395 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g82f" podStartSLOduration=4.472495081 podStartE2EDuration="25.64537759s" totalImagesPullingTime="21.172882509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:12.645318651 +0000 UTC m=+25.705514623" watchObservedRunningTime="2026-07-05 14:57:12.64537759 +0000 UTC m=+25.705573552" Jul 05 14:57:13.370516 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:13.370338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:13.370714 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:13.370337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:13.370714 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:13.370646 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:13.370714 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:13.370381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:13.370887 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:13.370728 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:13.370887 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:13.370765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:14.635507 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.634725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerStarted","Data":"78b11fefceb1c19ab3cb1dd72c2b84a7fe924adab849084fa042122cfbff3fca"} Jul 05 14:57:14.641289 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.641261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" event={"ID":"7b40bf3d-ad9c-437f-aefd-55c991a1726c","Type":"ContainerStarted","Data":"b5ff82afb6797a26f4e001b14a0815ab0a94f8a4627aec9d6cc8b476853b0ed4"} Jul 05 14:57:14.641639 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.641618 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:57:14.642049 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.641817 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:57:14.658825 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.658715 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:57:14.660266 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.660244 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:57:14.678225 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:14.678174 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" podStartSLOduration=8.5917202 podStartE2EDuration="27.67815926s" totalImagesPullingTime="19.08643906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:14.677590455 +0000 UTC m=+27.737786414" watchObservedRunningTime="2026-07-05 14:57:14.67815926 +0000 UTC m=+27.738355220" Jul 05 14:57:15.371181 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.371009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:15.371358 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.371013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:15.371358 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:15.371278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:15.371358 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.371012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:15.371513 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:15.371325 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:15.371513 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:15.371406 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:15.456409 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.456377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:57:15.456969 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.456950 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:57:15.645664 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.645520 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c59ee82-412a-471a-9c94-a4b8f04f2d82" containerID="78b11fefceb1c19ab3cb1dd72c2b84a7fe924adab849084fa042122cfbff3fca" exitCode=0 Jul 05 14:57:15.645664 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.645629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerDied","Data":"78b11fefceb1c19ab3cb1dd72c2b84a7fe924adab849084fa042122cfbff3fca"} Jul 05 14:57:15.646178 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:15.645864 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 05 14:57:16.058015 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.057983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:57:16.541771 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.541742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6x6gm"] Jul 05 14:57:16.541942 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.541875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:16.541991 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:16.541956 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:16.544615 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.544577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q5c8q"] Jul 05 14:57:16.544741 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.544696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:16.544797 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:16.544781 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:16.557709 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.557681 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssjm4"] Jul 05 14:57:16.557819 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:16.557787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:16.557891 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:16.557871 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:17.650885 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:17.650851 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c59ee82-412a-471a-9c94-a4b8f04f2d82" containerID="b7c31c8e549f4246b0599b6cca82735d2d29b823c094f1ace36a647183547869" exitCode=0 Jul 05 14:57:17.651442 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:17.650934 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerDied","Data":"b7c31c8e549f4246b0599b6cca82735d2d29b823c094f1ace36a647183547869"} Jul 05 14:57:18.370694 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:18.370662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:18.370694 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:18.370697 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:18.370868 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:18.370671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:18.370868 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:18.370784 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:18.370868 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:18.370845 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:18.370964 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:18.370898 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:18.655574 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:18.655400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerStarted","Data":"34a0e16c469b76ab45a10aeec65c6c055ab1276f4183b8932928ea6b3f1db93e"} Jul 05 14:57:19.170097 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:19.170068 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:57:19.170243 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:19.170189 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 05 14:57:19.170868 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:19.170846 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h6x8p" Jul 05 14:57:19.659918 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:19.659885 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c59ee82-412a-471a-9c94-a4b8f04f2d82" containerID="34a0e16c469b76ab45a10aeec65c6c055ab1276f4183b8932928ea6b3f1db93e" exitCode=0 Jul 05 14:57:19.660371 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:19.660005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerDied","Data":"34a0e16c469b76ab45a10aeec65c6c055ab1276f4183b8932928ea6b3f1db93e"} Jul 05 14:57:20.371000 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:20.370971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:20.371000 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:20.370992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:20.371247 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:20.370992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:20.371247 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:20.371093 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:20.371247 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:20.371203 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:20.371405 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:20.371313 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:21.133758 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:21.133727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:21.134245 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:21.133779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:21.134245 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.133881 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:57:21.134245 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.133882 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 14:57:21.134245 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.133946 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs podName:2fd29184-9ded-433b-8f51-412f90541242 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:53.133927883 +0000 UTC m=+66.194123821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs") pod "network-metrics-daemon-q5c8q" (UID: "2fd29184-9ded-433b-8f51-412f90541242") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 14:57:21.134245 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.133992 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret podName:c31a2572-862e-4711-9eba-668336d76999 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:53.13395459 +0000 UTC m=+66.194150536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret") pod "global-pull-secret-syncer-6x6gm" (UID: "c31a2572-862e-4711-9eba-668336d76999") : object "kube-system"/"original-pull-secret" not registered Jul 05 14:57:21.234769 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:21.234740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:21.234949 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.234881 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 14:57:21.234949 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.234897 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 14:57:21.234949 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.234908 2578 projected.go:196] Error preparing data for projected volume kube-api-access-ztzr9 for pod openshift-network-diagnostics/network-check-target-ssjm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:57:21.235120 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:21.234972 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9 podName:8b64cd81-14a2-485f-a9c9-1d5b0aac7e06 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:53.23495376 +0000 UTC m=+66.295149729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztzr9" (UniqueName: "kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9") pod "network-check-target-ssjm4" (UID: "8b64cd81-14a2-485f-a9c9-1d5b0aac7e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 14:57:22.370527 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:22.370493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:22.370966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:22.370610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:22.370966 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:22.370615 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ssjm4" podUID="8b64cd81-14a2-485f-a9c9-1d5b0aac7e06" Jul 05 14:57:22.370966 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:22.370735 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5c8q" podUID="2fd29184-9ded-433b-8f51-412f90541242" Jul 05 14:57:22.370966 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:22.370617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:22.370966 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:22.370844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6x6gm" podUID="c31a2572-862e-4711-9eba-668336d76999" Jul 05 14:57:23.325002 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.324931 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-154.ec2.internal" event="NodeReady" Jul 05 14:57:23.325158 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.325059 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 14:57:23.387919 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.387885 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6tlvz"] Jul 05 14:57:23.390750 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.390606 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jwn6t"] Jul 05 14:57:23.390750 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.390708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.392429 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.392400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.392823 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.392692 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 14:57:23.392823 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.392820 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 14:57:23.393044 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.393020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 14:57:23.393227 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.393210 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cj8m2\"" Jul 05 14:57:23.395815 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.395786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 14:57:23.397235 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.397066 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 14:57:23.397235 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.397157 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lzkql\"" Jul 05 14:57:23.404232 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.404209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6tlvz"] Jul 05 14:57:23.408119 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.408099 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwn6t"] Jul 05 14:57:23.553523 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.553486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08a5afac-d6ec-4cea-9040-e804f8407249-config-volume\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.553523 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.553538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9994\" (UniqueName: \"kubernetes.io/projected/d07cfc0d-4a3a-4dc1-808f-ccae597a1507-kube-api-access-g9994\") pod \"ingress-canary-6tlvz\" (UID: \"d07cfc0d-4a3a-4dc1-808f-ccae597a1507\") " pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.553776 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.553591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07cfc0d-4a3a-4dc1-808f-ccae597a1507-cert\") pod \"ingress-canary-6tlvz\" (UID: \"d07cfc0d-4a3a-4dc1-808f-ccae597a1507\") " pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.553776 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.553633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a5afac-d6ec-4cea-9040-e804f8407249-tmp-dir\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.553776 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.553678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzgpf\" (UniqueName: \"kubernetes.io/projected/08a5afac-d6ec-4cea-9040-e804f8407249-kube-api-access-qzgpf\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.553776 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.553718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.654375 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgpf\" (UniqueName: \"kubernetes.io/projected/08a5afac-d6ec-4cea-9040-e804f8407249-kube-api-access-qzgpf\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.654375 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.654577 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08a5afac-d6ec-4cea-9040-e804f8407249-config-volume\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.654577 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9994\" (UniqueName: \"kubernetes.io/projected/d07cfc0d-4a3a-4dc1-808f-ccae597a1507-kube-api-access-g9994\") pod \"ingress-canary-6tlvz\" (UID: \"d07cfc0d-4a3a-4dc1-808f-ccae597a1507\") " pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.654577 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07cfc0d-4a3a-4dc1-808f-ccae597a1507-cert\") pod \"ingress-canary-6tlvz\" (UID: \"d07cfc0d-4a3a-4dc1-808f-ccae597a1507\") " pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.654577 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a5afac-d6ec-4cea-9040-e804f8407249-tmp-dir\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.654577 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:23.654511 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 14:57:23.654827 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:23.654583 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls podName:08a5afac-d6ec-4cea-9040-e804f8407249 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:24.154562334 +0000 UTC m=+37.214758272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls") pod "dns-default-jwn6t" (UID: "08a5afac-d6ec-4cea-9040-e804f8407249") : secret "dns-default-metrics-tls" not found Jul 05 14:57:23.654881 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.654846 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08a5afac-d6ec-4cea-9040-e804f8407249-tmp-dir\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.655088 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.655066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08a5afac-d6ec-4cea-9040-e804f8407249-config-volume\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.658636 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.658617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07cfc0d-4a3a-4dc1-808f-ccae597a1507-cert\") pod \"ingress-canary-6tlvz\" (UID: \"d07cfc0d-4a3a-4dc1-808f-ccae597a1507\") " pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.662996 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.662977 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9994\" (UniqueName: \"kubernetes.io/projected/d07cfc0d-4a3a-4dc1-808f-ccae597a1507-kube-api-access-g9994\") pod \"ingress-canary-6tlvz\" (UID: \"d07cfc0d-4a3a-4dc1-808f-ccae597a1507\") " pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.663115 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.663093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzgpf\" (UniqueName: \"kubernetes.io/projected/08a5afac-d6ec-4cea-9040-e804f8407249-kube-api-access-qzgpf\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:23.705199 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.705177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6tlvz" Jul 05 14:57:23.856831 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:23.856651 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6tlvz"] Jul 05 14:57:23.862062 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:23.862024 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07cfc0d_4a3a_4dc1_808f_ccae597a1507.slice/crio-a7a2f36df40a74451d34516d47dc45989957b0fae6a80afde4568b2e38efb9d7 WatchSource:0}: Error finding container a7a2f36df40a74451d34516d47dc45989957b0fae6a80afde4568b2e38efb9d7: Status 404 returned error can't find the container with id a7a2f36df40a74451d34516d47dc45989957b0fae6a80afde4568b2e38efb9d7 Jul 05 14:57:24.158718 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.158685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:24.158873 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:24.158839 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 14:57:24.158949 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:24.158905 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls podName:08a5afac-d6ec-4cea-9040-e804f8407249 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:25.158886794 +0000 UTC m=+38.219082749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls") pod "dns-default-jwn6t" (UID: "08a5afac-d6ec-4cea-9040-e804f8407249") : secret "dns-default-metrics-tls" not found Jul 05 14:57:24.370393 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.370357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:24.370393 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.370379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:24.370625 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.370379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:24.374242 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.374210 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 14:57:24.374842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.374441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zjbzw\"" Jul 05 14:57:24.374842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.374471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 14:57:24.374842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.374707 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 14:57:24.374842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.374712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bncht\"" Jul 05 14:57:24.374842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.374801 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 14:57:24.588373 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.588293 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7skl6"] Jul 05 14:57:24.591424 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.591399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.594025 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.593985 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 14:57:24.594025 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.593990 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 14:57:24.594214 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.594045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hn64k\"" Jul 05 14:57:24.594294 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.594277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 14:57:24.594435 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.594419 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 14:57:24.603761 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.603742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7skl6"] Jul 05 14:57:24.672366 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.672333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6tlvz" event={"ID":"d07cfc0d-4a3a-4dc1-808f-ccae597a1507","Type":"ContainerStarted","Data":"a7a2f36df40a74451d34516d47dc45989957b0fae6a80afde4568b2e38efb9d7"} Jul 05 14:57:24.675375 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.675351 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c59ee82-412a-471a-9c94-a4b8f04f2d82" containerID="5e0b14a0e96f47becfed567a70c12876aaa9a9a112f44d98859d5f1b25c35f5f" exitCode=0 Jul 05 14:57:24.675472 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.675402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerDied","Data":"5e0b14a0e96f47becfed567a70c12876aaa9a9a112f44d98859d5f1b25c35f5f"} Jul 05 14:57:24.748835 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.748807 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h"] Jul 05 14:57:24.752740 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.752715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" Jul 05 14:57:24.755001 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.754842 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qcvq6\"" Jul 05 14:57:24.755001 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.754854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 05 14:57:24.755324 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.755304 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 05 14:57:24.762074 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.762042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h"] Jul 05 14:57:24.762324 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.762287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/348e2aef-aa27-47c2-bc22-7fd980a362fc-crio-socket\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.762324 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.762311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.762587 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.762406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/348e2aef-aa27-47c2-bc22-7fd980a362fc-data-volume\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.762743 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.762721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.762807 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.762758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkdnf\" (UniqueName: \"kubernetes.io/projected/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-api-access-dkdnf\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863481 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/348e2aef-aa27-47c2-bc22-7fd980a362fc-data-volume\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863634 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863634 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkdnf\" (UniqueName: \"kubernetes.io/projected/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-api-access-dkdnf\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863634 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5zq\" (UniqueName: \"kubernetes.io/projected/e6de0c33-d057-4e0f-9e2c-c536965f1897-kube-api-access-qs5zq\") pod \"migrator-d57d58cc9-qjm4h\" (UID: \"e6de0c33-d057-4e0f-9e2c-c536965f1897\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" Jul 05 14:57:24.863634 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/348e2aef-aa27-47c2-bc22-7fd980a362fc-crio-socket\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863831 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863831 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:24.863665 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 14:57:24.863831 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:24.863750 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:25.363726017 +0000 UTC m=+38.423921955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : secret "insights-runtime-extractor-tls" not found Jul 05 14:57:24.863831 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:24.863750 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 14:57:24.863831 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863786 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/348e2aef-aa27-47c2-bc22-7fd980a362fc-data-volume\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.863831 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:24.863800 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:25.363789604 +0000 UTC m=+38.423985544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : configmap "kube-rbac-proxy" not found Jul 05 14:57:24.864085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.863945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/348e2aef-aa27-47c2-bc22-7fd980a362fc-crio-socket\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.873504 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.873482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkdnf\" (UniqueName: \"kubernetes.io/projected/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-api-access-dkdnf\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:24.964328 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.964293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5zq\" (UniqueName: \"kubernetes.io/projected/e6de0c33-d057-4e0f-9e2c-c536965f1897-kube-api-access-qs5zq\") pod \"migrator-d57d58cc9-qjm4h\" (UID: \"e6de0c33-d057-4e0f-9e2c-c536965f1897\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" Jul 05 14:57:24.972482 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:24.972453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5zq\" (UniqueName: \"kubernetes.io/projected/e6de0c33-d057-4e0f-9e2c-c536965f1897-kube-api-access-qs5zq\") pod \"migrator-d57d58cc9-qjm4h\" (UID: \"e6de0c33-d057-4e0f-9e2c-c536965f1897\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" Jul 05 14:57:25.076945 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.076905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" Jul 05 14:57:25.168098 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.168071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:25.168251 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:25.168230 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 14:57:25.168315 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:25.168298 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls podName:08a5afac-d6ec-4cea-9040-e804f8407249 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:27.168280737 +0000 UTC m=+40.228476674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls") pod "dns-default-jwn6t" (UID: "08a5afac-d6ec-4cea-9040-e804f8407249") : secret "dns-default-metrics-tls" not found Jul 05 14:57:25.214939 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.213996 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h"] Jul 05 14:57:25.369687 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.369646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:25.369869 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.369724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:25.369869 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:25.369798 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 14:57:25.369869 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:25.369801 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 14:57:25.369869 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:25.369864 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:26.36984248 +0000 UTC m=+39.430038470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : configmap "kube-rbac-proxy" not found Jul 05 14:57:25.370086 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:25.369879 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:26.369872544 +0000 UTC m=+39.430068482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : secret "insights-runtime-extractor-tls" not found Jul 05 14:57:25.681691 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.681656 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c59ee82-412a-471a-9c94-a4b8f04f2d82" containerID="0cfea47837359f1ad4906d49c6c9de0505cc3602f19f2cbd2c894c346f9a53e0" exitCode=0 Jul 05 14:57:25.682115 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:25.681730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerDied","Data":"0cfea47837359f1ad4906d49c6c9de0505cc3602f19f2cbd2c894c346f9a53e0"} Jul 05 14:57:25.979704 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:25.979627 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6de0c33_d057_4e0f_9e2c_c536965f1897.slice/crio-d9e74a794cc4dc72afb01aa7e3dd7d9b5f326d55d3e948d297f9844d422b375d WatchSource:0}: Error finding container d9e74a794cc4dc72afb01aa7e3dd7d9b5f326d55d3e948d297f9844d422b375d: Status 404 returned error can't find the container with id d9e74a794cc4dc72afb01aa7e3dd7d9b5f326d55d3e948d297f9844d422b375d Jul 05 14:57:26.378581 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.378545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:26.378759 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.378660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:26.378759 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:26.378676 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 14:57:26.378759 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:26.378748 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:28.378730236 +0000 UTC m=+41.438926177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : configmap "kube-rbac-proxy" not found Jul 05 14:57:26.378928 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:26.378776 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 14:57:26.378928 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:26.378829 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:28.37881273 +0000 UTC m=+41.439008671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : secret "insights-runtime-extractor-tls" not found Jul 05 14:57:26.685913 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.685857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6tlvz" event={"ID":"d07cfc0d-4a3a-4dc1-808f-ccae597a1507","Type":"ContainerStarted","Data":"5c2ecc0442ad64215282b4938345a278c0fef430b056ec49bcc3891b7c0e694a"} Jul 05 14:57:26.687394 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.687358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" event={"ID":"e6de0c33-d057-4e0f-9e2c-c536965f1897","Type":"ContainerStarted","Data":"d9e74a794cc4dc72afb01aa7e3dd7d9b5f326d55d3e948d297f9844d422b375d"} Jul 05 14:57:26.692623 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.691112 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" event={"ID":"4c59ee82-412a-471a-9c94-a4b8f04f2d82","Type":"ContainerStarted","Data":"19053801c274fde99935ca5fa09298737b40e0a0f7f5bcefd84e971edc66b856"} Jul 05 14:57:26.705031 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.704971 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6tlvz" podStartSLOduration=1.434216865 podStartE2EDuration="3.704944048s" totalImagesPullingTime="2.270727183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:26.704643163 +0000 UTC m=+39.764839124" watchObservedRunningTime="2026-07-05 14:57:26.704944048 +0000 UTC m=+39.765146512" Jul 05 14:57:26.731151 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.731100 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f6qq4" podStartSLOduration=10.969192127 podStartE2EDuration="39.731083692s" totalImagesPullingTime="28.761891565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:26.729546233 +0000 UTC m=+39.789742197" watchObservedRunningTime="2026-07-05 14:57:26.731083692 +0000 UTC m=+39.791279651" Jul 05 14:57:26.759502 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:26.759472 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpgh5_fd4ea5a6-0938-4704-a704-5d9a29d9abae/dns-node-resolver/0.log" Jul 05 14:57:27.186839 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:27.186806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:27.186993 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:27.186962 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 14:57:27.187029 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:27.187025 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls podName:08a5afac-d6ec-4cea-9040-e804f8407249 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:31.187009886 +0000 UTC m=+44.247205824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls") pod "dns-default-jwn6t" (UID: "08a5afac-d6ec-4cea-9040-e804f8407249") : secret "dns-default-metrics-tls" not found Jul 05 14:57:27.694708 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:27.694675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" event={"ID":"e6de0c33-d057-4e0f-9e2c-c536965f1897","Type":"ContainerStarted","Data":"ebf2332a0e46971f1e5ed43a90657a63b5baab5a0b1e0b56e71ce0fe7fd7882d"} Jul 05 14:57:27.759283 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:27.759259 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zczxh_9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0/node-ca/0.log" Jul 05 14:57:28.159892 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:28.159863 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tlvz_d07cfc0d-4a3a-4dc1-808f-ccae597a1507/serve-healthcheck-canary/0.log" Jul 05 14:57:28.397283 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:28.397239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:28.397454 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:28.397316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:28.397454 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:28.397387 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 14:57:28.397454 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:28.397424 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 14:57:28.397677 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:28.397470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:32.397447963 +0000 UTC m=+45.457643917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : configmap "kube-rbac-proxy" not found Jul 05 14:57:28.397677 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:28.397492 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:32.397482309 +0000 UTC m=+45.457678249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : secret "insights-runtime-extractor-tls" not found Jul 05 14:57:28.698487 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:28.698451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" event={"ID":"e6de0c33-d057-4e0f-9e2c-c536965f1897","Type":"ContainerStarted","Data":"2a5780da379688a3d1e3d54131b6c11e6cc9ab88fe2fb538971c8730adf81a7a"} Jul 05 14:57:28.714092 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:28.714047 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qjm4h" podStartSLOduration=3.142163791 podStartE2EDuration="4.714029256s" totalImagesPullingTime="1.571865465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:28.713634915 +0000 UTC m=+41.773830866" watchObservedRunningTime="2026-07-05 14:57:28.714029256 +0000 UTC m=+41.774225217" Jul 05 14:57:31.214725 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:31.214683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:31.215197 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:31.214868 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 14:57:31.215197 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:31.214949 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls podName:08a5afac-d6ec-4cea-9040-e804f8407249 nodeName:}" failed. No retries permitted until 2026-07-05 14:57:39.214928102 +0000 UTC m=+52.275124051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls") pod "dns-default-jwn6t" (UID: "08a5afac-d6ec-4cea-9040-e804f8407249") : secret "dns-default-metrics-tls" not found Jul 05 14:57:32.424292 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:32.424254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:32.424721 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:32.424323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:32.424721 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:32.424374 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 14:57:32.424721 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:32.424418 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 14:57:32.424721 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:32.424445 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:40.424430189 +0000 UTC m=+53.484626126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : configmap "kube-rbac-proxy" not found Jul 05 14:57:32.424721 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:32.424462 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:40.424451573 +0000 UTC m=+53.484647511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : secret "insights-runtime-extractor-tls" not found Jul 05 14:57:39.275570 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:39.275537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:39.278719 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:39.278696 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08a5afac-d6ec-4cea-9040-e804f8407249-metrics-tls\") pod \"dns-default-jwn6t\" (UID: \"08a5afac-d6ec-4cea-9040-e804f8407249\") " pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:39.310836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:39.310809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:39.468455 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:39.468425 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jwn6t"] Jul 05 14:57:39.471024 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:39.470996 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a5afac_d6ec_4cea_9040_e804f8407249.slice/crio-fe3ad37e05e80848f0a7c5ca43aae47f3e0862a8069ae7acc093a71c2114472f WatchSource:0}: Error finding container fe3ad37e05e80848f0a7c5ca43aae47f3e0862a8069ae7acc093a71c2114472f: Status 404 returned error can't find the container with id fe3ad37e05e80848f0a7c5ca43aae47f3e0862a8069ae7acc093a71c2114472f Jul 05 14:57:39.725827 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:39.725789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwn6t" event={"ID":"08a5afac-d6ec-4cea-9040-e804f8407249","Type":"ContainerStarted","Data":"fe3ad37e05e80848f0a7c5ca43aae47f3e0862a8069ae7acc093a71c2114472f"} Jul 05 14:57:40.485343 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:40.485300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:40.485775 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:40.485416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:40.485775 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:40.485559 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 14:57:40.485775 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:57:40.485640 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls podName:348e2aef-aa27-47c2-bc22-7fd980a362fc nodeName:}" failed. No retries permitted until 2026-07-05 14:57:56.485618371 +0000 UTC m=+69.545814333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7skl6" (UID: "348e2aef-aa27-47c2-bc22-7fd980a362fc") : secret "insights-runtime-extractor-tls" not found Jul 05 14:57:40.486003 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:40.485976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/348e2aef-aa27-47c2-bc22-7fd980a362fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:41.731841 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:41.731804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwn6t" event={"ID":"08a5afac-d6ec-4cea-9040-e804f8407249","Type":"ContainerStarted","Data":"8412dd37824a16ea2174d4cab599c8d7d14d30327fcbe836b368d763e29dcdf5"} Jul 05 14:57:42.735805 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:42.735765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jwn6t" event={"ID":"08a5afac-d6ec-4cea-9040-e804f8407249","Type":"ContainerStarted","Data":"a43d25dcd78f63e9834bc7470a241a4542c4130f48677e284dd113dd7f628a61"} Jul 05 14:57:42.736166 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:42.735827 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:42.752445 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:42.752382 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jwn6t" podStartSLOduration=17.706979544 podStartE2EDuration="19.752363518s" totalImagesPullingTime="2.045383974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:42.751642141 +0000 UTC m=+55.811838101" watchObservedRunningTime="2026-07-05 14:57:42.752363518 +0000 UTC m=+55.812559474" Jul 05 14:57:47.272003 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.271974 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs"] Jul 05 14:57:47.277913 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.277891 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv"] Jul 05 14:57:47.278040 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.278003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.280097 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280074 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 14:57:47.280196 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 05 14:57:47.280422 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280399 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 14:57:47.280532 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 14:57:47.280712 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280693 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl"] Jul 05 14:57:47.280789 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280719 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-msp4q\"" Jul 05 14:57:47.280842 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.280791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.283543 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.283526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.284286 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.284267 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 05 14:57:47.285475 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.285453 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 05 14:57:47.285581 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.285474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 05 14:57:47.285581 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.285497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 05 14:57:47.285581 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.285560 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 05 14:57:47.290288 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.290268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv"] Jul 05 14:57:47.291347 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.291326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs"] Jul 05 14:57:47.294146 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.292365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl"] Jul 05 14:57:47.335506 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fd25974-ca19-4be5-bec6-76f1737cbd9f-klusterlet-config\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.335633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjsh7\" (UniqueName: \"kubernetes.io/projected/8fd25974-ca19-4be5-bec6-76f1737cbd9f-kube-api-access-mjsh7\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.335633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-ca\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.335633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-hub\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.335633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnjts\" (UniqueName: \"kubernetes.io/projected/08dedbc0-35d2-4dbb-b08c-2677a3f382b1-kube-api-access-jnjts\") pod \"managed-serviceaccount-addon-agent-6bf489d94d-2skcs\" (UID: \"08dedbc0-35d2-4dbb-b08c-2677a3f382b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.335765 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqb4q\" (UniqueName: \"kubernetes.io/projected/2fc4b66e-cb86-4998-9648-3b93358fdc08-kube-api-access-cqb4q\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.335765 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd25974-ca19-4be5-bec6-76f1737cbd9f-tmp\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.335765 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.335854 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08dedbc0-35d2-4dbb-b08c-2677a3f382b1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bf489d94d-2skcs\" (UID: \"08dedbc0-35d2-4dbb-b08c-2677a3f382b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.335854 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc4b66e-cb86-4998-9648-3b93358fdc08-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.335854 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.335847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.436261 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd25974-ca19-4be5-bec6-76f1737cbd9f-tmp\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.436261 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.436423 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08dedbc0-35d2-4dbb-b08c-2677a3f382b1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bf489d94d-2skcs\" (UID: \"08dedbc0-35d2-4dbb-b08c-2677a3f382b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.436494 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc4b66e-cb86-4998-9648-3b93358fdc08-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.436543 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.436651 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fd25974-ca19-4be5-bec6-76f1737cbd9f-klusterlet-config\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.436720 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjsh7\" (UniqueName: \"kubernetes.io/projected/8fd25974-ca19-4be5-bec6-76f1737cbd9f-kube-api-access-mjsh7\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.436720 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-ca\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.436720 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fd25974-ca19-4be5-bec6-76f1737cbd9f-tmp\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.436949 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.436922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-hub\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.437078 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.437061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnjts\" (UniqueName: \"kubernetes.io/projected/08dedbc0-35d2-4dbb-b08c-2677a3f382b1-kube-api-access-jnjts\") pod \"managed-serviceaccount-addon-agent-6bf489d94d-2skcs\" (UID: \"08dedbc0-35d2-4dbb-b08c-2677a3f382b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.437358 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.437343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqb4q\" (UniqueName: \"kubernetes.io/projected/2fc4b66e-cb86-4998-9648-3b93358fdc08-kube-api-access-cqb4q\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.437652 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.437216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fc4b66e-cb86-4998-9648-3b93358fdc08-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.439314 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.439289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fd25974-ca19-4be5-bec6-76f1737cbd9f-klusterlet-config\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.439487 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.439469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.439548 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.439520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-ca\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.439661 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.439640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08dedbc0-35d2-4dbb-b08c-2677a3f382b1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bf489d94d-2skcs\" (UID: \"08dedbc0-35d2-4dbb-b08c-2677a3f382b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.439722 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.439649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.439847 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.439833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2fc4b66e-cb86-4998-9648-3b93358fdc08-hub\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.444802 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.444781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjsh7\" (UniqueName: \"kubernetes.io/projected/8fd25974-ca19-4be5-bec6-76f1737cbd9f-kube-api-access-mjsh7\") pod \"klusterlet-addon-workmgr-68ddd8f69f-wqlwv\" (UID: \"8fd25974-ca19-4be5-bec6-76f1737cbd9f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.446339 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.446317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqb4q\" (UniqueName: \"kubernetes.io/projected/2fc4b66e-cb86-4998-9648-3b93358fdc08-kube-api-access-cqb4q\") pod \"cluster-proxy-proxy-agent-56cd9fd8cb-smgnl\" (UID: \"2fc4b66e-cb86-4998-9648-3b93358fdc08\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.447154 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.447133 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnjts\" (UniqueName: \"kubernetes.io/projected/08dedbc0-35d2-4dbb-b08c-2677a3f382b1-kube-api-access-jnjts\") pod \"managed-serviceaccount-addon-agent-6bf489d94d-2skcs\" (UID: \"08dedbc0-35d2-4dbb-b08c-2677a3f382b1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.595132 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.595081 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" Jul 05 14:57:47.602245 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.602226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:47.607386 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.607371 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" Jul 05 14:57:47.667085 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.667056 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfhn6" Jul 05 14:57:47.767181 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.767150 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs"] Jul 05 14:57:47.774790 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:47.774751 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08dedbc0_35d2_4dbb_b08c_2677a3f382b1.slice/crio-b5091df48b882811fd66f78ec133bd47b81048014bf4dedc6c6c10fe3151ee99 WatchSource:0}: Error finding container b5091df48b882811fd66f78ec133bd47b81048014bf4dedc6c6c10fe3151ee99: Status 404 returned error can't find the container with id b5091df48b882811fd66f78ec133bd47b81048014bf4dedc6c6c10fe3151ee99 Jul 05 14:57:47.790624 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.790576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv"] Jul 05 14:57:47.793087 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:47.793059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd25974_ca19_4be5_bec6_76f1737cbd9f.slice/crio-df741df26efdda0980f219585d566483b77b171730103dfd58bc05668538eca6 WatchSource:0}: Error finding container df741df26efdda0980f219585d566483b77b171730103dfd58bc05668538eca6: Status 404 returned error can't find the container with id df741df26efdda0980f219585d566483b77b171730103dfd58bc05668538eca6 Jul 05 14:57:47.818798 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:47.818768 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl"] Jul 05 14:57:47.821742 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:47.821717 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fc4b66e_cb86_4998_9648_3b93358fdc08.slice/crio-722db9889f8a2251d2df07f6f182486420efd910528035d6558e131fe2a86638 WatchSource:0}: Error finding container 722db9889f8a2251d2df07f6f182486420efd910528035d6558e131fe2a86638: Status 404 returned error can't find the container with id 722db9889f8a2251d2df07f6f182486420efd910528035d6558e131fe2a86638 Jul 05 14:57:48.754049 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:48.754008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" event={"ID":"8fd25974-ca19-4be5-bec6-76f1737cbd9f","Type":"ContainerStarted","Data":"df741df26efdda0980f219585d566483b77b171730103dfd58bc05668538eca6"} Jul 05 14:57:48.755528 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:48.755461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" event={"ID":"2fc4b66e-cb86-4998-9648-3b93358fdc08","Type":"ContainerStarted","Data":"722db9889f8a2251d2df07f6f182486420efd910528035d6558e131fe2a86638"} Jul 05 14:57:48.756984 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:48.756932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" event={"ID":"08dedbc0-35d2-4dbb-b08c-2677a3f382b1","Type":"ContainerStarted","Data":"b5091df48b882811fd66f78ec133bd47b81048014bf4dedc6c6c10fe3151ee99"} Jul 05 14:57:52.741352 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:52.741324 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jwn6t" Jul 05 14:57:53.185340 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.185297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:53.185527 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.185405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:53.187863 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.187835 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 14:57:53.188005 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.187844 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 14:57:53.198374 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.198345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c31a2572-862e-4711-9eba-668336d76999-original-pull-secret\") pod \"global-pull-secret-syncer-6x6gm\" (UID: \"c31a2572-862e-4711-9eba-668336d76999\") " pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:53.198374 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.198366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd29184-9ded-433b-8f51-412f90541242-metrics-certs\") pod \"network-metrics-daemon-q5c8q\" (UID: \"2fd29184-9ded-433b-8f51-412f90541242\") " pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:53.286089 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.286049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:53.288555 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.288530 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 14:57:53.299177 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.299153 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 14:57:53.310532 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.310509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztzr9\" (UniqueName: \"kubernetes.io/projected/8b64cd81-14a2-485f-a9c9-1d5b0aac7e06-kube-api-access-ztzr9\") pod \"network-check-target-ssjm4\" (UID: \"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06\") " pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:53.487044 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.486967 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zjbzw\"" Jul 05 14:57:53.491904 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.491880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6x6gm" Jul 05 14:57:53.495031 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.495008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:53.500048 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.500029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bncht\"" Jul 05 14:57:53.508656 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.508638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5c8q" Jul 05 14:57:53.778144 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.777616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" event={"ID":"08dedbc0-35d2-4dbb-b08c-2677a3f382b1","Type":"ContainerStarted","Data":"fc92709df9fe25694d0d8cd16f7cce9af164cdac2368481e322cbeecc46b912f"} Jul 05 14:57:53.780957 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.780795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" event={"ID":"8fd25974-ca19-4be5-bec6-76f1737cbd9f","Type":"ContainerStarted","Data":"d90a62d980c6c9c0a9a8d37ea6f278b5d527d94dc2786d27958e3b5da5f7493d"} Jul 05 14:57:53.781274 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.781220 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:53.782508 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.782091 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" podUID="8fd25974-ca19-4be5-bec6-76f1737cbd9f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.11:8000/readyz\": dial tcp 10.134.0.11:8000: connect: connection refused" Jul 05 14:57:53.783647 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.783237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" event={"ID":"2fc4b66e-cb86-4998-9648-3b93358fdc08","Type":"ContainerStarted","Data":"53d6864884737f6e75b010804fc9b2cad75781999343dbd368bcc9cdc63ef55e"} Jul 05 14:57:53.792675 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.792371 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bf489d94d-2skcs" podStartSLOduration=0.919431031 podStartE2EDuration="6.792352257s" totalImagesPullingTime="5.872921226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:53.791007981 +0000 UTC m=+66.851203942" watchObservedRunningTime="2026-07-05 14:57:53.792352257 +0000 UTC m=+66.852548220" Jul 05 14:57:53.815819 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.815319 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" podStartSLOduration=0.935060317 podStartE2EDuration="6.815295591s" totalImagesPullingTime="5.880235274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:53.814711576 +0000 UTC m=+66.874907541" watchObservedRunningTime="2026-07-05 14:57:53.815295591 +0000 UTC m=+66.875491555" Jul 05 14:57:53.822547 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.821534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6x6gm"] Jul 05 14:57:53.846412 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.846379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ssjm4"] Jul 05 14:57:53.849919 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:53.849879 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b64cd81_14a2_485f_a9c9_1d5b0aac7e06.slice/crio-ebf77317b27a5c8ce0adf717946942480d9aa221c19241dd6ab4eb37d5420adf WatchSource:0}: Error finding container ebf77317b27a5c8ce0adf717946942480d9aa221c19241dd6ab4eb37d5420adf: Status 404 returned error can't find the container with id ebf77317b27a5c8ce0adf717946942480d9aa221c19241dd6ab4eb37d5420adf Jul 05 14:57:53.866531 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:53.866470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q5c8q"] Jul 05 14:57:53.870684 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:53.870655 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd29184_9ded_433b_8f51_412f90541242.slice/crio-a4e702b7e4703ebd20d718cd7dfc615a0b46cf16322381cc93e37e1b18db5de6 WatchSource:0}: Error finding container a4e702b7e4703ebd20d718cd7dfc615a0b46cf16322381cc93e37e1b18db5de6: Status 404 returned error can't find the container with id a4e702b7e4703ebd20d718cd7dfc615a0b46cf16322381cc93e37e1b18db5de6 Jul 05 14:57:54.790881 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.790789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" event={"ID":"2fc4b66e-cb86-4998-9648-3b93358fdc08","Type":"ContainerStarted","Data":"2dac999636d35131cd4eee6010a8d9592a1ca0b0d848b59261b9a30d467ee07e"} Jul 05 14:57:54.790881 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.790851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" event={"ID":"2fc4b66e-cb86-4998-9648-3b93358fdc08","Type":"ContainerStarted","Data":"ccc9f351a8825b7e59535e8fc118ff18007d981d3d6eb915a7182cc15ae1dcd8"} Jul 05 14:57:54.793136 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.793107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5c8q" event={"ID":"2fd29184-9ded-433b-8f51-412f90541242","Type":"ContainerStarted","Data":"a4e702b7e4703ebd20d718cd7dfc615a0b46cf16322381cc93e37e1b18db5de6"} Jul 05 14:57:54.799081 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.796861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6x6gm" event={"ID":"c31a2572-862e-4711-9eba-668336d76999","Type":"ContainerStarted","Data":"1fcf7d777d3a1ae3ff9aebf0daddf77e452d131511e350d81deda9b215ce8130"} Jul 05 14:57:54.800775 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.800691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssjm4" event={"ID":"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06","Type":"ContainerStarted","Data":"ebf77317b27a5c8ce0adf717946942480d9aa221c19241dd6ab4eb37d5420adf"} Jul 05 14:57:54.802239 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.802219 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68ddd8f69f-wqlwv" Jul 05 14:57:54.810399 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:54.810355 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cd9fd8cb-smgnl" podStartSLOduration=1.974598415 podStartE2EDuration="7.810338764s" totalImagesPullingTime="5.835740349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:54.808908524 +0000 UTC m=+67.869104497" watchObservedRunningTime="2026-07-05 14:57:54.810338764 +0000 UTC m=+67.870534727" Jul 05 14:57:55.808334 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:55.807632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5c8q" event={"ID":"2fd29184-9ded-433b-8f51-412f90541242","Type":"ContainerStarted","Data":"094663205ca549154e7aca7cca135d3bdc22c40ce3c129251b3b657433dac6ed"} Jul 05 14:57:55.808334 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:55.807700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5c8q" event={"ID":"2fd29184-9ded-433b-8f51-412f90541242","Type":"ContainerStarted","Data":"663ba7124095932a3ac3b5e76cf58e20083d1cb3fd538b38e084023f25176469"} Jul 05 14:57:55.823835 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:55.823741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q5c8q" podStartSLOduration=67.402080515 podStartE2EDuration="1m8.823724502s" totalImagesPullingTime="1.421643987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:55.821894012 +0000 UTC m=+68.882089976" watchObservedRunningTime="2026-07-05 14:57:55.823724502 +0000 UTC m=+68.883920463" Jul 05 14:57:56.511374 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:56.511323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:56.514126 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:56.514102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/348e2aef-aa27-47c2-bc22-7fd980a362fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7skl6\" (UID: \"348e2aef-aa27-47c2-bc22-7fd980a362fc\") " pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:56.704115 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:56.704077 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hn64k\"" Jul 05 14:57:56.712904 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:56.712876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7skl6" Jul 05 14:57:58.820778 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:58.820737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ssjm4" event={"ID":"8b64cd81-14a2-485f-a9c9-1d5b0aac7e06","Type":"ContainerStarted","Data":"4e2822d85ef1e58e76550716f87a79861d2f4ff8fa9c11180fb601216d216dc2"} Jul 05 14:57:58.821188 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:58.820922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 14:57:58.834757 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:58.834707 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ssjm4" podStartSLOduration=66.957120295 podStartE2EDuration="1m11.83468504s" totalImagesPullingTime="4.877564745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:58.834443478 +0000 UTC m=+71.894639443" watchObservedRunningTime="2026-07-05 14:57:58.83468504 +0000 UTC m=+71.894881001" Jul 05 14:57:58.861042 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:58.860970 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7skl6"] Jul 05 14:57:58.862914 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:57:58.862892 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348e2aef_aa27_47c2_bc22_7fd980a362fc.slice/crio-a5fa87c291968f34aa825452adc546d76d7571e6027cc9c637a7200f402982d2 WatchSource:0}: Error finding container a5fa87c291968f34aa825452adc546d76d7571e6027cc9c637a7200f402982d2: Status 404 returned error can't find the container with id a5fa87c291968f34aa825452adc546d76d7571e6027cc9c637a7200f402982d2 Jul 05 14:57:59.825749 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:59.825708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6x6gm" event={"ID":"c31a2572-862e-4711-9eba-668336d76999","Type":"ContainerStarted","Data":"6d88448c26fae9d55b7984d1537a3268f3d353915d10424f5336a62fd0e9d59d"} Jul 05 14:57:59.827265 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:59.827237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7skl6" event={"ID":"348e2aef-aa27-47c2-bc22-7fd980a362fc","Type":"ContainerStarted","Data":"a5fa87c291968f34aa825452adc546d76d7571e6027cc9c637a7200f402982d2"} Jul 05 14:57:59.840003 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:57:59.839947 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6x6gm" podStartSLOduration=67.928507547 podStartE2EDuration="1m12.839932523s" totalImagesPullingTime="4.911424976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:57:59.839383737 +0000 UTC m=+72.899579700" watchObservedRunningTime="2026-07-05 14:57:59.839932523 +0000 UTC m=+72.900128497" Jul 05 14:58:02.838088 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:02.838006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7skl6" event={"ID":"348e2aef-aa27-47c2-bc22-7fd980a362fc","Type":"ContainerStarted","Data":"e0737ddb71d0fa6749f4154a0bd9b1391d7178bf165eb7895ef358a11b70f280"} Jul 05 14:58:03.843917 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:03.843882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7skl6" event={"ID":"348e2aef-aa27-47c2-bc22-7fd980a362fc","Type":"ContainerStarted","Data":"a656920faa4966f506604c8ca4641cd2ef36a279ce7603bc01567ac173e8b987"} Jul 05 14:58:05.852529 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:05.852432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7skl6" event={"ID":"348e2aef-aa27-47c2-bc22-7fd980a362fc","Type":"ContainerStarted","Data":"47166abdce865fe919a145d4ea8d82c83951af98366b7603d1d8a1ef040fe8c3"} Jul 05 14:58:05.869704 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:05.869647 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7skl6" podStartSLOduration=35.262446787 podStartE2EDuration="41.869625604s" totalImagesPullingTime="6.607178817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:57:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:58:05.868247895 +0000 UTC m=+78.928443856" watchObservedRunningTime="2026-07-05 14:58:05.869625604 +0000 UTC m=+78.929821565" Jul 05 14:58:12.013300 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.013168 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4vd2w"] Jul 05 14:58:12.017512 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.017496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.019670 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.019586 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 14:58:12.019670 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.019656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 14:58:12.020240 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.020213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 14:58:12.020355 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.020228 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 14:58:12.020355 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.020260 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vcrmt\"" Jul 05 14:58:12.020355 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.020275 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 14:58:12.020355 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.020253 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 14:58:12.129480 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-tls\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129590 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-wtmp\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129590 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-textfile\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129590 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129590 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp88m\" (UniqueName: \"kubernetes.io/projected/3e0f297c-682f-41c8-973e-5febc26c10d4-kube-api-access-rp88m\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129786 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-root\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129786 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e0f297c-682f-41c8-973e-5febc26c10d4-metrics-client-ca\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129786 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.129786 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.129750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-sys\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230509 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-wtmp\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-textfile\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp88m\" (UniqueName: \"kubernetes.io/projected/3e0f297c-682f-41c8-973e-5febc26c10d4-kube-api-access-rp88m\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230633 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-root\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e0f297c-682f-41c8-973e-5febc26c10d4-metrics-client-ca\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-sys\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230689 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-wtmp\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-tls\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-sys\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.230836 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:58:12.230807 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 05 14:58:12.231106 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e0f297c-682f-41c8-973e-5febc26c10d4-root\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.231106 ip-10-0-128-154 kubenswrapper[2578]: E0705 14:58:12.230885 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-tls podName:3e0f297c-682f-41c8-973e-5febc26c10d4 nodeName:}" failed. No retries permitted until 2026-07-05 14:58:12.730865012 +0000 UTC m=+85.791060967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-tls") pod "node-exporter-4vd2w" (UID: "3e0f297c-682f-41c8-973e-5febc26c10d4") : secret "node-exporter-tls" not found Jul 05 14:58:12.231106 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.230933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-textfile\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.231260 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.231240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.231260 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.231253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e0f297c-682f-41c8-973e-5febc26c10d4-metrics-client-ca\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.233040 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.233023 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.239213 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.239187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp88m\" (UniqueName: \"kubernetes.io/projected/3e0f297c-682f-41c8-973e-5febc26c10d4-kube-api-access-rp88m\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.733397 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.733363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-tls\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.735791 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.735766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e0f297c-682f-41c8-973e-5febc26c10d4-node-exporter-tls\") pod \"node-exporter-4vd2w\" (UID: \"3e0f297c-682f-41c8-973e-5febc26c10d4\") " pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.926276 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:12.926244 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4vd2w" Jul 05 14:58:12.937441 ip-10-0-128-154 kubenswrapper[2578]: W0705 14:58:12.937411 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0f297c_682f_41c8_973e_5febc26c10d4.slice/crio-0ec60521b4923df1af0f2f2da2f82d0e3a00ed8cc4409ea8560ff1753911688e WatchSource:0}: Error finding container 0ec60521b4923df1af0f2f2da2f82d0e3a00ed8cc4409ea8560ff1753911688e: Status 404 returned error can't find the container with id 0ec60521b4923df1af0f2f2da2f82d0e3a00ed8cc4409ea8560ff1753911688e Jul 05 14:58:13.878969 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:13.878938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vd2w" event={"ID":"3e0f297c-682f-41c8-973e-5febc26c10d4","Type":"ContainerStarted","Data":"0ec60521b4923df1af0f2f2da2f82d0e3a00ed8cc4409ea8560ff1753911688e"} Jul 05 14:58:14.883772 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:14.883737 2578 generic.go:356] "Generic (PLEG): container finished" podID="3e0f297c-682f-41c8-973e-5febc26c10d4" containerID="8162cb06748d5b710c793b82156fe90450d3689cfc467f2647614696fbbed50c" exitCode=0 Jul 05 14:58:14.884137 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:14.883800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vd2w" event={"ID":"3e0f297c-682f-41c8-973e-5febc26c10d4","Type":"ContainerDied","Data":"8162cb06748d5b710c793b82156fe90450d3689cfc467f2647614696fbbed50c"} Jul 05 14:58:15.888720 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:15.888684 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vd2w" event={"ID":"3e0f297c-682f-41c8-973e-5febc26c10d4","Type":"ContainerStarted","Data":"22261992e23823f9407b6a26c045e45b3abb74dfbda2767632fc93f61af86523"} Jul 05 14:58:15.889066 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:15.888742 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4vd2w" event={"ID":"3e0f297c-682f-41c8-973e-5febc26c10d4","Type":"ContainerStarted","Data":"2281a8f2452124ec8b1b82082845ff1dd87dd8ac0fd862062fb18dcd09d49a97"} Jul 05 14:58:15.906366 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:15.906324 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4vd2w" podStartSLOduration=3.882235897 podStartE2EDuration="4.906309974s" totalImagesPullingTime="952.879285ms" totalInitContainerRuntime="71.194792ms" isStatefulPod=true podCreationTimestamp="2026-07-05 14:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:58:15.90531309 +0000 UTC m=+88.965509049" watchObservedRunningTime="2026-07-05 14:58:15.906309974 +0000 UTC m=+88.966505941" Jul 05 14:58:29.829940 ip-10-0-128-154 kubenswrapper[2578]: I0705 14:58:29.829908 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ssjm4" Jul 05 15:01:10.426693 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.426621 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg"] Jul 05 15:01:10.429535 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.429514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.431890 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.431870 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 15:01:10.432013 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.431914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 15:01:10.432013 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.431926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 15:01:10.432013 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.431969 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fjx6c\"" Jul 05 15:01:10.432013 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.431983 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 15:01:10.447842 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.447822 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg"] Jul 05 15:01:10.525517 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.525481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7a0a782-9869-4e01-9e42-d40f786ab8b5-manifests\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.525517 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.525519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7a0a782-9869-4e01-9e42-d40f786ab8b5-tmp\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.525687 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.525539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7a0a782-9869-4e01-9e42-d40f786ab8b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.525687 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.525556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7a0a782-9869-4e01-9e42-d40f786ab8b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.525687 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.525652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjlm\" (UniqueName: \"kubernetes.io/projected/b7a0a782-9869-4e01-9e42-d40f786ab8b5-kube-api-access-dhjlm\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.626472 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.626438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7a0a782-9869-4e01-9e42-d40f786ab8b5-manifests\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.626644 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.626473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7a0a782-9869-4e01-9e42-d40f786ab8b5-tmp\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.626644 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.626503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7a0a782-9869-4e01-9e42-d40f786ab8b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.626644 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.626524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7a0a782-9869-4e01-9e42-d40f786ab8b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.626644 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.626552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjlm\" (UniqueName: \"kubernetes.io/projected/b7a0a782-9869-4e01-9e42-d40f786ab8b5-kube-api-access-dhjlm\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.626915 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.626832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b7a0a782-9869-4e01-9e42-d40f786ab8b5-manifests\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.628887 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.628856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7a0a782-9869-4e01-9e42-d40f786ab8b5-tmp\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.629035 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.629016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b7a0a782-9869-4e01-9e42-d40f786ab8b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.629174 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.629153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b7a0a782-9869-4e01-9e42-d40f786ab8b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.637868 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.637845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjlm\" (UniqueName: \"kubernetes.io/projected/b7a0a782-9869-4e01-9e42-d40f786ab8b5-kube-api-access-dhjlm\") pod \"opendatahub-operator-controller-manager-86749fcdf5-fvpkg\" (UID: \"b7a0a782-9869-4e01-9e42-d40f786ab8b5\") " pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.739115 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.739013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:10.881930 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:10.881898 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg"] Jul 05 15:01:10.885049 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:10.885024 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a0a782_9869_4e01_9e42_d40f786ab8b5.slice/crio-e5547691437029ab8e6ed330a1f66c2efc82a21f8aca0bcb3506ccba7213edd4 WatchSource:0}: Error finding container e5547691437029ab8e6ed330a1f66c2efc82a21f8aca0bcb3506ccba7213edd4: Status 404 returned error can't find the container with id e5547691437029ab8e6ed330a1f66c2efc82a21f8aca0bcb3506ccba7213edd4 Jul 05 15:01:11.442076 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:11.442041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" event={"ID":"b7a0a782-9869-4e01-9e42-d40f786ab8b5","Type":"ContainerStarted","Data":"e5547691437029ab8e6ed330a1f66c2efc82a21f8aca0bcb3506ccba7213edd4"} Jul 05 15:01:14.454287 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:14.454254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" event={"ID":"b7a0a782-9869-4e01-9e42-d40f786ab8b5","Type":"ContainerStarted","Data":"1f76212c5dea955dc8a398c6344ee23beacf0686405e9766ab16af13fdc4319a"} Jul 05 15:01:15.458840 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:15.458802 2578 generic.go:356] "Generic (PLEG): container finished" podID="b7a0a782-9869-4e01-9e42-d40f786ab8b5" containerID="1f76212c5dea955dc8a398c6344ee23beacf0686405e9766ab16af13fdc4319a" exitCode=0 Jul 05 15:01:15.459206 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:15.458887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" event={"ID":"b7a0a782-9869-4e01-9e42-d40f786ab8b5","Type":"ContainerDied","Data":"1f76212c5dea955dc8a398c6344ee23beacf0686405e9766ab16af13fdc4319a"} Jul 05 15:01:16.464371 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:16.464290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" event={"ID":"b7a0a782-9869-4e01-9e42-d40f786ab8b5","Type":"ContainerStarted","Data":"1f10af6d34d8659166d3bbd8a8a0bb687e2445d65c43c60a909b28bbd472efc2"} Jul 05 15:01:16.464897 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:16.464402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:16.488525 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:16.488470 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" podStartSLOduration=2.035359649 podStartE2EDuration="6.488450212s" totalImagesPullingTime="3.45139577s" totalInitContainerRuntime="1.001694793s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:16.487626947 +0000 UTC m=+269.547822902" watchObservedRunningTime="2026-07-05 15:01:16.488450212 +0000 UTC m=+269.548646173" Jul 05 15:01:27.470091 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:27.470062 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86749fcdf5-fvpkg" Jul 05 15:01:29.715080 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.715044 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv"] Jul 05 15:01:29.725665 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.725634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.728351 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.728333 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 15:01:29.728351 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.728340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 05 15:01:29.728512 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.728496 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mxcm2\"" Jul 05 15:01:29.729066 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.729045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 05 15:01:29.729202 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.729086 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 15:01:29.733291 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.733271 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv"] Jul 05 15:01:29.759986 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.759953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d27f\" (UniqueName: \"kubernetes.io/projected/d5861260-493e-4420-806a-519ed97c1b03-kube-api-access-5d27f\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.759986 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.759986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5861260-493e-4420-806a-519ed97c1b03-tmp\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.760183 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.760015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5861260-493e-4420-806a-519ed97c1b03-tls-certs\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.860574 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.860543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d27f\" (UniqueName: \"kubernetes.io/projected/d5861260-493e-4420-806a-519ed97c1b03-kube-api-access-5d27f\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.860574 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.860580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5861260-493e-4420-806a-519ed97c1b03-tmp\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.860830 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.860630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5861260-493e-4420-806a-519ed97c1b03-tls-certs\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.863019 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.862985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5861260-493e-4420-806a-519ed97c1b03-tmp\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.863187 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.863169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5861260-493e-4420-806a-519ed97c1b03-tls-certs\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:29.882315 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:29.882281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d27f\" (UniqueName: \"kubernetes.io/projected/d5861260-493e-4420-806a-519ed97c1b03-kube-api-access-5d27f\") pod \"kube-auth-proxy-6f8657b479-7vxpv\" (UID: \"d5861260-493e-4420-806a-519ed97c1b03\") " pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:30.035232 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.035146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" Jul 05 15:01:30.070387 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.070354 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l489h"] Jul 05 15:01:30.073965 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.073946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.076300 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.076269 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 05 15:01:30.076438 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.076417 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7nq4g\"" Jul 05 15:01:30.083001 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.082972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l489h"] Jul 05 15:01:30.163750 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.163717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba25b75d-3155-4bac-bd4c-381cae6b294e-cert\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.163917 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.163796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkcq\" (UniqueName: \"kubernetes.io/projected/ba25b75d-3155-4bac-bd4c-381cae6b294e-kube-api-access-5kkcq\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.180519 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.180388 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv"] Jul 05 15:01:30.183493 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:30.183458 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5861260_493e_4420_806a_519ed97c1b03.slice/crio-bff37e55ba0ca5095cfd78a12614c36f94a438dde9dc576b8dbf3a8e583a3a0b WatchSource:0}: Error finding container bff37e55ba0ca5095cfd78a12614c36f94a438dde9dc576b8dbf3a8e583a3a0b: Status 404 returned error can't find the container with id bff37e55ba0ca5095cfd78a12614c36f94a438dde9dc576b8dbf3a8e583a3a0b Jul 05 15:01:30.264474 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.264421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkcq\" (UniqueName: \"kubernetes.io/projected/ba25b75d-3155-4bac-bd4c-381cae6b294e-kube-api-access-5kkcq\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.264705 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.264492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba25b75d-3155-4bac-bd4c-381cae6b294e-cert\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.264705 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:01:30.264674 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 05 15:01:30.264831 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:01:30.264742 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba25b75d-3155-4bac-bd4c-381cae6b294e-cert podName:ba25b75d-3155-4bac-bd4c-381cae6b294e nodeName:}" failed. No retries permitted until 2026-07-05 15:01:30.764721345 +0000 UTC m=+283.824917285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba25b75d-3155-4bac-bd4c-381cae6b294e-cert") pod "odh-model-controller-7998c67dc4-l489h" (UID: "ba25b75d-3155-4bac-bd4c-381cae6b294e") : secret "odh-model-controller-webhook-cert" not found Jul 05 15:01:30.274097 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.274066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkcq\" (UniqueName: \"kubernetes.io/projected/ba25b75d-3155-4bac-bd4c-381cae6b294e-kube-api-access-5kkcq\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.511328 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.511290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" event={"ID":"d5861260-493e-4420-806a-519ed97c1b03","Type":"ContainerStarted","Data":"bff37e55ba0ca5095cfd78a12614c36f94a438dde9dc576b8dbf3a8e583a3a0b"} Jul 05 15:01:30.769386 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.769295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba25b75d-3155-4bac-bd4c-381cae6b294e-cert\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.771775 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.771752 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba25b75d-3155-4bac-bd4c-381cae6b294e-cert\") pod \"odh-model-controller-7998c67dc4-l489h\" (UID: \"ba25b75d-3155-4bac-bd4c-381cae6b294e\") " pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:30.988253 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:30.988173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:31.031313 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.031180 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm29l"] Jul 05 15:01:31.034618 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.034515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.037485 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.036991 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 15:01:31.037485 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.037292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rm62z\"" Jul 05 15:01:31.037485 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.037306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 15:01:31.037485 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.037412 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 15:01:31.037485 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.037473 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 15:01:31.054506 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.054439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm29l"] Jul 05 15:01:31.072938 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.072909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.073120 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.072966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqjv2\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-kube-api-access-vqjv2\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.073120 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.073000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.073120 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.073046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-cacerts\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.073120 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.073084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-local-certs\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.073120 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.073108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.073397 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.073136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-token\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.174153 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-cacerts\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.174692 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l489h"] Jul 05 15:01:31.174692 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-local-certs\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.174817 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.174817 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-token\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.174817 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.175066 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqjv2\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-kube-api-access-vqjv2\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.175066 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.174869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.175514 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.175484 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.178307 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.178068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-cacerts\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.178307 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:31.178169 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba25b75d_3155_4bac_bd4c_381cae6b294e.slice/crio-79b3b01b544eecb7d8fcf6af38b56e409f77a40ed2f34a96d439e6b6408323d3 WatchSource:0}: Error finding container 79b3b01b544eecb7d8fcf6af38b56e409f77a40ed2f34a96d439e6b6408323d3: Status 404 returned error can't find the container with id 79b3b01b544eecb7d8fcf6af38b56e409f77a40ed2f34a96d439e6b6408323d3 Jul 05 15:01:31.179489 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.179182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.180327 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.180263 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.180484 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.180439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-local-certs\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.186851 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.186806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqjv2\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-kube-api-access-vqjv2\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.188177 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.188153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-token\") pod \"istiod-openshift-gateway-7574459656-xm29l\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.346731 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.346645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:31.492993 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.492968 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm29l"] Jul 05 15:01:31.496002 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:31.495968 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4185d2c7_2f81_4af4_a7dc_873cf6bd392d.slice/crio-bd546bcc6f124dbc4913d49421314508574a653ac0948d88d6973b71476e369f WatchSource:0}: Error finding container bd546bcc6f124dbc4913d49421314508574a653ac0948d88d6973b71476e369f: Status 404 returned error can't find the container with id bd546bcc6f124dbc4913d49421314508574a653ac0948d88d6973b71476e369f Jul 05 15:01:31.517442 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.517402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" event={"ID":"4185d2c7-2f81-4af4-a7dc-873cf6bd392d","Type":"ContainerStarted","Data":"bd546bcc6f124dbc4913d49421314508574a653ac0948d88d6973b71476e369f"} Jul 05 15:01:31.518765 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:31.518731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" event={"ID":"ba25b75d-3155-4bac-bd4c-381cae6b294e","Type":"ContainerStarted","Data":"79b3b01b544eecb7d8fcf6af38b56e409f77a40ed2f34a96d439e6b6408323d3"} Jul 05 15:01:35.522421 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:35.522367 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 05 15:01:35.522803 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:35.522445 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 05 15:01:35.537263 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:35.537240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" event={"ID":"d5861260-493e-4420-806a-519ed97c1b03","Type":"ContainerStarted","Data":"3c098a29b888e3480e1a1e8b4828a00ab6d203157024c96ac8bc92ad23f6e3fe"} Jul 05 15:01:35.556986 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:35.553618 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f8657b479-7vxpv" podStartSLOduration=1.280711289 podStartE2EDuration="6.553576196s" totalImagesPullingTime="5.272864907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:35.550928374 +0000 UTC m=+288.611124334" watchObservedRunningTime="2026-07-05 15:01:35.553576196 +0000 UTC m=+288.613772159" Jul 05 15:01:36.541886 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.541847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" event={"ID":"4185d2c7-2f81-4af4-a7dc-873cf6bd392d","Type":"ContainerStarted","Data":"adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444"} Jul 05 15:01:36.542337 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.542057 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:36.543944 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.543913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" event={"ID":"ba25b75d-3155-4bac-bd4c-381cae6b294e","Type":"ContainerStarted","Data":"29d84d7fd8ebaddd52995ae2beef39d9cec0cddba9a6646c02055db349c62d98"} Jul 05 15:01:36.544114 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.544091 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xm29l container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 15:01:36.544186 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.544144 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" podUID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 15:01:36.560136 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.560085 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" podStartSLOduration=1.5367609230000001 podStartE2EDuration="5.560065936s" totalImagesPullingTime="4.023305013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:36.559064033 +0000 UTC m=+289.619260011" watchObservedRunningTime="2026-07-05 15:01:36.560065936 +0000 UTC m=+289.620261902" Jul 05 15:01:36.575225 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:36.575179 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" podStartSLOduration=2.285738037 podStartE2EDuration="6.575161947s" totalImagesPullingTime="4.28942391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:36.573210236 +0000 UTC m=+289.633406196" watchObservedRunningTime="2026-07-05 15:01:36.575161947 +0000 UTC m=+289.635357908" Jul 05 15:01:37.547317 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:37.547283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:01:37.547829 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:37.547811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:39.305239 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.305205 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669"] Jul 05 15:01:39.308258 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.308241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.319050 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.319028 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669"] Jul 05 15:01:39.449033 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.448998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.449033 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.449035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.449224 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.449057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszpj\" (UniqueName: \"kubernetes.io/projected/8886ee88-d6f3-47de-a25f-f9310ceff508-kube-api-access-pszpj\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.449224 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.449084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.449224 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.449105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.449224 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.449182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8886ee88-d6f3-47de-a25f-f9310ceff508-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.449224 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.449204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549769 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549970 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8886ee88-d6f3-47de-a25f-f9310ceff508-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549970 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549970 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549970 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549970 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszpj\" (UniqueName: \"kubernetes.io/projected/8886ee88-d6f3-47de-a25f-f9310ceff508-kube-api-access-pszpj\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.549970 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.549898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.550943 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.550911 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.552471 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.552441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8886ee88-d6f3-47de-a25f-f9310ceff508-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.552581 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.552564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.552705 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.552686 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.552764 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.552749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8886ee88-d6f3-47de-a25f-f9310ceff508-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.563614 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.563553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8886ee88-d6f3-47de-a25f-f9310ceff508-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.569143 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.569112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszpj\" (UniqueName: \"kubernetes.io/projected/8886ee88-d6f3-47de-a25f-f9310ceff508-kube-api-access-pszpj\") pod \"istiod-openshift-gateway-94bb8fbfd-rm669\" (UID: \"8886ee88-d6f3-47de-a25f-f9310ceff508\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.617618 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.617573 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:39.742658 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.742628 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669"] Jul 05 15:01:39.745382 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:39.745355 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8886ee88_d6f3_47de_a25f_f9310ceff508.slice/crio-4fddbfa7eb62a3f80c9d5aa10c1fcb9c874538cdc816c6e2bda0cfef4928a828 WatchSource:0}: Error finding container 4fddbfa7eb62a3f80c9d5aa10c1fcb9c874538cdc816c6e2bda0cfef4928a828: Status 404 returned error can't find the container with id 4fddbfa7eb62a3f80c9d5aa10c1fcb9c874538cdc816c6e2bda0cfef4928a828 Jul 05 15:01:39.748187 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.748155 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 05 15:01:39.748263 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:39.748220 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 05 15:01:40.560814 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.560784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" event={"ID":"8886ee88-d6f3-47de-a25f-f9310ceff508","Type":"ContainerStarted","Data":"7ad09e1b7527f231bc0ee3a01b39fed4b14984d9f041df1ba3902769688485c6"} Jul 05 15:01:40.561261 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.560867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" event={"ID":"8886ee88-d6f3-47de-a25f-f9310ceff508","Type":"ContainerStarted","Data":"4fddbfa7eb62a3f80c9d5aa10c1fcb9c874538cdc816c6e2bda0cfef4928a828"} Jul 05 15:01:40.561261 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.561022 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:40.562607 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.562566 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" Jul 05 15:01:40.633416 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.633372 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rm669" podStartSLOduration=1.6333580909999998 podStartE2EDuration="1.633358091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:40.632357135 +0000 UTC m=+293.692553095" watchObservedRunningTime="2026-07-05 15:01:40.633358091 +0000 UTC m=+293.693554052" Jul 05 15:01:40.729341 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.729311 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm29l"] Jul 05 15:01:40.729536 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.729510 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" podUID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" containerName="discovery" containerID="cri-o://adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444" gracePeriod=30 Jul 05 15:01:40.967454 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:40.967425 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:41.063699 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063665 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqjv2\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-kube-api-access-vqjv2\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.063864 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063737 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-token\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.063864 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063837 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-kubeconfig\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.063966 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063868 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-ca-configmap\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.063966 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063892 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-local-certs\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.063966 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063918 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-dns-cert\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.063966 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.063948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-cacerts\") pod \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\" (UID: \"4185d2c7-2f81-4af4-a7dc-873cf6bd392d\") " Jul 05 15:01:41.064260 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.064232 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 15:01:41.066503 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.066449 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 15:01:41.066910 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.066794 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-kube-api-access-vqjv2" (OuterVolumeSpecName: "kube-api-access-vqjv2") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "kube-api-access-vqjv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 15:01:41.066910 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.066878 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-token" (OuterVolumeSpecName: "istio-token") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 15:01:41.066910 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.066881 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 15:01:41.066910 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.066891 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-local-certs" (OuterVolumeSpecName: "local-certs") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 15:01:41.066910 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.066896 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-cacerts" (OuterVolumeSpecName: "cacerts") pod "4185d2c7-2f81-4af4-a7dc-873cf6bd392d" (UID: "4185d2c7-2f81-4af4-a7dc-873cf6bd392d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 15:01:41.164878 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164853 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-token\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.164878 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164877 2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-kubeconfig\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.165022 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164887 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-ca-configmap\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.165022 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164896 2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-local-certs\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.165022 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164904 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-istio-csr-dns-cert\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.165022 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164911 2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-cacerts\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.165022 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.164920 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqjv2\" (UniqueName: \"kubernetes.io/projected/4185d2c7-2f81-4af4-a7dc-873cf6bd392d-kube-api-access-vqjv2\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:01:41.331791 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.331759 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv"] Jul 05 15:01:41.332017 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.332006 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" containerName="discovery" Jul 05 15:01:41.332056 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.332019 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" containerName="discovery" Jul 05 15:01:41.332090 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.332071 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" containerName="discovery" Jul 05 15:01:41.334880 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.334859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.337020 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.337002 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sgcht\"" Jul 05 15:01:41.337304 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.337288 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 05 15:01:41.345935 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.345914 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h"] Jul 05 15:01:41.348861 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.348844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:41.351472 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.351356 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-r9tsz\"" Jul 05 15:01:41.351472 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.351384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 05 15:01:41.352916 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.352879 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv"] Jul 05 15:01:41.364003 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.363985 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h"] Jul 05 15:01:41.467372 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.467287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9944ebf1-85dc-4fb4-95a2-209131e42a65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:41.467372 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.467322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hmc\" (UniqueName: \"kubernetes.io/projected/6d2e2354-a91b-44cf-9611-09ea1b8f8cc8-kube-api-access-42hmc\") pod \"kserve-controller-manager-d6f4b65b8-pfzcv\" (UID: \"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.467372 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.467353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkr6v\" (UniqueName: \"kubernetes.io/projected/9944ebf1-85dc-4fb4-95a2-209131e42a65-kube-api-access-lkr6v\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:41.467581 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.467439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2e2354-a91b-44cf-9611-09ea1b8f8cc8-cert\") pod \"kserve-controller-manager-d6f4b65b8-pfzcv\" (UID: \"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.565342 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.565309 2578 generic.go:356] "Generic (PLEG): container finished" podID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" containerID="adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444" exitCode=0 Jul 05 15:01:41.565822 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.565359 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" Jul 05 15:01:41.565822 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.565396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" event={"ID":"4185d2c7-2f81-4af4-a7dc-873cf6bd392d","Type":"ContainerDied","Data":"adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444"} Jul 05 15:01:41.565822 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.565453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xm29l" event={"ID":"4185d2c7-2f81-4af4-a7dc-873cf6bd392d","Type":"ContainerDied","Data":"bd546bcc6f124dbc4913d49421314508574a653ac0948d88d6973b71476e369f"} Jul 05 15:01:41.565822 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.565501 2578 scope.go:117] "RemoveContainer" containerID="adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444" Jul 05 15:01:41.567906 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.567884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkr6v\" (UniqueName: \"kubernetes.io/projected/9944ebf1-85dc-4fb4-95a2-209131e42a65-kube-api-access-lkr6v\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:41.568017 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.567930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2e2354-a91b-44cf-9611-09ea1b8f8cc8-cert\") pod \"kserve-controller-manager-d6f4b65b8-pfzcv\" (UID: \"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.568017 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.567976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9944ebf1-85dc-4fb4-95a2-209131e42a65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:41.568017 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.568006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hmc\" (UniqueName: \"kubernetes.io/projected/6d2e2354-a91b-44cf-9611-09ea1b8f8cc8-kube-api-access-42hmc\") pod \"kserve-controller-manager-d6f4b65b8-pfzcv\" (UID: \"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.568169 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:01:41.568112 2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 05 15:01:41.568232 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:01:41.568183 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9944ebf1-85dc-4fb4-95a2-209131e42a65-cert podName:9944ebf1-85dc-4fb4-95a2-209131e42a65 nodeName:}" failed. No retries permitted until 2026-07-05 15:01:42.068163005 +0000 UTC m=+295.128358949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9944ebf1-85dc-4fb4-95a2-209131e42a65-cert") pod "llmisvc-controller-manager-777c6bd7d5-dql8h" (UID: "9944ebf1-85dc-4fb4-95a2-209131e42a65") : secret "llmisvc-webhook-server-cert" not found Jul 05 15:01:41.570673 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.570653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d2e2354-a91b-44cf-9611-09ea1b8f8cc8-cert\") pod \"kserve-controller-manager-d6f4b65b8-pfzcv\" (UID: \"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.573731 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.573715 2578 scope.go:117] "RemoveContainer" containerID="adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444" Jul 05 15:01:41.574005 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:01:41.573987 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444\": container with ID starting with adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444 not found: ID does not exist" containerID="adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444" Jul 05 15:01:41.574058 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.574022 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444"} err="failed to get container status \"adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444\": rpc error: code = NotFound desc = could not find container \"adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444\": container with ID starting with adbc4ff6027060b73e029feb0d71a956edfe51873e284da6c3e4c15ed536f444 not found: ID does not exist" Jul 05 15:01:41.581445 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.581408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hmc\" (UniqueName: \"kubernetes.io/projected/6d2e2354-a91b-44cf-9611-09ea1b8f8cc8-kube-api-access-42hmc\") pod \"kserve-controller-manager-d6f4b65b8-pfzcv\" (UID: \"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.582149 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.582128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkr6v\" (UniqueName: \"kubernetes.io/projected/9944ebf1-85dc-4fb4-95a2-209131e42a65-kube-api-access-lkr6v\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:41.595007 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.594984 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm29l"] Jul 05 15:01:41.606661 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.606641 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xm29l"] Jul 05 15:01:41.644644 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.644614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:41.773968 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:41.773939 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv"] Jul 05 15:01:41.777118 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:41.777092 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2e2354_a91b_44cf_9611_09ea1b8f8cc8.slice/crio-5654c94b7c80231628cefcd43fb7d4cfc05e902f3145b0b3648b3964682468d6 WatchSource:0}: Error finding container 5654c94b7c80231628cefcd43fb7d4cfc05e902f3145b0b3648b3964682468d6: Status 404 returned error can't find the container with id 5654c94b7c80231628cefcd43fb7d4cfc05e902f3145b0b3648b3964682468d6 Jul 05 15:01:42.073101 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:42.073011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9944ebf1-85dc-4fb4-95a2-209131e42a65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:42.075474 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:42.075447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9944ebf1-85dc-4fb4-95a2-209131e42a65-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dql8h\" (UID: \"9944ebf1-85dc-4fb4-95a2-209131e42a65\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:42.259333 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:42.259293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:42.389320 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:42.389293 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h"] Jul 05 15:01:42.392192 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:01:42.392164 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9944ebf1_85dc_4fb4_95a2_209131e42a65.slice/crio-26d6a3aaf6edb684ca51fdcfe36f5c7f08090ecc5d125043bc39fa1129318895 WatchSource:0}: Error finding container 26d6a3aaf6edb684ca51fdcfe36f5c7f08090ecc5d125043bc39fa1129318895: Status 404 returned error can't find the container with id 26d6a3aaf6edb684ca51fdcfe36f5c7f08090ecc5d125043bc39fa1129318895 Jul 05 15:01:42.570476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:42.570439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" event={"ID":"9944ebf1-85dc-4fb4-95a2-209131e42a65","Type":"ContainerStarted","Data":"26d6a3aaf6edb684ca51fdcfe36f5c7f08090ecc5d125043bc39fa1129318895"} Jul 05 15:01:42.572460 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:42.572435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" event={"ID":"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8","Type":"ContainerStarted","Data":"5654c94b7c80231628cefcd43fb7d4cfc05e902f3145b0b3648b3964682468d6"} Jul 05 15:01:43.376153 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:43.376119 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4185d2c7-2f81-4af4-a7dc-873cf6bd392d" path="/var/lib/kubelet/pods/4185d2c7-2f81-4af4-a7dc-873cf6bd392d/volumes" Jul 05 15:01:44.581321 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:44.581237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" event={"ID":"6d2e2354-a91b-44cf-9611-09ea1b8f8cc8","Type":"ContainerStarted","Data":"257b73ddfb100bb493a683c479909a6604e27b28af1d8d5e53ed0db40625d306"} Jul 05 15:01:44.581714 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:44.581369 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:01:44.618650 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:44.618565 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" podStartSLOduration=1.102129169 podStartE2EDuration="3.618544889s" totalImagesPullingTime="2.51641572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:44.618228151 +0000 UTC m=+297.678424111" watchObservedRunningTime="2026-07-05 15:01:44.618544889 +0000 UTC m=+297.678740849" Jul 05 15:01:46.591273 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:46.591235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" event={"ID":"9944ebf1-85dc-4fb4-95a2-209131e42a65","Type":"ContainerStarted","Data":"770c6f10751fd8005e15a9e36fb1c17d10105401846d316e4372a4f1c3a7097b"} Jul 05 15:01:46.591733 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:46.591358 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:01:46.610493 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:46.610442 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" podStartSLOduration=2.443995365 podStartE2EDuration="5.610422955s" totalImagesPullingTime="3.16642759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:01:46.60895607 +0000 UTC m=+299.669152022" watchObservedRunningTime="2026-07-05 15:01:46.610422955 +0000 UTC m=+299.670618920" Jul 05 15:01:47.291286 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:47.291266 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 15:01:48.552659 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:01:48.552622 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-l489h" Jul 05 15:02:15.591356 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:15.591326 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pfzcv" Jul 05 15:02:17.597309 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:17.597280 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dql8h" Jul 05 15:02:55.528909 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.528836 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv"] Jul 05 15:02:55.531936 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.531920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:02:55.533880 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.533864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 15:02:55.534448 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.534431 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 15:02:55.534523 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.534455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vwb59\"" Jul 05 15:02:55.545525 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.545505 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv"] Jul 05 15:02:55.616499 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.616471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctbtv\" (UniqueName: \"kubernetes.io/projected/a4b67acd-31e5-4a37-a3fb-539aefa67fbd-kube-api-access-ctbtv\") pod \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" (UID: \"a4b67acd-31e5-4a37-a3fb-539aefa67fbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:02:55.717739 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.717707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctbtv\" (UniqueName: \"kubernetes.io/projected/a4b67acd-31e5-4a37-a3fb-539aefa67fbd-kube-api-access-ctbtv\") pod \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" (UID: \"a4b67acd-31e5-4a37-a3fb-539aefa67fbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:02:55.727915 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.727885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctbtv\" (UniqueName: \"kubernetes.io/projected/a4b67acd-31e5-4a37-a3fb-539aefa67fbd-kube-api-access-ctbtv\") pod \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" (UID: \"a4b67acd-31e5-4a37-a3fb-539aefa67fbd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:02:55.841495 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.841393 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:02:55.984339 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.984308 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv"] Jul 05 15:02:55.987572 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:02:55.987543 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b67acd_31e5_4a37_a3fb_539aefa67fbd.slice/crio-941254ca3df7dd405d53ff7668752b22237426630fddc59b0f355c1632a260f9 WatchSource:0}: Error finding container 941254ca3df7dd405d53ff7668752b22237426630fddc59b0f355c1632a260f9: Status 404 returned error can't find the container with id 941254ca3df7dd405d53ff7668752b22237426630fddc59b0f355c1632a260f9 Jul 05 15:02:55.989641 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:55.989623 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 15:02:56.847541 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:56.847504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" event={"ID":"a4b67acd-31e5-4a37-a3fb-539aefa67fbd","Type":"ContainerStarted","Data":"941254ca3df7dd405d53ff7668752b22237426630fddc59b0f355c1632a260f9"} Jul 05 15:02:58.856874 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:58.856834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" event={"ID":"a4b67acd-31e5-4a37-a3fb-539aefa67fbd","Type":"ContainerStarted","Data":"cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7"} Jul 05 15:02:58.857273 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:02:58.856947 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:04.946252 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:04.946199 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" podStartSLOduration=7.9600363 podStartE2EDuration="9.94617982s" totalImagesPullingTime="1.98614352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:02:58.893298728 +0000 UTC m=+371.953494688" watchObservedRunningTime="2026-07-05 15:03:04.94617982 +0000 UTC m=+378.006375780" Jul 05 15:03:04.946902 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:04.946886 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg"] Jul 05 15:03:04.952281 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:04.951242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:04.953699 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:04.953676 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t8xfj\"" Jul 05 15:03:04.964206 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:04.964182 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg"] Jul 05 15:03:05.095937 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.095897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8zl\" (UniqueName: \"kubernetes.io/projected/05e12f24-6f6d-4d99-b771-174893bcb648-kube-api-access-wv8zl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.096119 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.095989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e12f24-6f6d-4d99-b771-174893bcb648-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.197326 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.197247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e12f24-6f6d-4d99-b771-174893bcb648-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.197326 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.197302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8zl\" (UniqueName: \"kubernetes.io/projected/05e12f24-6f6d-4d99-b771-174893bcb648-kube-api-access-wv8zl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.197748 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.197724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e12f24-6f6d-4d99-b771-174893bcb648-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.205082 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.205058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8zl\" (UniqueName: \"kubernetes.io/projected/05e12f24-6f6d-4d99-b771-174893bcb648-kube-api-access-wv8zl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.262189 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.262161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:05.390653 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.390633 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg"] Jul 05 15:03:05.393257 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:03:05.393233 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e12f24_6f6d_4d99_b771_174893bcb648.slice/crio-a88dc10bb5ee621b4b9acf16cc0ae617549a42e7284dfa1950aa2f4a7e656659 WatchSource:0}: Error finding container a88dc10bb5ee621b4b9acf16cc0ae617549a42e7284dfa1950aa2f4a7e656659: Status 404 returned error can't find the container with id a88dc10bb5ee621b4b9acf16cc0ae617549a42e7284dfa1950aa2f4a7e656659 Jul 05 15:03:05.886151 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:05.886116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" event={"ID":"05e12f24-6f6d-4d99-b771-174893bcb648","Type":"ContainerStarted","Data":"a88dc10bb5ee621b4b9acf16cc0ae617549a42e7284dfa1950aa2f4a7e656659"} Jul 05 15:03:09.864477 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:09.864450 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:11.913204 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:11.913167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" event={"ID":"05e12f24-6f6d-4d99-b771-174893bcb648","Type":"ContainerStarted","Data":"aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee"} Jul 05 15:03:11.913622 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:11.913306 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:11.931987 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:11.931941 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" podStartSLOduration=2.267693133 podStartE2EDuration="7.931924346s" totalImagesPullingTime="5.664231213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:03:11.93107958 +0000 UTC m=+384.991275540" watchObservedRunningTime="2026-07-05 15:03:11.931924346 +0000 UTC m=+384.992120307" Jul 05 15:03:22.919974 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:22.919945 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.198340 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.198302 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z"] Jul 05 15:03:24.201701 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.201686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.218322 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.218302 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z"] Jul 05 15:03:24.347095 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.347065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdpzj\" (UniqueName: \"kubernetes.io/projected/527bd387-620d-40ad-9a35-ec1963e73134-kube-api-access-rdpzj\") pod \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.347243 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.347103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/527bd387-620d-40ad-9a35-ec1963e73134-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.448463 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.448394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdpzj\" (UniqueName: \"kubernetes.io/projected/527bd387-620d-40ad-9a35-ec1963e73134-kube-api-access-rdpzj\") pod \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.448463 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.448432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/527bd387-620d-40ad-9a35-ec1963e73134-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.448776 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.448760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/527bd387-620d-40ad-9a35-ec1963e73134-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.458120 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.458091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdpzj\" (UniqueName: \"kubernetes.io/projected/527bd387-620d-40ad-9a35-ec1963e73134-kube-api-access-rdpzj\") pod \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.511610 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.511568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:24.538776 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.538745 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z"] Jul 05 15:03:24.546100 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.546073 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z"] Jul 05 15:03:24.588538 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.588496 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg"] Jul 05 15:03:24.588786 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.588745 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" containerName="manager" containerID="cri-o://aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee" gracePeriod=2 Jul 05 15:03:24.609173 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.609113 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg"] Jul 05 15:03:24.611963 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.611931 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"05e12f24-6f6d-4d99-b771-174893bcb648\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-244tg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.620687 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.620664 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z"] Jul 05 15:03:24.620969 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.620954 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" containerName="manager" Jul 05 15:03:24.621015 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.620973 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" containerName="manager" Jul 05 15:03:24.621057 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.621040 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" containerName="manager" Jul 05 15:03:24.623885 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.623868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.624569 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.624548 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv"] Jul 05 15:03:24.624776 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.624753 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" containerName="manager" containerID="cri-o://cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7" gracePeriod=2 Jul 05 15:03:24.625908 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.625881 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.639081 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.639017 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv"] Jul 05 15:03:24.640953 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.640926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z"] Jul 05 15:03:24.650025 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.649079 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x"] Jul 05 15:03:24.650025 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.649430 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" containerName="manager" Jul 05 15:03:24.650025 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.649444 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" containerName="manager" Jul 05 15:03:24.650025 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.649537 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" containerName="manager" Jul 05 15:03:24.653496 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.652858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:24.665254 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.664177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x"] Jul 05 15:03:24.688217 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.688181 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.689759 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.689735 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.752018 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.751979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6e52d8-3b2a-41f5-af32-73232b777519-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj46z\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.752134 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.752086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlc9t\" (UniqueName: \"kubernetes.io/projected/6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449-kube-api-access-qlc9t\") pod \"limitador-operator-controller-manager-859d7b78bd-crm5x\" (UID: \"6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:24.752134 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.752124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsxn2\" (UniqueName: \"kubernetes.io/projected/db6e52d8-3b2a-41f5-af32-73232b777519-kube-api-access-rsxn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj46z\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.859849 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.857941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6e52d8-3b2a-41f5-af32-73232b777519-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj46z\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.859849 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.858013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlc9t\" (UniqueName: \"kubernetes.io/projected/6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449-kube-api-access-qlc9t\") pod \"limitador-operator-controller-manager-859d7b78bd-crm5x\" (UID: \"6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:24.859849 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.858053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsxn2\" (UniqueName: \"kubernetes.io/projected/db6e52d8-3b2a-41f5-af32-73232b777519-kube-api-access-rsxn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj46z\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.859849 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.858812 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6e52d8-3b2a-41f5-af32-73232b777519-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj46z\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.870147 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.870122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsxn2\" (UniqueName: \"kubernetes.io/projected/db6e52d8-3b2a-41f5-af32-73232b777519-kube-api-access-rsxn2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xj46z\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:24.870379 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.870363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlc9t\" (UniqueName: \"kubernetes.io/projected/6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449-kube-api-access-qlc9t\") pod \"limitador-operator-controller-manager-859d7b78bd-crm5x\" (UID: \"6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:24.870824 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.870807 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.872398 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.872376 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.873894 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.873870 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.874271 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.874253 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.875809 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.875781 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.877199 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.877178 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.966236 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.966146 2578 generic.go:356] "Generic (PLEG): container finished" podID="05e12f24-6f6d-4d99-b771-174893bcb648" containerID="aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee" exitCode=0 Jul 05 15:03:24.966236 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.966194 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.966444 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.966254 2578 scope.go:117] "RemoveContainer" containerID="aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee" Jul 05 15:03:24.967721 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.967652 2578 generic.go:356] "Generic (PLEG): container finished" podID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" containerID="cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7" exitCode=0 Jul 05 15:03:24.967721 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.967690 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.968018 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.967997 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.969634 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.969588 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.971118 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.971095 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:24.972498 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.972475 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:24.974547 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.974530 2578 scope.go:117] "RemoveContainer" containerID="aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee" Jul 05 15:03:24.974783 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.974765 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee\": container with ID starting with aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee not found: ID does not exist" containerID="aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee" Jul 05 15:03:24.974844 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.974793 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee"} err="failed to get container status \"aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee\": rpc error: code = NotFound desc = could not find container \"aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee\": container with ID starting with aeb4c45bd29ee347ee88d13d5c4debe178b759be013b27f195073efce54fbeee not found: ID does not exist" Jul 05 15:03:24.974844 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.974809 2578 scope.go:117] "RemoveContainer" containerID="cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7" Jul 05 15:03:24.981867 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.981853 2578 scope.go:117] "RemoveContainer" containerID="cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7" Jul 05 15:03:24.982116 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:24.982100 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7\": container with ID starting with cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7 not found: ID does not exist" containerID="cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7" Jul 05 15:03:24.982156 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:24.982121 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7"} err="failed to get container status \"cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7\": rpc error: code = NotFound desc = could not find container \"cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7\": container with ID starting with cc4ca6e2f0edea7d91960f6cf125628a7e1d9e8e5ebcf24afb55f828616badd7 not found: ID does not exist" Jul 05 15:03:25.010336 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.010298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:25.015421 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.015407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:25.059208 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.059180 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e12f24-6f6d-4d99-b771-174893bcb648-extensions-socket-volume\") pod \"05e12f24-6f6d-4d99-b771-174893bcb648\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " Jul 05 15:03:25.059375 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.059245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv8zl\" (UniqueName: \"kubernetes.io/projected/05e12f24-6f6d-4d99-b771-174893bcb648-kube-api-access-wv8zl\") pod \"05e12f24-6f6d-4d99-b771-174893bcb648\" (UID: \"05e12f24-6f6d-4d99-b771-174893bcb648\") " Jul 05 15:03:25.059375 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.059289 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctbtv\" (UniqueName: \"kubernetes.io/projected/a4b67acd-31e5-4a37-a3fb-539aefa67fbd-kube-api-access-ctbtv\") pod \"a4b67acd-31e5-4a37-a3fb-539aefa67fbd\" (UID: \"a4b67acd-31e5-4a37-a3fb-539aefa67fbd\") " Jul 05 15:03:25.059961 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.059932 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e12f24-6f6d-4d99-b771-174893bcb648-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05e12f24-6f6d-4d99-b771-174893bcb648" (UID: "05e12f24-6f6d-4d99-b771-174893bcb648"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 15:03:25.062781 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.062731 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e12f24-6f6d-4d99-b771-174893bcb648-kube-api-access-wv8zl" (OuterVolumeSpecName: "kube-api-access-wv8zl") pod "05e12f24-6f6d-4d99-b771-174893bcb648" (UID: "05e12f24-6f6d-4d99-b771-174893bcb648"). InnerVolumeSpecName "kube-api-access-wv8zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 15:03:25.062979 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.062957 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b67acd-31e5-4a37-a3fb-539aefa67fbd-kube-api-access-ctbtv" (OuterVolumeSpecName: "kube-api-access-ctbtv") pod "a4b67acd-31e5-4a37-a3fb-539aefa67fbd" (UID: "a4b67acd-31e5-4a37-a3fb-539aefa67fbd"). InnerVolumeSpecName "kube-api-access-ctbtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 15:03:25.152478 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.152452 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z"] Jul 05 15:03:25.155068 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:03:25.155040 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6e52d8_3b2a_41f5_af32_73232b777519.slice/crio-78962808095e122b98faee41a5c219a2f434e00bfb989a866e258f5ce1534dfc WatchSource:0}: Error finding container 78962808095e122b98faee41a5c219a2f434e00bfb989a866e258f5ce1534dfc: Status 404 returned error can't find the container with id 78962808095e122b98faee41a5c219a2f434e00bfb989a866e258f5ce1534dfc Jul 05 15:03:25.160617 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.160577 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e12f24-6f6d-4d99-b771-174893bcb648-extensions-socket-volume\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:25.160617 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.160614 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8zl\" (UniqueName: \"kubernetes.io/projected/05e12f24-6f6d-4d99-b771-174893bcb648-kube-api-access-wv8zl\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:25.160722 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.160630 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctbtv\" (UniqueName: \"kubernetes.io/projected/a4b67acd-31e5-4a37-a3fb-539aefa67fbd-kube-api-access-ctbtv\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:25.166355 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.166331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x"] Jul 05 15:03:25.168861 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:03:25.168836 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff63b4c_99d8_42e3_9b53_ed1fdfb1d449.slice/crio-4a417460502dad88c9ea0d70c9ca1028f75f1e8f13236ec476fc8e36f2e4ca54 WatchSource:0}: Error finding container 4a417460502dad88c9ea0d70c9ca1028f75f1e8f13236ec476fc8e36f2e4ca54: Status 404 returned error can't find the container with id 4a417460502dad88c9ea0d70c9ca1028f75f1e8f13236ec476fc8e36f2e4ca54 Jul 05 15:03:25.281286 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:25.281252 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:25.283172 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:25.283149 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:25.284903 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:25.284884 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-244tg\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-244tg" Jul 05 15:03:25.286483 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:25.286461 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2n9cv\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2n9cv" Jul 05 15:03:25.377523 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.377489 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e12f24-6f6d-4d99-b771-174893bcb648" path="/var/lib/kubelet/pods/05e12f24-6f6d-4d99-b771-174893bcb648/volumes" Jul 05 15:03:25.377911 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.377892 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b67acd-31e5-4a37-a3fb-539aefa67fbd" path="/var/lib/kubelet/pods/a4b67acd-31e5-4a37-a3fb-539aefa67fbd/volumes" Jul 05 15:03:25.491035 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:25.491000 2578 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 05 15:03:25.491035 ip-10-0-128-154 kubenswrapper[2578]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9ds2z_kuadrant-system_527bd387-620d-40ad-9a35-ec1963e73134_0(362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9ds2z to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3" Netns:"/var/run/netns/ae8d345c-e18e-474b-a9ff-5b82bf146193" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-9ds2z;K8S_POD_INFRA_CONTAINER_ID=362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3;K8S_POD_UID=527bd387-620d-40ad-9a35-ec1963e73134" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z/527bd387-620d-40ad-9a35-ec1963e73134:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z 362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z 362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-9ds2z" not found Jul 05 15:03:25.491035 ip-10-0-128-154 kubenswrapper[2578]: ' Jul 05 15:03:25.491035 ip-10-0-128-154 kubenswrapper[2578]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 05 15:03:25.491035 ip-10-0-128-154 kubenswrapper[2578]: > Jul 05 15:03:25.491312 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:25.491060 2578 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 05 15:03:25.491312 ip-10-0-128-154 kubenswrapper[2578]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-9ds2z_kuadrant-system_527bd387-620d-40ad-9a35-ec1963e73134_0(362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-9ds2z to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3" Netns:"/var/run/netns/ae8d345c-e18e-474b-a9ff-5b82bf146193" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-9ds2z;K8S_POD_INFRA_CONTAINER_ID=362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3;K8S_POD_UID=527bd387-620d-40ad-9a35-ec1963e73134" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z/527bd387-620d-40ad-9a35-ec1963e73134:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z 362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z 362e5ec1fa1a8d9e150373c94a697ebf8a31ab0e375e330925e6f380a1cebca3 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-9ds2z" not found Jul 05 15:03:25.491312 ip-10-0-128-154 kubenswrapper[2578]: ' Jul 05 15:03:25.491312 ip-10-0-128-154 kubenswrapper[2578]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 05 15:03:25.491312 ip-10-0-128-154 kubenswrapper[2578]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:25.975695 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.975664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" event={"ID":"6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449","Type":"ContainerStarted","Data":"e060d8c04539100a82a4747cd7407377e995ae2ab98b076de2b8c8d23ac248d5"} Jul 05 15:03:25.975925 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.975728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" event={"ID":"6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449","Type":"ContainerStarted","Data":"4a417460502dad88c9ea0d70c9ca1028f75f1e8f13236ec476fc8e36f2e4ca54"} Jul 05 15:03:25.975925 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.975758 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:25.978164 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.978139 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:25.978292 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.978182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" event={"ID":"db6e52d8-3b2a-41f5-af32-73232b777519","Type":"ContainerStarted","Data":"83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b"} Jul 05 15:03:25.978292 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.978230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" event={"ID":"db6e52d8-3b2a-41f5-af32-73232b777519","Type":"ContainerStarted","Data":"78962808095e122b98faee41a5c219a2f434e00bfb989a866e258f5ce1534dfc"} Jul 05 15:03:25.985787 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.985769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:25.992613 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:25.992552 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" podStartSLOduration=1.9925350320000002 podStartE2EDuration="1.992535032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:03:25.992270751 +0000 UTC m=+399.052466710" watchObservedRunningTime="2026-07-05 15:03:25.992535032 +0000 UTC m=+399.052730993" Jul 05 15:03:26.017993 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.017932 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" podStartSLOduration=2.017919594 podStartE2EDuration="2.017919594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:03:26.016193346 +0000 UTC m=+399.076389453" watchObservedRunningTime="2026-07-05 15:03:26.017919594 +0000 UTC m=+399.078115553" Jul 05 15:03:26.018111 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:26.018067 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="527bd387-620d-40ad-9a35-ec1963e73134" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:26.168702 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.168369 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdpzj\" (UniqueName: \"kubernetes.io/projected/527bd387-620d-40ad-9a35-ec1963e73134-kube-api-access-rdpzj\") pod \"527bd387-620d-40ad-9a35-ec1963e73134\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " Jul 05 15:03:26.168702 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.168430 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/527bd387-620d-40ad-9a35-ec1963e73134-extensions-socket-volume\") pod \"527bd387-620d-40ad-9a35-ec1963e73134\" (UID: \"527bd387-620d-40ad-9a35-ec1963e73134\") " Jul 05 15:03:26.168945 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.168918 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/527bd387-620d-40ad-9a35-ec1963e73134-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "527bd387-620d-40ad-9a35-ec1963e73134" (UID: "527bd387-620d-40ad-9a35-ec1963e73134"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 15:03:26.171476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.171447 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527bd387-620d-40ad-9a35-ec1963e73134-kube-api-access-rdpzj" (OuterVolumeSpecName: "kube-api-access-rdpzj") pod "527bd387-620d-40ad-9a35-ec1963e73134" (UID: "527bd387-620d-40ad-9a35-ec1963e73134"). InnerVolumeSpecName "kube-api-access-rdpzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 15:03:26.270001 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.269932 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdpzj\" (UniqueName: \"kubernetes.io/projected/527bd387-620d-40ad-9a35-ec1963e73134-kube-api-access-rdpzj\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:26.270001 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.269957 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/527bd387-620d-40ad-9a35-ec1963e73134-extensions-socket-volume\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:26.981571 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.981539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:26.982062 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:26.981663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:26.983609 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:26.983576 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="527bd387-620d-40ad-9a35-ec1963e73134" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:26.989116 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:26.989091 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="527bd387-620d-40ad-9a35-ec1963e73134" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:27.373342 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:27.373256 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-9ds2z\" is forbidden: User \"system:node:ip-10-0-128-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-154.ec2.internal' and this object" podUID="527bd387-620d-40ad-9a35-ec1963e73134" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-9ds2z" Jul 05 15:03:27.375505 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:27.375480 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527bd387-620d-40ad-9a35-ec1963e73134" path="/var/lib/kubelet/pods/527bd387-620d-40ad-9a35-ec1963e73134/volumes" Jul 05 15:03:36.984271 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:36.984240 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-crm5x" Jul 05 15:03:37.987995 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:37.987968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:53.461693 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.461660 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z"] Jul 05 15:03:53.462200 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.461846 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" podUID="db6e52d8-3b2a-41f5-af32-73232b777519" containerName="manager" containerID="cri-o://83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b" gracePeriod=10 Jul 05 15:03:53.690964 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.690934 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z"] Jul 05 15:03:53.693210 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.693192 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:53.704466 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.704446 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:53.710463 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.710437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z"] Jul 05 15:03:53.766855 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.766800 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsxn2\" (UniqueName: \"kubernetes.io/projected/db6e52d8-3b2a-41f5-af32-73232b777519-kube-api-access-rsxn2\") pod \"db6e52d8-3b2a-41f5-af32-73232b777519\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " Jul 05 15:03:53.766952 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.766865 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6e52d8-3b2a-41f5-af32-73232b777519-extensions-socket-volume\") pod \"db6e52d8-3b2a-41f5-af32-73232b777519\" (UID: \"db6e52d8-3b2a-41f5-af32-73232b777519\") " Jul 05 15:03:53.767088 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.767053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99e7cf26-0f57-446d-b728-df6d3815ebdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7sf2z\" (UID: \"99e7cf26-0f57-446d-b728-df6d3815ebdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:53.767191 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.767100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8jh\" (UniqueName: \"kubernetes.io/projected/99e7cf26-0f57-446d-b728-df6d3815ebdc-kube-api-access-dw8jh\") pod \"kuadrant-operator-controller-manager-86878c769f-7sf2z\" (UID: \"99e7cf26-0f57-446d-b728-df6d3815ebdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:53.767232 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.767193 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6e52d8-3b2a-41f5-af32-73232b777519-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db6e52d8-3b2a-41f5-af32-73232b777519" (UID: "db6e52d8-3b2a-41f5-af32-73232b777519"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 15:03:53.768975 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.768949 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6e52d8-3b2a-41f5-af32-73232b777519-kube-api-access-rsxn2" (OuterVolumeSpecName: "kube-api-access-rsxn2") pod "db6e52d8-3b2a-41f5-af32-73232b777519" (UID: "db6e52d8-3b2a-41f5-af32-73232b777519"). InnerVolumeSpecName "kube-api-access-rsxn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 15:03:53.867733 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.867698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99e7cf26-0f57-446d-b728-df6d3815ebdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7sf2z\" (UID: \"99e7cf26-0f57-446d-b728-df6d3815ebdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:53.867733 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.867737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8jh\" (UniqueName: \"kubernetes.io/projected/99e7cf26-0f57-446d-b728-df6d3815ebdc-kube-api-access-dw8jh\") pod \"kuadrant-operator-controller-manager-86878c769f-7sf2z\" (UID: \"99e7cf26-0f57-446d-b728-df6d3815ebdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:53.867912 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.867778 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db6e52d8-3b2a-41f5-af32-73232b777519-extensions-socket-volume\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:53.867912 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.867791 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsxn2\" (UniqueName: \"kubernetes.io/projected/db6e52d8-3b2a-41f5-af32-73232b777519-kube-api-access-rsxn2\") on node \"ip-10-0-128-154.ec2.internal\" DevicePath \"\"" Jul 05 15:03:53.868054 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.868034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99e7cf26-0f57-446d-b728-df6d3815ebdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7sf2z\" (UID: \"99e7cf26-0f57-446d-b728-df6d3815ebdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:53.876586 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:53.876562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8jh\" (UniqueName: \"kubernetes.io/projected/99e7cf26-0f57-446d-b728-df6d3815ebdc-kube-api-access-dw8jh\") pod \"kuadrant-operator-controller-manager-86878c769f-7sf2z\" (UID: \"99e7cf26-0f57-446d-b728-df6d3815ebdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:54.012493 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.012457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:54.097095 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.097067 2578 generic.go:356] "Generic (PLEG): container finished" podID="db6e52d8-3b2a-41f5-af32-73232b777519" containerID="83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b" exitCode=0 Jul 05 15:03:54.097229 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.097126 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" Jul 05 15:03:54.097229 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.097143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" event={"ID":"db6e52d8-3b2a-41f5-af32-73232b777519","Type":"ContainerDied","Data":"83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b"} Jul 05 15:03:54.097229 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.097217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z" event={"ID":"db6e52d8-3b2a-41f5-af32-73232b777519","Type":"ContainerDied","Data":"78962808095e122b98faee41a5c219a2f434e00bfb989a866e258f5ce1534dfc"} Jul 05 15:03:54.097393 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.097251 2578 scope.go:117] "RemoveContainer" containerID="83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b" Jul 05 15:03:54.106043 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.106022 2578 scope.go:117] "RemoveContainer" containerID="83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b" Jul 05 15:03:54.106331 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:03:54.106306 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b\": container with ID starting with 83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b not found: ID does not exist" containerID="83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b" Jul 05 15:03:54.106415 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.106342 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b"} err="failed to get container status \"83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b\": rpc error: code = NotFound desc = could not find container \"83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b\": container with ID starting with 83961d236778a28d7a2e9d93182691c210fd51ec968b5d271f73d84b336e067b not found: ID does not exist" Jul 05 15:03:54.124174 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.124152 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z"] Jul 05 15:03:54.132732 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.132712 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xj46z"] Jul 05 15:03:54.143265 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:54.143247 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z"] Jul 05 15:03:54.146195 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:03:54.146175 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e7cf26_0f57_446d_b728_df6d3815ebdc.slice/crio-6b5f162c1d11fef8dfae3c1b46f247b0fe9f828529d058258e65fb640656679a WatchSource:0}: Error finding container 6b5f162c1d11fef8dfae3c1b46f247b0fe9f828529d058258e65fb640656679a: Status 404 returned error can't find the container with id 6b5f162c1d11fef8dfae3c1b46f247b0fe9f828529d058258e65fb640656679a Jul 05 15:03:55.103016 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:55.102981 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" event={"ID":"99e7cf26-0f57-446d-b728-df6d3815ebdc","Type":"ContainerStarted","Data":"b007e3ffb74b272053744c914adaaed8ba02714de8fdf54e60b093420e0efc53"} Jul 05 15:03:55.103379 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:55.103029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" event={"ID":"99e7cf26-0f57-446d-b728-df6d3815ebdc","Type":"ContainerStarted","Data":"6b5f162c1d11fef8dfae3c1b46f247b0fe9f828529d058258e65fb640656679a"} Jul 05 15:03:55.103379 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:55.103106 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:03:55.125584 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:55.125546 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" podStartSLOduration=2.125531862 podStartE2EDuration="2.125531862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:03:55.124895264 +0000 UTC m=+428.185091227" watchObservedRunningTime="2026-07-05 15:03:55.125531862 +0000 UTC m=+428.185727803" Jul 05 15:03:55.375652 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:03:55.375549 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6e52d8-3b2a-41f5-af32-73232b777519" path="/var/lib/kubelet/pods/db6e52d8-3b2a-41f5-af32-73232b777519/volumes" Jul 05 15:04:06.109585 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:06.109553 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7sf2z" Jul 05 15:04:50.985471 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.985434 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77698ff474-rxhvq"] Jul 05 15:04:50.985869 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.985730 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6e52d8-3b2a-41f5-af32-73232b777519" containerName="manager" Jul 05 15:04:50.985869 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.985740 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6e52d8-3b2a-41f5-af32-73232b777519" containerName="manager" Jul 05 15:04:50.985869 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.985804 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db6e52d8-3b2a-41f5-af32-73232b777519" containerName="manager" Jul 05 15:04:50.989805 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.989785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:50.992523 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.992500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 15:04:50.992637 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.992530 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pwll7\"" Jul 05 15:04:50.992637 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:50.992550 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 15:04:51.000529 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.000505 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77698ff474-rxhvq"] Jul 05 15:04:51.005316 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.005292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l55jh\" (UniqueName: \"kubernetes.io/projected/238f5595-b4b8-4a8b-9fbe-afab8277521a-kube-api-access-l55jh\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.005422 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.005361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/238f5595-b4b8-4a8b-9fbe-afab8277521a-webhook-cert\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.106206 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.106157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/238f5595-b4b8-4a8b-9fbe-afab8277521a-webhook-cert\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.106377 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.106225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l55jh\" (UniqueName: \"kubernetes.io/projected/238f5595-b4b8-4a8b-9fbe-afab8277521a-kube-api-access-l55jh\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.106377 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:04:51.106308 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 05 15:04:51.106447 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:04:51.106383 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238f5595-b4b8-4a8b-9fbe-afab8277521a-webhook-cert podName:238f5595-b4b8-4a8b-9fbe-afab8277521a nodeName:}" failed. No retries permitted until 2026-07-05 15:04:51.606364913 +0000 UTC m=+484.666560872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/238f5595-b4b8-4a8b-9fbe-afab8277521a-webhook-cert") pod "maas-controller-77698ff474-rxhvq" (UID: "238f5595-b4b8-4a8b-9fbe-afab8277521a") : secret "maas-controller-webhook-cert" not found Jul 05 15:04:51.116716 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.116673 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l55jh\" (UniqueName: \"kubernetes.io/projected/238f5595-b4b8-4a8b-9fbe-afab8277521a-kube-api-access-l55jh\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.176609 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.176556 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dc9468f45-tlf6x"] Jul 05 15:04:51.179727 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.179712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.200629 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.200584 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dc9468f45-tlf6x"] Jul 05 15:04:51.207368 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.207345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c75ad68a-4682-4fcd-964d-571be0c0f0dd-webhook-cert\") pod \"maas-controller-6dc9468f45-tlf6x\" (UID: \"c75ad68a-4682-4fcd-964d-571be0c0f0dd\") " pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.207518 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.207375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwb5\" (UniqueName: \"kubernetes.io/projected/c75ad68a-4682-4fcd-964d-571be0c0f0dd-kube-api-access-njwb5\") pod \"maas-controller-6dc9468f45-tlf6x\" (UID: \"c75ad68a-4682-4fcd-964d-571be0c0f0dd\") " pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.308154 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.308085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c75ad68a-4682-4fcd-964d-571be0c0f0dd-webhook-cert\") pod \"maas-controller-6dc9468f45-tlf6x\" (UID: \"c75ad68a-4682-4fcd-964d-571be0c0f0dd\") " pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.308154 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.308118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njwb5\" (UniqueName: \"kubernetes.io/projected/c75ad68a-4682-4fcd-964d-571be0c0f0dd-kube-api-access-njwb5\") pod \"maas-controller-6dc9468f45-tlf6x\" (UID: \"c75ad68a-4682-4fcd-964d-571be0c0f0dd\") " pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.310749 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.310724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c75ad68a-4682-4fcd-964d-571be0c0f0dd-webhook-cert\") pod \"maas-controller-6dc9468f45-tlf6x\" (UID: \"c75ad68a-4682-4fcd-964d-571be0c0f0dd\") " pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.317349 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.317330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwb5\" (UniqueName: \"kubernetes.io/projected/c75ad68a-4682-4fcd-964d-571be0c0f0dd-kube-api-access-njwb5\") pod \"maas-controller-6dc9468f45-tlf6x\" (UID: \"c75ad68a-4682-4fcd-964d-571be0c0f0dd\") " pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.489689 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.489661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:04:51.610525 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.610494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/238f5595-b4b8-4a8b-9fbe-afab8277521a-webhook-cert\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.612867 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.612844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/238f5595-b4b8-4a8b-9fbe-afab8277521a-webhook-cert\") pod \"maas-controller-77698ff474-rxhvq\" (UID: \"238f5595-b4b8-4a8b-9fbe-afab8277521a\") " pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:51.616587 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.616520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dc9468f45-tlf6x"] Jul 05 15:04:51.618578 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:04:51.618559 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75ad68a_4682_4fcd_964d_571be0c0f0dd.slice/crio-db0384c55e82b13023c19665f4dc7a58cd6ce11357f2967a5f107de450e06875 WatchSource:0}: Error finding container db0384c55e82b13023c19665f4dc7a58cd6ce11357f2967a5f107de450e06875: Status 404 returned error can't find the container with id db0384c55e82b13023c19665f4dc7a58cd6ce11357f2967a5f107de450e06875 Jul 05 15:04:51.900768 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:51.900686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:04:52.030347 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:52.030324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77698ff474-rxhvq"] Jul 05 15:04:52.032654 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:04:52.032628 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238f5595_b4b8_4a8b_9fbe_afab8277521a.slice/crio-977e0826e1e1b2b6e190032c221beb7b1fe58a6d003e33db117590c1a8235da0 WatchSource:0}: Error finding container 977e0826e1e1b2b6e190032c221beb7b1fe58a6d003e33db117590c1a8235da0: Status 404 returned error can't find the container with id 977e0826e1e1b2b6e190032c221beb7b1fe58a6d003e33db117590c1a8235da0 Jul 05 15:04:52.337680 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:52.337639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" event={"ID":"c75ad68a-4682-4fcd-964d-571be0c0f0dd","Type":"ContainerStarted","Data":"db0384c55e82b13023c19665f4dc7a58cd6ce11357f2967a5f107de450e06875"} Jul 05 15:04:52.339020 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:52.338996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerStarted","Data":"977e0826e1e1b2b6e190032c221beb7b1fe58a6d003e33db117590c1a8235da0"} Jul 05 15:04:55.354189 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:55.354158 2578 generic.go:356] "Generic (PLEG): container finished" podID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" containerID="624c278c161940ca9956146e620ab7475c3fbbf4dd51be5f889615f444525cf4" exitCode=2 Jul 05 15:04:55.354654 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:55.354258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" event={"ID":"c75ad68a-4682-4fcd-964d-571be0c0f0dd","Type":"ContainerDied","Data":"624c278c161940ca9956146e620ab7475c3fbbf4dd51be5f889615f444525cf4"} Jul 05 15:04:55.354654 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:55.354451 2578 scope.go:117] "RemoveContainer" containerID="624c278c161940ca9956146e620ab7475c3fbbf4dd51be5f889615f444525cf4" Jul 05 15:04:55.355833 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:55.355814 2578 generic.go:356] "Generic (PLEG): container finished" podID="238f5595-b4b8-4a8b-9fbe-afab8277521a" containerID="e4671047f71ef3ca5b4fce09f4a101d5bd3d2ab5b60581f1682ca00cc3d3d913" exitCode=2 Jul 05 15:04:55.355915 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:55.355845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerDied","Data":"e4671047f71ef3ca5b4fce09f4a101d5bd3d2ab5b60581f1682ca00cc3d3d913"} Jul 05 15:04:55.356035 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:55.356021 2578 scope.go:117] "RemoveContainer" containerID="e4671047f71ef3ca5b4fce09f4a101d5bd3d2ab5b60581f1682ca00cc3d3d913" Jul 05 15:04:56.361559 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.361528 2578 generic.go:356] "Generic (PLEG): container finished" podID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" containerID="0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee" exitCode=2 Jul 05 15:04:56.362001 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.361641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" event={"ID":"c75ad68a-4682-4fcd-964d-571be0c0f0dd","Type":"ContainerDied","Data":"0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee"} Jul 05 15:04:56.362001 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.361716 2578 scope.go:117] "RemoveContainer" containerID="624c278c161940ca9956146e620ab7475c3fbbf4dd51be5f889615f444525cf4" Jul 05 15:04:56.362001 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.361864 2578 scope.go:117] "RemoveContainer" containerID="0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee" Jul 05 15:04:56.362165 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:04:56.362076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:04:56.363511 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.363492 2578 generic.go:356] "Generic (PLEG): container finished" podID="238f5595-b4b8-4a8b-9fbe-afab8277521a" containerID="f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b" exitCode=2 Jul 05 15:04:56.363631 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.363540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerDied","Data":"f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b"} Jul 05 15:04:56.363755 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.363740 2578 scope.go:117] "RemoveContainer" containerID="f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b" Jul 05 15:04:56.363897 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:04:56.363883 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:04:56.372410 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:56.372390 2578 scope.go:117] "RemoveContainer" containerID="e4671047f71ef3ca5b4fce09f4a101d5bd3d2ab5b60581f1682ca00cc3d3d913" Jul 05 15:04:57.369140 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:57.369109 2578 scope.go:117] "RemoveContainer" containerID="0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee" Jul 05 15:04:57.369567 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:04:57.369293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:04:57.370639 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:04:57.370617 2578 scope.go:117] "RemoveContainer" containerID="f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b" Jul 05 15:04:57.370819 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:04:57.370797 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:05:01.490136 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:01.490100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:05:01.490531 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:01.490479 2578 scope.go:117] "RemoveContainer" containerID="0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee" Jul 05 15:05:01.490676 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:01.490655 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:05:01.901278 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:01.901188 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:05:01.901654 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:01.901636 2578 scope.go:117] "RemoveContainer" containerID="f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b" Jul 05 15:05:01.901891 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:01.901868 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:05:11.490059 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:11.490010 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:05:11.490430 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:11.490371 2578 scope.go:117] "RemoveContainer" containerID="0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee" Jul 05 15:05:11.901004 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:11.900966 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:05:11.901342 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:11.901330 2578 scope.go:117] "RemoveContainer" containerID="f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b" Jul 05 15:05:12.430997 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.430965 2578 generic.go:356] "Generic (PLEG): container finished" podID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" containerID="6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1" exitCode=2 Jul 05 15:05:12.431116 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.431044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" event={"ID":"c75ad68a-4682-4fcd-964d-571be0c0f0dd","Type":"ContainerDied","Data":"6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1"} Jul 05 15:05:12.431173 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.431113 2578 scope.go:117] "RemoveContainer" containerID="0cc88428497ed0d1eecb8b7d83bdf1f8850aab3ebd36eca580d018db83bd9cee" Jul 05 15:05:12.431483 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.431464 2578 scope.go:117] "RemoveContainer" containerID="6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1" Jul 05 15:05:12.431721 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:12.431703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:05:12.432911 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.432891 2578 generic.go:356] "Generic (PLEG): container finished" podID="238f5595-b4b8-4a8b-9fbe-afab8277521a" containerID="e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb" exitCode=2 Jul 05 15:05:12.432993 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.432956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerDied","Data":"e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb"} Jul 05 15:05:12.433226 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.433214 2578 scope.go:117] "RemoveContainer" containerID="e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb" Jul 05 15:05:12.433374 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:12.433353 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:05:12.441735 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:12.441720 2578 scope.go:117] "RemoveContainer" containerID="f1da2a483d6dbc503ada0a7b9dace9bcc82d5b8998fcf5c011cddf5758c82f3b" Jul 05 15:05:21.490519 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:21.490491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:05:21.491027 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:21.490849 2578 scope.go:117] "RemoveContainer" containerID="6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1" Jul 05 15:05:21.491027 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:21.490989 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:05:21.901498 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:21.901415 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:05:21.901831 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:21.901817 2578 scope.go:117] "RemoveContainer" containerID="e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb" Jul 05 15:05:21.901995 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:21.901975 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:05:31.490160 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:31.490120 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:05:31.490675 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:31.490625 2578 scope.go:117] "RemoveContainer" containerID="6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1" Jul 05 15:05:31.490842 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:31.490821 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:05:31.901590 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:31.901506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:05:31.901872 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:31.901859 2578 scope.go:117] "RemoveContainer" containerID="e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb" Jul 05 15:05:31.902034 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:31.902016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:05:43.370704 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:43.370629 2578 scope.go:117] "RemoveContainer" containerID="6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1" Jul 05 15:05:44.370878 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:44.370846 2578 scope.go:117] "RemoveContainer" containerID="e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb" Jul 05 15:05:44.563538 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:44.563502 2578 generic.go:356] "Generic (PLEG): container finished" podID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" exitCode=2 Jul 05 15:05:44.563756 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:44.563574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" event={"ID":"c75ad68a-4682-4fcd-964d-571be0c0f0dd","Type":"ContainerDied","Data":"2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4"} Jul 05 15:05:44.563756 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:44.563651 2578 scope.go:117] "RemoveContainer" containerID="6a4964ddb7a0d56bc97961f30b44e115ba5ea030c833f41b3bb331027d0119e1" Jul 05 15:05:44.564026 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:44.564008 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:05:44.564213 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:44.564196 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:05:45.570550 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:45.570516 2578 generic.go:356] "Generic (PLEG): container finished" podID="238f5595-b4b8-4a8b-9fbe-afab8277521a" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" exitCode=2 Jul 05 15:05:45.571018 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:45.570587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerDied","Data":"9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f"} Jul 05 15:05:45.571018 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:45.570673 2578 scope.go:117] "RemoveContainer" containerID="e5d3466b4e9f3cea5eb06fc586290d2e416efc1d1ed6141fec48e67d4b72fcbb" Jul 05 15:05:45.571018 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:45.570979 2578 scope.go:117] "RemoveContainer" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" Jul 05 15:05:45.571167 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:45.571149 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:05:51.490292 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:51.490257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:05:51.490713 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:51.490320 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:05:51.490713 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:51.490673 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:05:51.490864 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:51.490845 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:05:51.901400 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:51.901310 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:05:51.901400 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:51.901373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:05:51.901707 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:05:51.901694 2578 scope.go:117] "RemoveContainer" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" Jul 05 15:05:51.901879 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:05:51.901863 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:02.370565 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:02.370534 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:06:02.371052 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:02.370730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:06:07.377760 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:07.377726 2578 scope.go:117] "RemoveContainer" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" Jul 05 15:06:07.378146 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:07.377930 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:16.371333 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:16.371303 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:06:16.371727 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:16.371462 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:06:19.371330 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:19.371303 2578 scope.go:117] "RemoveContainer" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" Jul 05 15:06:19.371718 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:19.371459 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:30.370652 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:30.370588 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:06:31.370787 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:31.370755 2578 scope.go:117] "RemoveContainer" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" Jul 05 15:06:31.751587 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:31.751550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerStarted","Data":"ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce"} Jul 05 15:06:31.751790 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:31.751773 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:06:31.769172 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:31.769117 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77698ff474-rxhvq" podStartSLOduration=98.213286748 podStartE2EDuration="1m41.769096408s" totalImagesPullingTime="3.55580966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 15:04:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:06:31.766792128 +0000 UTC m=+584.826988089" watchObservedRunningTime="2026-07-05 15:06:31.769096408 +0000 UTC m=+584.829292370" Jul 05 15:06:32.757390 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:32.757361 2578 generic.go:356] "Generic (PLEG): container finished" podID="238f5595-b4b8-4a8b-9fbe-afab8277521a" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" exitCode=2 Jul 05 15:06:32.757824 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:32.757458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77698ff474-rxhvq" event={"ID":"238f5595-b4b8-4a8b-9fbe-afab8277521a","Type":"ContainerDied","Data":"ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce"} Jul 05 15:06:32.757824 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:32.757512 2578 scope.go:117] "RemoveContainer" containerID="9e6a4237732c48d84d3c655b65c8a821454b1e89ab9470177ab571db12ee420f" Jul 05 15:06:32.757824 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:32.757664 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:06:32.757944 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:32.757835 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:33.762503 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:33.762470 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:06:33.763005 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:33.762664 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:40.535193 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:40.535147 2578 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-controller@sha256:b779c3d12208e10dda166031b5a4ab63cb8f6e654238a37e1badcc9ed5c8723a: pinging container registry quay.io: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/opendatahub/maas-controller@sha256:b779c3d12208e10dda166031b5a4ab63cb8f6e654238a37e1badcc9ed5c8723a" Jul 05 15:06:40.535563 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:40.535276 2578 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-controller@sha256:b779c3d12208e10dda166031b5a4ab63cb8f6e654238a37e1badcc9ed5c8723a: pinging container registry quay.io: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 05 15:06:40.535563 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:40.535316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-controller@sha256:b779c3d12208e10dda166031b5a4ab63cb8f6e654238a37e1badcc9ed5c8723a: pinging container registry quay.io: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:06:47.372322 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:47.372293 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:06:47.372784 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:47.372498 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:51.901236 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:51.901202 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-77698ff474-rxhvq" Jul 05 15:06:51.903540 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:51.901563 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:06:51.903540 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:51.901748 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:06:54.740740 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:54.740695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pfzcv_6d2e2354-a91b-44cf-9611-09ea1b8f8cc8/manager/0.log" Jul 05 15:06:54.849104 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:54.849076 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dql8h_9944ebf1-85dc-4fb4-95a2-209131e42a65/manager/0.log" Jul 05 15:06:54.958183 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:54.958161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dc9468f45-tlf6x_c75ad68a-4682-4fcd-964d-571be0c0f0dd/manager/3.log" Jul 05 15:06:55.063786 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:55.063727 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77698ff474-rxhvq_238f5595-b4b8-4a8b-9fbe-afab8277521a/manager/4.log" Jul 05 15:06:55.284018 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:55.283993 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l489h_ba25b75d-3155-4bac-bd4c-381cae6b294e/manager/0.log" Jul 05 15:06:55.370467 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:55.370405 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:06:55.370588 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:06:55.370572 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:06:55.512122 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:55.512093 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86749fcdf5-fvpkg_b7a0a782-9869-4e01-9e42-d40f786ab8b5/copy-manifests/0.log" Jul 05 15:06:55.525999 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:55.525970 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86749fcdf5-fvpkg_b7a0a782-9869-4e01-9e42-d40f786ab8b5/manager/0.log" Jul 05 15:06:57.476968 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:57.476944 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7sf2z_99e7cf26-0f57-446d-b728-df6d3815ebdc/manager/0.log" Jul 05 15:06:57.698955 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:57.698923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-crm5x_6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449/manager/0.log" Jul 05 15:06:58.155036 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:58.155008 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rm669_8886ee88-d6f3-47de-a25f-f9310ceff508/discovery/0.log" Jul 05 15:06:58.262995 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:06:58.262969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f8657b479-7vxpv_d5861260-493e-4420-806a-519ed97c1b03/kube-auth-proxy/0.log" Jul 05 15:07:05.760141 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:05.760105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6x6gm_c31a2572-862e-4711-9eba-668336d76999/global-pull-secret-syncer/0.log" Jul 05 15:07:05.905032 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:05.904998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h6x8p_78c93761-12ad-45cc-8378-54b3e1dd22a3/konnectivity-agent/0.log" Jul 05 15:07:05.946561 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:05.946538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-154.ec2.internal_2be5c8aa657a1c0c2e2171dae8c1ff8b/haproxy/0.log" Jul 05 15:07:07.372411 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:07.372359 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:07:07.372797 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:07.372467 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:07:07.372797 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:07:07.372662 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:07:07.899736 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:07.899706 2578 generic.go:356] "Generic (PLEG): container finished" podID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" containerID="b203fe852481ed06412816947be0357ecab2760e95218d8a0174c2e2fe93dd36" exitCode=2 Jul 05 15:07:07.899888 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:07.899744 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" event={"ID":"c75ad68a-4682-4fcd-964d-571be0c0f0dd","Type":"ContainerDied","Data":"b203fe852481ed06412816947be0357ecab2760e95218d8a0174c2e2fe93dd36"} Jul 05 15:07:07.899888 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:07.899800 2578 scope.go:117] "RemoveContainer" containerID="2ccb93d63ad7ba978eb9be7da20142dcb9e965fa29416c7717c5cb81f4e620c4" Jul 05 15:07:07.900141 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:07.900125 2578 scope.go:117] "RemoveContainer" containerID="b203fe852481ed06412816947be0357ecab2760e95218d8a0174c2e2fe93dd36" Jul 05 15:07:07.900329 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:07:07.900309 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:07:10.992947 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:10.992917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7sf2z_99e7cf26-0f57-446d-b728-df6d3815ebdc/manager/0.log" Jul 05 15:07:11.043275 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:11.043249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-crm5x_6ff63b4c-99d8-42e3-9b53-ed1fdfb1d449/manager/0.log" Jul 05 15:07:11.490351 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:11.490325 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:07:11.490518 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:11.490386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" Jul 05 15:07:11.490750 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:11.490737 2578 scope.go:117] "RemoveContainer" containerID="b203fe852481ed06412816947be0357ecab2760e95218d8a0174c2e2fe93dd36" Jul 05 15:07:11.490940 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:07:11.490918 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:07:12.884862 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:12.884826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vd2w_3e0f297c-682f-41c8-973e-5febc26c10d4/node-exporter/0.log" Jul 05 15:07:12.906580 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:12.906558 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vd2w_3e0f297c-682f-41c8-973e-5febc26c10d4/kube-rbac-proxy/0.log" Jul 05 15:07:12.931279 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:12.931258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4vd2w_3e0f297c-682f-41c8-973e-5febc26c10d4/init-textfile/0.log" Jul 05 15:07:15.720717 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.720680 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb"] Jul 05 15:07:15.724044 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.724024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.726067 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.726044 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrx7d\"/\"kube-root-ca.crt\"" Jul 05 15:07:15.726067 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.726063 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrx7d\"/\"openshift-service-ca.crt\"" Jul 05 15:07:15.726202 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.726061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vrx7d\"/\"default-dockercfg-q898k\"" Jul 05 15:07:15.734252 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.734231 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb"] Jul 05 15:07:15.805090 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.805055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-lib-modules\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.805264 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.805097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-proc\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.805264 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.805155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx66q\" (UniqueName: \"kubernetes.io/projected/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-kube-api-access-jx66q\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.805264 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.805192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-sys\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.805264 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.805253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-podres\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906285 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-sys\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-podres\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-lib-modules\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-proc\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906381 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-sys\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx66q\" (UniqueName: \"kubernetes.io/projected/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-kube-api-access-jx66q\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906476 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-proc\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906813 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-podres\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.906813 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.906499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-lib-modules\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:15.914485 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:15.914463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx66q\" (UniqueName: \"kubernetes.io/projected/91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6-kube-api-access-jx66q\") pod \"perf-node-gather-daemonset-dkxkb\" (UID: \"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6\") " pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:16.034455 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:16.034372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:16.169830 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:16.169800 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb"] Jul 05 15:07:16.172407 ip-10-0-128-154 kubenswrapper[2578]: W0705 15:07:16.172380 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91fa2df0_104c_4db3_a37e_b8cf9d6f1bd6.slice/crio-36520e11cd66515e702008afd8764951eae11232f022472ed440b38faad18922 WatchSource:0}: Error finding container 36520e11cd66515e702008afd8764951eae11232f022472ed440b38faad18922: Status 404 returned error can't find the container with id 36520e11cd66515e702008afd8764951eae11232f022472ed440b38faad18922 Jul 05 15:07:16.937423 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:16.937383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" event={"ID":"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6","Type":"ContainerStarted","Data":"b16a8507db063899c2fa845e2838b6d3367999326b7fb5da770b6c8589dd96af"} Jul 05 15:07:16.937821 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:16.937435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" event={"ID":"91fa2df0-104c-4db3-a37e-b8cf9d6f1bd6","Type":"ContainerStarted","Data":"36520e11cd66515e702008afd8764951eae11232f022472ed440b38faad18922"} Jul 05 15:07:16.937821 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:16.937497 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:16.957973 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:16.957931 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" podStartSLOduration=1.9579118210000002 podStartE2EDuration="1.957911821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 15:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 15:07:16.955085135 +0000 UTC m=+630.015281094" watchObservedRunningTime="2026-07-05 15:07:16.957911821 +0000 UTC m=+630.018107782" Jul 05 15:07:18.069916 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:18.069885 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwn6t_08a5afac-d6ec-4cea-9040-e804f8407249/dns/0.log" Jul 05 15:07:18.092278 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:18.092247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jwn6t_08a5afac-d6ec-4cea-9040-e804f8407249/kube-rbac-proxy/0.log" Jul 05 15:07:18.259074 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:18.259034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpgh5_fd4ea5a6-0938-4704-a704-5d9a29d9abae/dns-node-resolver/0.log" Jul 05 15:07:18.857535 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:18.857505 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zczxh_9c2dc84f-f22c-4dc4-89fa-d627bb1c85a0/node-ca/0.log" Jul 05 15:07:19.371377 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:19.371348 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:07:19.371779 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:07:19.371517 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:07:19.808035 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:19.808005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rm669_8886ee88-d6f3-47de-a25f-f9310ceff508/discovery/0.log" Jul 05 15:07:19.830454 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:19.830431 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f8657b479-7vxpv_d5861260-493e-4420-806a-519ed97c1b03/kube-auth-proxy/0.log" Jul 05 15:07:20.472804 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:20.472772 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6tlvz_d07cfc0d-4a3a-4dc1-808f-ccae597a1507/serve-healthcheck-canary/0.log" Jul 05 15:07:20.984933 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:20.984902 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7skl6_348e2aef-aa27-47c2-bc22-7fd980a362fc/kube-rbac-proxy/0.log" Jul 05 15:07:21.006133 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:21.006109 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7skl6_348e2aef-aa27-47c2-bc22-7fd980a362fc/exporter/0.log" Jul 05 15:07:21.031192 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:21.031166 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7skl6_348e2aef-aa27-47c2-bc22-7fd980a362fc/extractor/0.log" Jul 05 15:07:22.951865 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:22.951837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vrx7d/perf-node-gather-daemonset-dkxkb" Jul 05 15:07:23.276800 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.276727 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pfzcv_6d2e2354-a91b-44cf-9611-09ea1b8f8cc8/manager/0.log" Jul 05 15:07:23.303614 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.303572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dql8h_9944ebf1-85dc-4fb4-95a2-209131e42a65/manager/0.log" Jul 05 15:07:23.328730 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.328710 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dc9468f45-tlf6x_c75ad68a-4682-4fcd-964d-571be0c0f0dd/manager/4.log" Jul 05 15:07:23.328861 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.328803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dc9468f45-tlf6x_c75ad68a-4682-4fcd-964d-571be0c0f0dd/manager/4.log" Jul 05 15:07:23.349305 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.349289 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77698ff474-rxhvq_238f5595-b4b8-4a8b-9fbe-afab8277521a/manager/4.log" Jul 05 15:07:23.349406 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.349376 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77698ff474-rxhvq_238f5595-b4b8-4a8b-9fbe-afab8277521a/manager/4.log" Jul 05 15:07:23.415589 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.415566 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l489h_ba25b75d-3155-4bac-bd4c-381cae6b294e/manager/0.log" Jul 05 15:07:23.503934 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.503905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86749fcdf5-fvpkg_b7a0a782-9869-4e01-9e42-d40f786ab8b5/manager/0.log" Jul 05 15:07:23.522300 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:23.522272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86749fcdf5-fvpkg_b7a0a782-9869-4e01-9e42-d40f786ab8b5/copy-manifests/0.log" Jul 05 15:07:24.371138 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:24.371113 2578 scope.go:117] "RemoveContainer" containerID="b203fe852481ed06412816947be0357ecab2760e95218d8a0174c2e2fe93dd36" Jul 05 15:07:24.371434 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:07:24.371265 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=maas-controller-6dc9468f45-tlf6x_opendatahub(c75ad68a-4682-4fcd-964d-571be0c0f0dd)\"" pod="opendatahub/maas-controller-6dc9468f45-tlf6x" podUID="c75ad68a-4682-4fcd-964d-571be0c0f0dd" Jul 05 15:07:25.641762 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:25.641729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rm669_8886ee88-d6f3-47de-a25f-f9310ceff508/discovery/0.log" Jul 05 15:07:25.652241 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:25.652219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f8657b479-7vxpv_d5861260-493e-4420-806a-519ed97c1b03/kube-auth-proxy/0.log" Jul 05 15:07:26.749436 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:26.749412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rm669_8886ee88-d6f3-47de-a25f-f9310ceff508/discovery/0.log" Jul 05 15:07:26.761307 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:26.761290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f8657b479-7vxpv_d5861260-493e-4420-806a-519ed97c1b03/kube-auth-proxy/0.log" Jul 05 15:07:30.052042 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:30.052013 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qjm4h_e6de0c33-d057-4e0f-9e2c-c536965f1897/migrator/0.log" Jul 05 15:07:30.082454 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:30.082426 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qjm4h_e6de0c33-d057-4e0f-9e2c-c536965f1897/graceful-termination/0.log" Jul 05 15:07:31.382251 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.382226 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6wzxm_151b0838-bc2f-4690-bafd-b8a8028d36f3/kube-multus/0.log" Jul 05 15:07:31.592038 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.591960 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/kube-multus-additional-cni-plugins/0.log" Jul 05 15:07:31.612763 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.612736 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/egress-router-binary-copy/0.log" Jul 05 15:07:31.633263 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.633238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/cni-plugins/0.log" Jul 05 15:07:31.654652 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.654632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/bond-cni-plugin/0.log" Jul 05 15:07:31.675368 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.675349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/routeoverride-cni/0.log" Jul 05 15:07:31.700406 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.700389 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/whereabouts-cni-bincopy/0.log" Jul 05 15:07:31.722362 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:31.722342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f6qq4_4c59ee82-412a-471a-9c94-a4b8f04f2d82/whereabouts-cni/0.log" Jul 05 15:07:32.022366 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:32.022341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q5c8q_2fd29184-9ded-433b-8f51-412f90541242/network-metrics-daemon/0.log" Jul 05 15:07:32.044383 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:32.044352 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q5c8q_2fd29184-9ded-433b-8f51-412f90541242/kube-rbac-proxy/0.log" Jul 05 15:07:32.371351 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:32.371263 2578 scope.go:117] "RemoveContainer" containerID="ef5da9cbd7769cf513781f98cd051284e3025c4c7790f141c681a49ade3ab5ce" Jul 05 15:07:32.371519 ip-10-0-128-154 kubenswrapper[2578]: E0705 15:07:32.371478 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-77698ff474-rxhvq_opendatahub(238f5595-b4b8-4a8b-9fbe-afab8277521a)\"" pod="opendatahub/maas-controller-77698ff474-rxhvq" podUID="238f5595-b4b8-4a8b-9fbe-afab8277521a" Jul 05 15:07:33.043611 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.043572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/ovn-controller/0.log" Jul 05 15:07:33.063577 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.063538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/ovn-acl-logging/0.log" Jul 05 15:07:33.087115 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.087092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/kube-rbac-proxy-node/0.log" Jul 05 15:07:33.108569 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.108542 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/kube-rbac-proxy-ovn-metrics/0.log" Jul 05 15:07:33.130640 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.130616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/northd/0.log" Jul 05 15:07:33.152232 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.152211 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/nbdb/0.log" Jul 05 15:07:33.173024 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.172995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/sbdb/0.log" Jul 05 15:07:33.221320 ip-10-0-128-154 kubenswrapper[2578]: I0705 15:07:33.221290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfhn6_7b40bf3d-ad9c-437f-aefd-55c991a1726c/ovnkube-controller/0.log"