Jul 13 18:00:40.110452 ip-10-0-128-48 systemd[1]: Starting Kubernetes Kubelet... Jul 13 18:00:40.563868 ip-10-0-128-48 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 18:00:40.563868 ip-10-0-128-48 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 18:00:40.563868 ip-10-0-128-48 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 18:00:40.563868 ip-10-0-128-48 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 18:00:40.563868 ip-10-0-128-48 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 18:00:40.565140 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.564978 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 18:00:40.573260 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573240 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:00:40.573260 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573258 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:00:40.573260 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573263 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:00:40.573260 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573267 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573272 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573275 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573279 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573300 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573304 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573308 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573312 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573318 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573324 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573329 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573333 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573337 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573341 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573345 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573350 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573354 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573357 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573361 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:00:40.573510 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573364 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573368 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573374 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573380 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573384 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573388 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573392 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573395 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573400 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573404 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573408 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573413 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573417 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573421 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573425 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573430 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573435 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573440 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573456 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:00:40.574168 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573460 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573465 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573469 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573473 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573477 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573481 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573487 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573493 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573498 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573503 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573507 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573512 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573518 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573523 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573527 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573533 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573539 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573543 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573547 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:00:40.574642 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573551 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573555 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573559 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573564 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573568 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573572 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573577 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573583 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573587 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573593 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573597 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573601 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573606 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573618 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573623 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573628 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573632 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573636 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573640 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573644 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573648 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:00:40.575114 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573653 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573657 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573661 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573665 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573669 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573674 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573678 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573682 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573686 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573690 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573694 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573698 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573702 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573706 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573710 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573714 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573719 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:00:40.575895 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.573724 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:00:40.577290 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577268 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:00:40.577290 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577287 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:00:40.577290 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577291 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:00:40.577290 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577294 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577298 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577303 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577308 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577311 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577314 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577317 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577320 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577323 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577326 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577328 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577331 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577334 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577336 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577339 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577342 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577344 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577347 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577349 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:00:40.577429 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577352 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577354 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577356 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577359 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577361 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577364 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577366 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577369 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577380 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577383 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577385 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577387 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577390 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577392 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577395 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577398 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577401 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577408 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577411 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577413 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:00:40.578580 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577416 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577419 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577421 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577424 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577426 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577430 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577432 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577435 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577438 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577441 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577444 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577446 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577449 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577451 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577454 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577456 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577459 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577461 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577464 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577466 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:00:40.579067 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577469 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577472 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577475 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577477 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577480 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577484 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577488 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577491 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577494 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577497 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577499 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577502 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577504 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577506 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577509 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577511 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577513 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577516 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577518 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:00:40.579566 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577520 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577523 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577527 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577529 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577531 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577535 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577539 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577541 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577544 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577546 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577549 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577551 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577553 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577556 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577558 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577560 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577563 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577565 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577956 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577961 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:00:40.580015 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577965 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577968 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577971 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577974 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577976 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577979 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577981 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577984 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577987 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577991 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577994 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577996 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.577999 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578001 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578005 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578007 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578010 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578012 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578015 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:00:40.580537 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578019 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578022 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578025 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578028 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578032 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578035 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578038 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578041 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578043 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578046 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578048 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578050 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578053 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578056 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578058 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578061 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578063 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578065 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578068 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578070 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:00:40.580985 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578073 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578075 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578077 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578080 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578083 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578085 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578087 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578089 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578112 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578115 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578117 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578120 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578122 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578125 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578127 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578130 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578132 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578135 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578138 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:00:40.581489 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578140 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578144 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578148 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578150 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578153 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578156 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578158 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578161 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578163 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578166 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578168 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578170 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578173 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578175 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578177 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578180 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578182 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578185 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578187 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578189 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:00:40.581953 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578192 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578195 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578197 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578200 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578204 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578206 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578209 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578211 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578214 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578216 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578219 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578221 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578224 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578226 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578229 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578231 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578234 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578236 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578239 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578319 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578331 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 18:00:40.582444 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578357 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578363 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578368 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578371 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578375 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578379 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578382 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578385 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578389 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578396 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578399 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578402 2582 flags.go:64] FLAG: --cgroup-root="" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578405 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578408 2582 flags.go:64] FLAG: --client-ca-file="" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578411 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578414 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578419 2582 flags.go:64] FLAG: --cluster-domain="" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578421 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578425 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578427 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578431 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578435 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578438 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 18:00:40.582941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578441 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578449 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578452 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578455 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578458 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578461 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578464 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578468 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578471 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578474 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578476 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578479 2582 flags.go:64] FLAG: --enable-server="true" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578482 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578486 2582 flags.go:64] FLAG: --event-burst="100" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578490 2582 flags.go:64] FLAG: --event-qps="50" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578492 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578495 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578498 2582 flags.go:64] FLAG: --eviction-hard="" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578503 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578506 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578508 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578511 2582 flags.go:64] FLAG: --eviction-soft="" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578514 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578517 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578520 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 18:00:40.583503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578523 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578526 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578529 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578531 2582 flags.go:64] FLAG: --feature-gates="" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578540 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578543 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578546 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578549 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578552 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578555 2582 flags.go:64] FLAG: --help="false" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578558 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578561 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578564 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578567 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578571 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578574 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578577 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578580 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578583 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578586 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578589 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578592 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578595 2582 flags.go:64] FLAG: --kube-reserved="" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578598 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 18:00:40.584177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578600 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578604 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578607 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578609 2582 flags.go:64] FLAG: --lock-file="" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578612 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578615 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578618 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578624 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578627 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578629 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578632 2582 flags.go:64] FLAG: --logging-format="text" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578635 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578638 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578640 2582 flags.go:64] FLAG: --manifest-url="" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578643 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578647 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578650 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578654 2582 flags.go:64] FLAG: --max-pods="110" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578657 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578660 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578662 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578667 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578670 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578672 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578675 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 18:00:40.584772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578682 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578685 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578688 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578691 2582 flags.go:64] FLAG: --pod-cidr="" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578693 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578699 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578702 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578704 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578707 2582 flags.go:64] FLAG: --port="10250" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578710 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578713 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041758ea4f6cb642e" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578717 2582 flags.go:64] FLAG: --qos-reserved="" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578720 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578723 2582 flags.go:64] FLAG: --register-node="true" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578725 2582 flags.go:64] FLAG: --register-with-taints="" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578729 2582 flags.go:64] FLAG: --registry-burst="10" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578735 2582 flags.go:64] FLAG: --registry-qps="5" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578738 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578741 2582 flags.go:64] FLAG: --reserved-memory="" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578744 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578747 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578750 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578753 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578755 2582 flags.go:64] FLAG: --runonce="false" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578758 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 18:00:40.585439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578761 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578764 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578766 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578770 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578773 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578776 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578779 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578781 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578784 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578787 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578789 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578792 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578795 2582 flags.go:64] FLAG: --system-cgroups="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578797 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578802 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578805 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578808 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578812 2582 flags.go:64] FLAG: --tls-min-version="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578814 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578817 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578819 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578822 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578825 2582 flags.go:64] FLAG: --v="2" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578828 2582 flags.go:64] FLAG: --version="false" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578833 2582 flags.go:64] FLAG: --vmodule="" Jul 13 18:00:40.586071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578837 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.578840 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578963 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578966 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578969 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578972 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578975 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578977 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578980 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578983 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578986 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578989 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578991 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578994 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578996 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.578998 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579001 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579003 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579007 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579010 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:00:40.586809 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579014 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579017 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579020 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579023 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579025 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579028 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579030 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579033 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579035 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579038 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579040 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579042 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579045 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579048 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579050 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579052 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579055 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579057 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579060 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579062 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:00:40.587313 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579064 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579067 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579071 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579074 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579077 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579081 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579084 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579086 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579089 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579106 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579110 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579112 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579115 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579117 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579120 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579124 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579126 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579129 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579131 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:00:40.587830 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579134 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579136 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579139 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579142 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579144 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579146 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579149 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579152 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579155 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579157 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579160 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579162 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579164 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579167 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579169 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579173 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579175 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579178 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579180 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579183 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:00:40.588361 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579185 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579187 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579190 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579194 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579197 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579200 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579202 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579205 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579209 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579211 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579214 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579216 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579219 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579221 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579224 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579226 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579229 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579231 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579233 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579236 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:00:40.588842 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579239 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.579241 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.579247 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.587222 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.587238 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.587258 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.587264 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587338 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587344 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587347 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587350 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587353 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587356 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587359 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587362 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:00:40.589347 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587365 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587368 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587371 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587373 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587376 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587379 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587382 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587384 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587387 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587390 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587392 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587394 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587397 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587400 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587402 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587406 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587411 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587415 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587418 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:00:40.589716 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587421 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587424 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587427 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587430 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587433 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587436 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587439 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587441 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587444 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587447 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587449 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587452 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587455 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587457 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587460 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587463 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587465 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587467 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587470 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587473 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:00:40.590203 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587475 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587478 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587480 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587483 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587485 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587488 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587490 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587492 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587495 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587497 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587503 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587506 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587508 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587510 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587513 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587516 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587519 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587521 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587523 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587526 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:00:40.590702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587528 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587531 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587533 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587535 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587539 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587543 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587545 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587547 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587550 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587552 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587554 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587557 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587559 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587561 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587564 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587566 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587569 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587571 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587574 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:00:40.591301 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587576 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587579 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587582 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587584 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587593 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587596 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587599 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587602 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587605 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587607 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587610 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587612 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587615 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.587620 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587762 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:00:40.591752 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587767 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587770 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587773 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587776 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587779 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587782 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587785 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587788 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587791 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587793 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587796 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587798 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587801 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587803 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587805 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587808 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587810 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587813 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587815 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587818 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:00:40.592183 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587820 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587823 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587829 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587831 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587834 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587837 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587840 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587842 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587845 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587847 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587850 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587852 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587854 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587857 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587859 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587861 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587865 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587868 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587870 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:00:40.592730 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587873 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587876 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587878 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587881 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587884 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587886 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587889 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587891 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587893 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587897 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587900 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587903 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587905 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587908 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587910 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587913 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587916 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587919 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587921 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587924 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:00:40.593243 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587926 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587928 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587931 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587933 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587935 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587938 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587940 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587943 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587945 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587947 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587950 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587952 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587955 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587957 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587960 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587962 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587964 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587967 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587969 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587971 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:00:40.594033 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587974 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587976 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587979 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587981 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587984 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587986 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587988 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587991 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587993 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587996 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.587999 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588001 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588003 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588006 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588008 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588010 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588013 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588017 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:00:40.594738 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:40.588020 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.588025 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.588163 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.590488 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.592025 2582 server.go:1019] "Starting client certificate rotation" Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.592142 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.592195 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 18:00:40.595214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.594862 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 18:00:40.597129 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.597085 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 18:00:40.607345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.607326 2582 log.go:25] "Validated CRI v1 runtime API" Jul 13 18:00:40.609712 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.609698 2582 log.go:25] "Validated CRI v1 image API" Jul 13 18:00:40.610441 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.610423 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 18:00:40.614020 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.614001 2582 fs.go:135] Filesystem UUIDs: map[6e9256e5-02c9-4544-a76f-69e2b5182c55:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d5af85d3-12bb-4755-a32f-a0ccf227d470:/dev/nvme0n1p3] Jul 13 18:00:40.614073 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.614020 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 18:00:40.620300 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.620169 2582 manager.go:216] Machine: {Timestamp:2026-07-13 18:00:40.619637888 +0000 UTC m=+0.381448650 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098760 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2043b3937b752165a2c07a0641f52a SystemUUID:ec2043b3-937b-7521-65a2-c07a0641f52a BootID:58df52dc-bee4-40a0-8942-bfdd4c914073 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9d:0d:7f:04:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9d:0d:7f:04:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:c1:3b:86:b1:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 18:00:40.620300 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.620294 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 18:00:40.620422 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.620381 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 18:00:40.624000 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.623975 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 18:00:40.624163 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.624004 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 18:00:40.624842 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.624831 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 18:00:40.624874 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.624845 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 18:00:40.624874 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.624853 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 18:00:40.625780 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.625770 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 18:00:40.626561 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.626545 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 18:00:40.627529 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.627519 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 18:00:40.631696 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631684 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 13 18:00:40.631816 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631806 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 18:00:40.631856 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631836 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 13 18:00:40.631856 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631853 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 18:00:40.631918 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631868 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 18:00:40.631918 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631877 2582 kubelet.go:398] "Adding apiserver pod source" Jul 13 18:00:40.631918 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.631886 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 18:00:40.632273 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.632262 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 18:00:40.632316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.632280 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 18:00:40.634639 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.634620 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 18:00:40.637188 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.637173 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 18:00:40.637256 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.637203 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 18:00:40.638132 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638120 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638139 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638145 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638151 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638160 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638167 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638175 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638180 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 18:00:40.638189 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638194 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 18:00:40.638402 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638200 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 18:00:40.638402 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638209 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 18:00:40.638402 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.638214 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 18:00:40.639916 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.639904 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 18:00:40.639916 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.639914 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 18:00:40.642961 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.642948 2582 server.go:1268] "Started kubelet" Jul 13 18:00:40.643054 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.643016 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 18:00:40.643120 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.643020 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 18:00:40.643187 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.643132 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 18:00:40.643801 ip-10-0-128-48 systemd[1]: Started Kubernetes Kubelet. Jul 13 18:00:40.644682 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.644576 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 18:00:40.646357 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.646341 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 13 18:00:40.647057 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.647031 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 18:00:40.647150 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.647082 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 18:00:40.647433 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.647405 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 18:00:40.648956 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.648933 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 18:00:40.652300 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.652285 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 18:00:40.652391 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.652283 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 18:00:40.652391 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.652385 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:40.652810 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.651671 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-48.ec2.internal.18c1eb4c5e05fd8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-48.ec2.internal,UID:ip-10-0-128-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-48.ec2.internal,},FirstTimestamp:2026-07-13 18:00:40.642919821 +0000 UTC m=+0.404730581,LastTimestamp:2026-07-13 18:00:40.642919821 +0000 UTC m=+0.404730581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-48.ec2.internal,}" Jul 13 18:00:40.653017 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.652999 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 18:00:40.653115 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653001 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 18:00:40.653115 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653030 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 18:00:40.653115 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653111 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 13 18:00:40.653255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653122 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 13 18:00:40.653255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653125 2582 factory.go:55] Registering systemd factory Jul 13 18:00:40.653255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653140 2582 factory.go:223] Registration of the systemd container factory successfully Jul 13 18:00:40.653515 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653489 2582 factory.go:153] Registering CRI-O factory Jul 13 18:00:40.653515 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653506 2582 factory.go:223] Registration of the crio container factory successfully Jul 13 18:00:40.653652 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653558 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 18:00:40.653652 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653580 2582 factory.go:103] Registering Raw factory Jul 13 18:00:40.653652 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.653593 2582 manager.go:1196] Started watching for new ooms in manager Jul 13 18:00:40.654035 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.654017 2582 manager.go:349] Starting recovery of all containers Jul 13 18:00:40.656932 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.656860 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 18:00:40.657124 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.657047 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 18:00:40.662026 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.662007 2582 manager.go:354] Recovery completed Jul 13 18:00:40.666817 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.666801 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.668780 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.668704 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxh7z" Jul 13 18:00:40.669033 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669019 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.669085 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669049 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.669085 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669059 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.669665 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669651 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 18:00:40.669665 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669663 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.669804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669665 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 18:00:40.669804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.669730 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 13 18:00:40.670383 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.670368 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.670459 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.670393 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.670459 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.670404 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.670873 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.670861 2582 policy_none.go:49] "None policy: Start" Jul 13 18:00:40.670910 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.670877 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 18:00:40.670910 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.670887 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 18:00:40.671364 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.671300 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-48.ec2.internal.18c1eb4c5f9479cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-48.ec2.internal,UID:ip-10-0-128-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-48.ec2.internal,},FirstTimestamp:2026-07-13 18:00:40.669034956 +0000 UTC m=+0.430845717,LastTimestamp:2026-07-13 18:00:40.669034956 +0000 UTC m=+0.430845717,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-48.ec2.internal,}" Jul 13 18:00:40.671915 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.671904 2582 policy_none.go:47] "Start" Jul 13 18:00:40.676761 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.676743 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxh7z" Jul 13 18:00:40.680802 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.680742 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-48.ec2.internal.18c1eb4c5f94c51a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-48.ec2.internal,UID:ip-10-0-128-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-48.ec2.internal,},FirstTimestamp:2026-07-13 18:00:40.669054234 +0000 UTC m=+0.430864995,LastTimestamp:2026-07-13 18:00:40.669054234 +0000 UTC m=+0.430864995,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-48.ec2.internal,}" Jul 13 18:00:40.709953 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.709792 2582 manager.go:337] "Starting Device Plugin manager" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.709981 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.709995 2582 server.go:87] "Starting device plugin registration server" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.710231 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.710243 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.710404 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.710492 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.710503 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.710990 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 18:00:40.720792 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.711037 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:40.722021 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.722000 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 18:00:40.723346 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.723323 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 18:00:40.723443 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.723361 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 18:00:40.723443 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.723380 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 18:00:40.723443 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.723414 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 18:00:40.724903 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.724887 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:00:40.810861 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.810774 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.811754 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.811734 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.811865 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.811765 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.811865 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.811775 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.811865 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.811807 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.820276 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.820257 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.820380 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.820284 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-48.ec2.internal\": node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:40.824007 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.823987 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"] Jul 13 18:00:40.824112 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.824045 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.824804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.824789 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.824858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.824818 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.824858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.824828 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.825964 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.825953 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.826075 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.826123 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826080 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.826653 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826637 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.826769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826655 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.826769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826668 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.826769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826674 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.826769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826681 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.826769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.826683 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.830145 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.830130 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.830196 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.830155 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:40.835283 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.835255 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:40.835359 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.835289 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:40.835359 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.835304 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:40.847129 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.847116 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:40.854594 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.854571 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.854657 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.854614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.854657 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.854630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc266b970294ca7e6b02e58f7dfbfaf7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"fc266b970294ca7e6b02e58f7dfbfaf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.864946 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.864924 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.869485 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.869470 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.947735 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:40.947704 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:40.955040 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.955010 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.955133 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.955049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.955133 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.955067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc266b970294ca7e6b02e58f7dfbfaf7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"fc266b970294ca7e6b02e58f7dfbfaf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.955210 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.955135 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc266b970294ca7e6b02e58f7dfbfaf7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"fc266b970294ca7e6b02e58f7dfbfaf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.955210 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.955136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:40.955210 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:40.955138 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:41.048250 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.048220 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.149087 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.149018 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.167475 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.167441 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:41.173550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.173525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" Jul 13 18:00:41.249685 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.249651 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.350237 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.350212 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.450770 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.450691 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.551400 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.551365 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.591831 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.591797 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 18:00:41.592346 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.591982 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 18:00:41.652004 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.651979 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.680751 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.680711 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:55:41 +0000 UTC" deadline="2028-03-15 07:06:59.061590686 +0000 UTC" Jul 13 18:00:41.680751 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.680749 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14653h6m17.380846711s" Jul 13 18:00:41.701288 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.701232 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:00:41.729249 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:41.729218 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc266b970294ca7e6b02e58f7dfbfaf7.slice/crio-9590276be2702083a7ce9b695536e19e818012e2eda7e34c29838f690aff959f WatchSource:0}: Error finding container 9590276be2702083a7ce9b695536e19e818012e2eda7e34c29838f690aff959f: Status 404 returned error can't find the container with id 9590276be2702083a7ce9b695536e19e818012e2eda7e34c29838f690aff959f Jul 13 18:00:41.729920 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:41.729897 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41c40da60a15333861b842213a29712.slice/crio-2eca5a6e039a942e7685b1e157c1337aefe3e71a978a4c404045a590fcb98839 WatchSource:0}: Error finding container 2eca5a6e039a942e7685b1e157c1337aefe3e71a978a4c404045a590fcb98839: Status 404 returned error can't find the container with id 2eca5a6e039a942e7685b1e157c1337aefe3e71a978a4c404045a590fcb98839 Jul 13 18:00:41.736830 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.736811 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 18:00:41.752146 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.752123 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.777419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.777397 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:00:41.778571 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.778546 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:00:41.778660 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.778583 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:00:41.778660 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.778597 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:00:41.853216 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.853182 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:41.863086 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:41.863064 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:00:41.953455 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:41.953373 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:42.053845 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:42.053818 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:42.154592 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:42.154555 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found" Jul 13 18:00:42.183955 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:42.183931 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:00:43.295967 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.295664 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" Jul 13 18:00:43.313467 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.313438 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 18:00:43.314547 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.314515 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" Jul 13 18:00:43.327144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.327118 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 18:00:43.676517 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.676434 2582 apiserver.go:52] "Watching apiserver" Jul 13 18:00:43.685471 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.685447 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 18:00:43.685891 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.685853 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal","openshift-multus/multus-additional-cni-plugins-vx5kv","openshift-multus/network-metrics-daemon-n29xm","openshift-ovn-kubernetes/ovnkube-node-x6t7r","kube-system/konnectivity-agent-l25h6","openshift-cluster-node-tuning-operator/tuned-5tbdq","openshift-dns/node-resolver-zc5p7","openshift-image-registry/node-ca-nq9lq","openshift-multus/multus-g5nsv","openshift-network-diagnostics/network-check-target-7tq6k","openshift-network-operator/iptables-alerter-954lp","kube-system/global-pull-secret-syncer-tszs5","kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"] Jul 13 18:00:43.687492 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.687469 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.688812 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.688790 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:43.688914 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.688893 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:43.690927 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.690459 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.690927 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.690851 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:43.691896 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.691868 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:43.692387 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.692079 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 18:00:43.692387 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.692087 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 18:00:43.692387 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.692097 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.692580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.692441 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8thzr\"" Jul 13 18:00:43.692580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.692499 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.693178 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.693163 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.693638 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.693617 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k4fhg\"" Jul 13 18:00:43.693816 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.693801 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.693899 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.693842 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 18:00:43.694104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.694085 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.694943 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.694619 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.695713 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.695693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.696250 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.696463 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.696602 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.696737 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zn2z4\"" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.696945 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.697367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.697432 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.697426 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.697846 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.698073 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.698176 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.698238 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.698464 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.698496 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 18:00:43.699666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.698701 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h9ntj\"" Jul 13 18:00:43.700199 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.699787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.700804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.700534 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.700804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.700565 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xqrgp\"" Jul 13 18:00:43.700804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.700644 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 18:00:43.701923 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.701907 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.702378 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.702346 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.702477 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.702424 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xs487\"" Jul 13 18:00:43.702628 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.702610 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 18:00:43.702628 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.702624 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.703308 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.703290 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.704250 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.704231 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.704843 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.704823 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.704980 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.704961 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.705372 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.705356 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2gwt\"" Jul 13 18:00:43.705941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.705924 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 18:00:43.705995 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.705981 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66pdj\"" Jul 13 18:00:43.706133 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706118 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 18:00:43.706342 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-node-log\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706399 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706399 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-cni-bin\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706493 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706417 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/f2931846-13fd-4ad3-a897-e70445e592bd-kube-api-access-5lmqc\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.706493 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:43.706493 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjg7\" (UniqueName: \"kubernetes.io/projected/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-kube-api-access-vfjg7\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:43.706636 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-serviceca\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.706636 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706542 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-log-socket\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706636 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-cni-netd\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706636 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706609 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706818 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706680 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovnkube-script-lib\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706818 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-kubelet\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706910 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706823 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-systemd\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706910 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-var-lib-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.706910 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-env-overrides\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.707020 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706916 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31f73a1a-a36f-4a68-86c4-6b1439356b48-dbus\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.707020 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-multus-certs\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.707575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.706978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-run-netns\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.707659 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707597 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-ovn\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.707659 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.707659 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-system-cni-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.707809 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707669 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-netns\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.707809 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707732 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c9d46b2-989f-48f1-9c78-03141820208f-multus-daemon-config\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.707809 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovnkube-config\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.707952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31f73a1a-a36f-4a68-86c4-6b1439356b48-kubelet-config\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.707952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 18:00:43.707952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707882 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-cni-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.707952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707910 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c9d46b2-989f-48f1-9c78-03141820208f-cni-binary-copy\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.707952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-k8s-cni-cncf-io\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.707993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-cni-multus\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-kubelet\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-hostroot\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708092 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-etc-kubernetes\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtmnk\" (UniqueName: \"kubernetes.io/projected/6c9d46b2-989f-48f1-9c78-03141820208f-kube-api-access-qtmnk\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-cnibin\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2931846-13fd-4ad3-a897-e70445e592bd-iptables-alerter-script\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708320 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2931846-13fd-4ad3-a897-e70445e592bd-host-slash\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708350 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/160e65f7-afd7-4d9f-a93a-2e675d0b932f-agent-certs\") pod \"konnectivity-agent-l25h6\" (UID: \"160e65f7-afd7-4d9f-a93a-2e675d0b932f\") " pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708374 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-host\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708398 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbnfv\" (UniqueName: \"kubernetes.io/projected/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-kube-api-access-cbnfv\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-slash\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-cni-bin\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-conf-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/160e65f7-afd7-4d9f-a93a-2e675d0b932f-konnectivity-ca\") pod \"konnectivity-agent-l25h6\" (UID: \"160e65f7-afd7-4d9f-a93a-2e675d0b932f\") " pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.708559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-etc-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708140 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708658 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovn-node-metrics-cert\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708680 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw2qz\" (UniqueName: \"kubernetes.io/projected/6a18c05a-4e8e-4527-8fab-4ca60906efe5-kube-api-access-dw2qz\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-os-release\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-socket-dir-parent\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-systemd-units\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.709094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.708752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.709427 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.709138 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-95fx5\"" Jul 13 18:00:43.709427 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.709165 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 18:00:43.734392 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.734364 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tc7b6" Jul 13 18:00:43.744077 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.744052 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tc7b6" Jul 13 18:00:43.746490 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.746472 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:00:43.771885 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.771839 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" event={"ID":"fc266b970294ca7e6b02e58f7dfbfaf7","Type":"ContainerStarted","Data":"9590276be2702083a7ce9b695536e19e818012e2eda7e34c29838f690aff959f"} Jul 13 18:00:43.772790 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.772764 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"b41c40da60a15333861b842213a29712","Type":"ContainerStarted","Data":"2eca5a6e039a942e7685b1e157c1337aefe3e71a978a4c404045a590fcb98839"} Jul 13 18:00:43.796867 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.796833 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 18:00:43.809466 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovnkube-config\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.809466 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809477 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-kubernetes\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysctl-conf\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-var-lib-kubelet\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-os-release\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a054bc5d-3d61-4b56-b677-6071a37cfa1d-tmp-dir\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c9d46b2-989f-48f1-9c78-03141820208f-cni-binary-copy\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-k8s-cni-cncf-io\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809665 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-cni-multus\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.809687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809685 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-hostroot\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-etc-kubernetes\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809786 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-k8s-cni-cncf-io\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnfv\" (UniqueName: \"kubernetes.io/projected/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-kube-api-access-cbnfv\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-slash\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809850 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809868 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-hostroot\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809907 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-etc-kubernetes\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809909 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-sys\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809969 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-host\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.809983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-conf-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.810006 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810032 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-etc-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw2qz\" (UniqueName: \"kubernetes.io/projected/6a18c05a-4e8e-4527-8fab-4ca60906efe5-kube-api-access-dw2qz\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810064 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-socket-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-os-release\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjg7\" (UniqueName: \"kubernetes.io/projected/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-kube-api-access-vfjg7\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810169 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovnkube-config\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-serviceca\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810215 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-slash\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-log-socket\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-cni-multus\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810243 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-conf-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810256 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-sys-fs\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-cnibin\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810186 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c9d46b2-989f-48f1-9c78-03141820208f-cni-binary-copy\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.810319 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:44.310304399 +0000 UTC m=+3.028932135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.810343 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-kubelet\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-var-lib-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.810813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810431 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810429 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-var-lib-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810459 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-log-socket\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810477 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-etc-openvswitch\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31f73a1a-a36f-4a68-86c4-6b1439356b48-dbus\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810465 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-os-release\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.810533 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:44.310519024 +0000 UTC m=+3.029146782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysctl-d\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-run\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-lib-modules\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-run-netns\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810713 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31f73a1a-a36f-4a68-86c4-6b1439356b48-dbus\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810754 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-run-netns\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810753 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-modprobe-d\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-systemd\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.811539 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv6r5\" (UniqueName: \"kubernetes.io/projected/71877637-d3c7-400e-a758-c281ee814c44-kube-api-access-dv6r5\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810756 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-kubelet\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-serviceca\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810844 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-cni-binary-copy\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810893 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-netns\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-netns\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31f73a1a-a36f-4a68-86c4-6b1439356b48-kubelet-config\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-system-cni-dir\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-cni-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.810987 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31f73a1a-a36f-4a68-86c4-6b1439356b48-kubelet-config\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-kubelet\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811062 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-cni-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811084 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtmnk\" (UniqueName: \"kubernetes.io/projected/6c9d46b2-989f-48f1-9c78-03141820208f-kube-api-access-qtmnk\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811092 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-kubelet\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2931846-13fd-4ad3-a897-e70445e592bd-iptables-alerter-script\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/160e65f7-afd7-4d9f-a93a-2e675d0b932f-agent-certs\") pod \"konnectivity-agent-l25h6\" (UID: \"160e65f7-afd7-4d9f-a93a-2e675d0b932f\") " pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-host\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-node-log\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.812211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71877637-d3c7-400e-a758-c281ee814c44-tmp\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811233 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-host\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-cnibin\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2931846-13fd-4ad3-a897-e70445e592bd-host-slash\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811397 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a054bc5d-3d61-4b56-b677-6071a37cfa1d-hosts-file\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-cnibin\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811449 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2931846-13fd-4ad3-a897-e70445e592bd-host-slash\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-node-log\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811543 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811570 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-cni-bin\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-var-lib-cni-bin\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/160e65f7-afd7-4d9f-a93a-2e675d0b932f-konnectivity-ca\") pod \"konnectivity-agent-l25h6\" (UID: \"160e65f7-afd7-4d9f-a93a-2e675d0b932f\") " pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811650 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovn-node-metrics-cert\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2931846-13fd-4ad3-a897-e70445e592bd-iptables-alerter-script\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-device-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpj9g\" (UniqueName: \"kubernetes.io/projected/d9f91909-4f5c-4198-aa34-c9da21d0da64-kube-api-access-jpj9g\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.812863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-socket-dir-parent\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-systemd-units\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-cni-bin\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-registration-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/f2931846-13fd-4ad3-a897-e70445e592bd-kube-api-access-5lmqc\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-cni-netd\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovnkube-script-lib\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvqp\" (UniqueName: \"kubernetes.io/projected/e3b0789c-2e97-45b0-9380-8aef15a3a467-kube-api-access-4zvqp\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysconfig\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.811994 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-systemd\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-env-overrides\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812049 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71877637-d3c7-400e-a758-c281ee814c44-etc-tuned\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-multus-certs\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-ovn\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.813550 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk6x6\" (UniqueName: \"kubernetes.io/projected/a054bc5d-3d61-4b56-b677-6071a37cfa1d-kube-api-access-bk6x6\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-system-cni-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812247 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c9d46b2-989f-48f1-9c78-03141820208f-multus-daemon-config\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812612 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-systemd\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812672 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c9d46b2-989f-48f1-9c78-03141820208f-multus-daemon-config\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812727 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-host-run-multus-certs\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812751 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-run-ovn\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-system-cni-dir\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812855 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-cni-bin\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812894 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c9d46b2-989f-48f1-9c78-03141820208f-multus-socket-dir-parent\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812921 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-systemd-units\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812931 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.812985 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-cni-netd\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.813007 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a18c05a-4e8e-4527-8fab-4ca60906efe5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.813090 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-env-overrides\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.813137 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovnkube-script-lib\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.814144 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.813162 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/160e65f7-afd7-4d9f-a93a-2e675d0b932f-konnectivity-ca\") pod \"konnectivity-agent-l25h6\" (UID: \"160e65f7-afd7-4d9f-a93a-2e675d0b932f\") " pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.815342 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.815320 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a18c05a-4e8e-4527-8fab-4ca60906efe5-ovn-node-metrics-cert\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.815451 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.815433 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/160e65f7-afd7-4d9f-a93a-2e675d0b932f-agent-certs\") pod \"konnectivity-agent-l25h6\" (UID: \"160e65f7-afd7-4d9f-a93a-2e675d0b932f\") " pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:43.821210 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.821187 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnfv\" (UniqueName: \"kubernetes.io/projected/2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f-kube-api-access-cbnfv\") pod \"node-ca-nq9lq\" (UID: \"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f\") " pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:43.822788 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.822215 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:00:43.822788 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.822242 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:00:43.822788 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.822257 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:43.822788 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:43.822350 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:44.322332431 +0000 UTC m=+3.040960183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:43.823115 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.823096 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjg7\" (UniqueName: \"kubernetes.io/projected/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-kube-api-access-vfjg7\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:43.825502 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.824909 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw2qz\" (UniqueName: \"kubernetes.io/projected/6a18c05a-4e8e-4527-8fab-4ca60906efe5-kube-api-access-dw2qz\") pod \"ovnkube-node-x6t7r\" (UID: \"6a18c05a-4e8e-4527-8fab-4ca60906efe5\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:43.825502 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.825216 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtmnk\" (UniqueName: \"kubernetes.io/projected/6c9d46b2-989f-48f1-9c78-03141820208f-kube-api-access-qtmnk\") pod \"multus-g5nsv\" (UID: \"6c9d46b2-989f-48f1-9c78-03141820208f\") " pod="openshift-multus/multus-g5nsv" Jul 13 18:00:43.825709 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.825688 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmqc\" (UniqueName: \"kubernetes.io/projected/f2931846-13fd-4ad3-a897-e70445e592bd-kube-api-access-5lmqc\") pod \"iptables-alerter-954lp\" (UID: \"f2931846-13fd-4ad3-a897-e70445e592bd\") " pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-sys\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-host\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913252 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-socket-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913325 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-sys-fs\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913349 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-sys\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-cnibin\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913363 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-host\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.913460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.913423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-cnibin\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914174 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-sys-fs\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914223 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-socket-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysctl-d\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914499 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysctl-d\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-run\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914628 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-lib-modules\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914647 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-run\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914730 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-modprobe-d\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-systemd\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914770 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-lib-modules\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914788 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv6r5\" (UniqueName: \"kubernetes.io/projected/71877637-d3c7-400e-a758-c281ee814c44-kube-api-access-dv6r5\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914820 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-cni-binary-copy\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-system-cni-dir\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71877637-d3c7-400e-a758-c281ee814c44-tmp\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914932 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a054bc5d-3d61-4b56-b677-6071a37cfa1d-hosts-file\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.916680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.914963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-device-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915053 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpj9g\" (UniqueName: \"kubernetes.io/projected/d9f91909-4f5c-4198-aa34-c9da21d0da64-kube-api-access-jpj9g\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-registration-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvqp\" (UniqueName: \"kubernetes.io/projected/e3b0789c-2e97-45b0-9380-8aef15a3a467-kube-api-access-4zvqp\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915183 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysconfig\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71877637-d3c7-400e-a758-c281ee814c44-etc-tuned\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915252 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915303 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk6x6\" (UniqueName: \"kubernetes.io/projected/a054bc5d-3d61-4b56-b677-6071a37cfa1d-kube-api-access-bk6x6\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-kubernetes\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysctl-conf\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915391 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-var-lib-kubelet\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-os-release\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a054bc5d-3d61-4b56-b677-6071a37cfa1d-tmp-dir\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915511 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-cni-binary-copy\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-systemd\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.917519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915796 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a054bc5d-3d61-4b56-b677-6071a37cfa1d-tmp-dir\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915911 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysconfig\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916052 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-kubernetes\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916059 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-system-cni-dir\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916361 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-var-lib-kubelet\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.915027 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-modprobe-d\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916588 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71877637-d3c7-400e-a758-c281ee814c44-etc-sysctl-conf\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-device-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916717 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9f91909-4f5c-4198-aa34-c9da21d0da64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916780 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a054bc5d-3d61-4b56-b677-6071a37cfa1d-hosts-file\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.916848 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9f91909-4f5c-4198-aa34-c9da21d0da64-os-release\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:43.918207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.917083 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-registration-dir\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.918734 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.918673 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71877637-d3c7-400e-a758-c281ee814c44-etc-tuned\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.919193 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.919172 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3b0789c-2e97-45b0-9380-8aef15a3a467-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.920007 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.919986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71877637-d3c7-400e-a758-c281ee814c44-tmp\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.924207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.924184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv6r5\" (UniqueName: \"kubernetes.io/projected/71877637-d3c7-400e-a758-c281ee814c44-kube-api-access-dv6r5\") pod \"tuned-5tbdq\" (UID: \"71877637-d3c7-400e-a758-c281ee814c44\") " pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:43.924940 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.924913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk6x6\" (UniqueName: \"kubernetes.io/projected/a054bc5d-3d61-4b56-b677-6071a37cfa1d-kube-api-access-bk6x6\") pod \"node-resolver-zc5p7\" (UID: \"a054bc5d-3d61-4b56-b677-6071a37cfa1d\") " pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:43.925025 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.924913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvqp\" (UniqueName: \"kubernetes.io/projected/e3b0789c-2e97-45b0-9380-8aef15a3a467-kube-api-access-4zvqp\") pod \"aws-ebs-csi-driver-node-jhqs8\" (UID: \"e3b0789c-2e97-45b0-9380-8aef15a3a467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:43.925025 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:43.924956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpj9g\" (UniqueName: \"kubernetes.io/projected/d9f91909-4f5c-4198-aa34-c9da21d0da64-kube-api-access-jpj9g\") pod \"multus-additional-cni-plugins-vx5kv\" (UID: \"d9f91909-4f5c-4198-aa34-c9da21d0da64\") " pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:44.002105 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.002024 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g5nsv" Jul 13 18:00:44.011616 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.011435 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-954lp" Jul 13 18:00:44.021508 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.021486 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:00:44.027342 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.027320 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:00:44.034955 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.034928 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nq9lq" Jul 13 18:00:44.042856 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.042713 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" Jul 13 18:00:44.050292 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.050257 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" Jul 13 18:00:44.058395 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.058218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" Jul 13 18:00:44.063909 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.063888 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zc5p7" Jul 13 18:00:44.318412 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.318330 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:44.318412 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.318366 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:44.318605 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.318496 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:44.318605 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.318499 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:44.318605 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.318545 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:45.318530405 +0000 UTC m=+4.037158140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:44.318605 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.318567 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:45.318550029 +0000 UTC m=+4.037177767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:44.419376 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.419345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:44.419565 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.419501 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:00:44.419565 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.419529 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:00:44.419565 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.419538 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:44.419728 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.419586 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:45.419571893 +0000 UTC m=+4.138199633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:44.746617 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.746538 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:55:43 +0000 UTC" deadline="2028-03-26 15:45:29.288848818 +0000 UTC" Jul 13 18:00:44.746617 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.746568 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14925h44m44.542284537s" Jul 13 18:00:44.766974 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:44.766945 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:44.767139 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:44.767050 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:44.784179 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.784149 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a18c05a_4e8e_4527_8fab_4ca60906efe5.slice/crio-aa8ab8f7665ab2433b9340eabe3cee25d9ed51cb00db355a1c2433ab0f9687d1 WatchSource:0}: Error finding container aa8ab8f7665ab2433b9340eabe3cee25d9ed51cb00db355a1c2433ab0f9687d1: Status 404 returned error can't find the container with id aa8ab8f7665ab2433b9340eabe3cee25d9ed51cb00db355a1c2433ab0f9687d1 Jul 13 18:00:44.786060 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.786038 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a39a6b8_e1c2_4dea_8f0e_9c98f58bc01f.slice/crio-cc0939d251d5dadf8db55d72176518bb3df2dbc73e21c7ea981a633e66b0c6be WatchSource:0}: Error finding container cc0939d251d5dadf8db55d72176518bb3df2dbc73e21c7ea981a633e66b0c6be: Status 404 returned error can't find the container with id cc0939d251d5dadf8db55d72176518bb3df2dbc73e21c7ea981a633e66b0c6be Jul 13 18:00:44.787718 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.787693 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2931846_13fd_4ad3_a897_e70445e592bd.slice/crio-5b2cb9c15860378b6b184bade9ba32e3362697e88d89540a55a1f63a21a19f32 WatchSource:0}: Error finding container 5b2cb9c15860378b6b184bade9ba32e3362697e88d89540a55a1f63a21a19f32: Status 404 returned error can't find the container with id 5b2cb9c15860378b6b184bade9ba32e3362697e88d89540a55a1f63a21a19f32 Jul 13 18:00:44.793300 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.793124 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160e65f7_afd7_4d9f_a93a_2e675d0b932f.slice/crio-470d41ca6aaf5648e716458153c14a88d6d1e6dc6a1316449b30643f8dafe2b2 WatchSource:0}: Error finding container 470d41ca6aaf5648e716458153c14a88d6d1e6dc6a1316449b30643f8dafe2b2: Status 404 returned error can't find the container with id 470d41ca6aaf5648e716458153c14a88d6d1e6dc6a1316449b30643f8dafe2b2 Jul 13 18:00:44.794807 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.794746 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9d46b2_989f_48f1_9c78_03141820208f.slice/crio-edf6ec68aa5b809755435f423f278123a5fad664f859c2401b92ce3626edbf9b WatchSource:0}: Error finding container edf6ec68aa5b809755435f423f278123a5fad664f859c2401b92ce3626edbf9b: Status 404 returned error can't find the container with id edf6ec68aa5b809755435f423f278123a5fad664f859c2401b92ce3626edbf9b Jul 13 18:00:44.796362 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.796338 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda054bc5d_3d61_4b56_b677_6071a37cfa1d.slice/crio-a4932a17e1eca62f7fb495e63205c5a7142905e9155acf01c6f6e61338446b8f WatchSource:0}: Error finding container a4932a17e1eca62f7fb495e63205c5a7142905e9155acf01c6f6e61338446b8f: Status 404 returned error can't find the container with id a4932a17e1eca62f7fb495e63205c5a7142905e9155acf01c6f6e61338446b8f Jul 13 18:00:44.797617 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.797598 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f91909_4f5c_4198_aa34_c9da21d0da64.slice/crio-1dc85f11198918e41eb45bdd6c07e7e14da298b6621b5b6ac43ffd42623c6d36 WatchSource:0}: Error finding container 1dc85f11198918e41eb45bdd6c07e7e14da298b6621b5b6ac43ffd42623c6d36: Status 404 returned error can't find the container with id 1dc85f11198918e41eb45bdd6c07e7e14da298b6621b5b6ac43ffd42623c6d36 Jul 13 18:00:44.800552 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:00:44.800521 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71877637_d3c7_400e_a758_c281ee814c44.slice/crio-8ab8f361d129b969878243d1387dc5912feb85646b0ea197683aa2fed0ef3ec0 WatchSource:0}: Error finding container 8ab8f361d129b969878243d1387dc5912feb85646b0ea197683aa2fed0ef3ec0: Status 404 returned error can't find the container with id 8ab8f361d129b969878243d1387dc5912feb85646b0ea197683aa2fed0ef3ec0 Jul 13 18:00:45.325420 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.325166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:45.325420 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.325383 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:45.325575 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.325333 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:45.325575 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.325459 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:45.325575 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.325498 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:47.325478183 +0000 UTC m=+6.044105918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:45.325575 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.325514 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:47.32550699 +0000 UTC m=+6.044134726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:45.426469 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.426384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:45.426469 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.426544 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:00:45.426469 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.426559 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:00:45.426469 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.426568 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:45.426880 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.426618 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:47.426600851 +0000 UTC m=+6.145228587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:45.747646 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.747557 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:55:43 +0000 UTC" deadline="2028-04-17 12:22:14.267305526 +0000 UTC" Jul 13 18:00:45.747646 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.747600 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15450h21m28.519711031s" Jul 13 18:00:45.768172 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.767634 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:45.768172 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.767758 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:45.768969 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.768507 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:45.768969 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:45.768626 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:45.780697 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.778708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g5nsv" event={"ID":"6c9d46b2-989f-48f1-9c78-03141820208f","Type":"ContainerStarted","Data":"edf6ec68aa5b809755435f423f278123a5fad664f859c2401b92ce3626edbf9b"} Jul 13 18:00:45.784881 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.784854 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" event={"ID":"e3b0789c-2e97-45b0-9380-8aef15a3a467","Type":"ContainerStarted","Data":"3a5247669886cfb82ea4673d45d43a0c7357fa63f58f3afb88f3dd63132876fd"} Jul 13 18:00:45.788433 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.788360 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-954lp" event={"ID":"f2931846-13fd-4ad3-a897-e70445e592bd","Type":"ContainerStarted","Data":"5b2cb9c15860378b6b184bade9ba32e3362697e88d89540a55a1f63a21a19f32"} Jul 13 18:00:45.791567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.791496 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" event={"ID":"71877637-d3c7-400e-a758-c281ee814c44","Type":"ContainerStarted","Data":"8ab8f361d129b969878243d1387dc5912feb85646b0ea197683aa2fed0ef3ec0"} Jul 13 18:00:45.795516 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.795434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerStarted","Data":"1dc85f11198918e41eb45bdd6c07e7e14da298b6621b5b6ac43ffd42623c6d36"} Jul 13 18:00:45.798842 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.798785 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zc5p7" event={"ID":"a054bc5d-3d61-4b56-b677-6071a37cfa1d","Type":"ContainerStarted","Data":"a4932a17e1eca62f7fb495e63205c5a7142905e9155acf01c6f6e61338446b8f"} Jul 13 18:00:45.800624 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.800579 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l25h6" event={"ID":"160e65f7-afd7-4d9f-a93a-2e675d0b932f","Type":"ContainerStarted","Data":"470d41ca6aaf5648e716458153c14a88d6d1e6dc6a1316449b30643f8dafe2b2"} Jul 13 18:00:45.803210 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.803169 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nq9lq" event={"ID":"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f","Type":"ContainerStarted","Data":"cc0939d251d5dadf8db55d72176518bb3df2dbc73e21c7ea981a633e66b0c6be"} Jul 13 18:00:45.806107 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.806082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"aa8ab8f7665ab2433b9340eabe3cee25d9ed51cb00db355a1c2433ab0f9687d1"} Jul 13 18:00:45.810406 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.810379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" event={"ID":"fc266b970294ca7e6b02e58f7dfbfaf7","Type":"ContainerStarted","Data":"de861025e0b4d0a4c372827dae7d52ee8cd5de7044a651380d5cd10f73c38138"} Jul 13 18:00:45.816114 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.815603 2582 generic.go:356] "Generic (PLEG): container finished" podID="b41c40da60a15333861b842213a29712" containerID="11dd9c3feb30f4c60bf929ff3b453f1a2eae99c1e5b539a2273ec3c029da16be" exitCode=0 Jul 13 18:00:45.816114 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.815641 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"b41c40da60a15333861b842213a29712","Type":"ContainerDied","Data":"11dd9c3feb30f4c60bf929ff3b453f1a2eae99c1e5b539a2273ec3c029da16be"} Jul 13 18:00:45.857367 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:45.856037 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" podStartSLOduration=2.856016499 podStartE2EDuration="2.856016499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:00:45.833929902 +0000 UTC m=+4.552557659" watchObservedRunningTime="2026-07-13 18:00:45.856016499 +0000 UTC m=+4.574644258" Jul 13 18:00:46.768251 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:46.767759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:46.768251 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:46.767883 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:46.839952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:46.839803 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"b41c40da60a15333861b842213a29712","Type":"ContainerStarted","Data":"bb1983886cf488855b1b8035f1e3ca3bab90ab37e71475d3e3cd2e891955bc55"} Jul 13 18:00:46.856260 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:46.855846 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" podStartSLOduration=3.855825332 podStartE2EDuration="3.855825332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:00:46.855011553 +0000 UTC m=+5.573639312" watchObservedRunningTime="2026-07-13 18:00:46.855825332 +0000 UTC m=+5.574453089" Jul 13 18:00:47.346124 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:47.345086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:47.346124 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:47.345142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:47.346124 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.345322 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:47.346124 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.345388 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:51.345369128 +0000 UTC m=+10.063996864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:47.346124 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.345844 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:47.346124 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.345898 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:51.345882892 +0000 UTC m=+10.064510631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:47.445777 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:47.445734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:47.445965 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.445914 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:00:47.445965 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.445938 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:00:47.445965 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.445950 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:47.446124 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.446008 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:51.44599079 +0000 UTC m=+10.164618531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:47.769858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:47.768434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:47.769858 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.768566 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:47.769858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:47.768964 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:47.769858 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:47.769061 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:48.766840 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:48.766801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:48.767004 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:48.766940 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:49.767333 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:49.767299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:49.767804 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:49.767336 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:49.767804 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:49.767412 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:49.767804 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:49.767542 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:50.767358 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:50.767321 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:50.767820 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:50.767439 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:51.386412 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:51.386374 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:51.386566 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:51.386425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:51.386637 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.386557 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:51.386637 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.386634 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:59.386612019 +0000 UTC m=+18.105239781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:51.386746 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.386662 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:51.386746 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.386723 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:59.386704636 +0000 UTC m=+18.105332440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:51.487407 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:51.487373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:51.487582 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.487527 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:00:51.487582 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.487543 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:00:51.487582 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.487552 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:51.487700 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.487608 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:00:59.487589326 +0000 UTC m=+18.206217082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:51.771439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:51.770741 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:51.771439 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.770857 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:51.771439 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:51.771234 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:51.771439 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:51.771345 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:52.767250 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:52.766779 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:52.767250 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:52.766908 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:53.767253 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:53.767208 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:53.767253 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:53.767228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:53.767768 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:53.767365 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:53.767999 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:53.767962 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:54.768072 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:54.767632 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:54.768072 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:54.767749 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:55.767857 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:55.767827 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:55.768015 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:55.767930 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:55.768015 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:55.767982 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:55.768078 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:55.768035 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:56.767381 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:56.767350 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:56.767829 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:56.767461 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:57.767331 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:57.767292 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:57.767516 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:57.767434 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:57.767831 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:57.767299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:57.767831 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:57.767800 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:00:58.767660 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:58.767626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:58.768185 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:58.767749 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:00:59.457413 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:59.457371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:59.457688 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:59.457433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:59.457688 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.457553 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:59.457688 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.457595 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:59.457688 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.457631 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:15.457611513 +0000 UTC m=+34.176239252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:00:59.457688 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.457653 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:15.457642808 +0000 UTC m=+34.176270549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:00:59.558111 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:59.558073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:00:59.558293 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.558237 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:00:59.558293 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.558260 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:00:59.558293 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.558273 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:59.558428 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.558354 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:15.558334318 +0000 UTC m=+34.276962059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:00:59.767137 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:59.767065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:00:59.767267 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.767182 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:00:59.767267 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:00:59.767220 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:00:59.767357 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:00:59.767323 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:00.766866 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:00.766832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:00.767317 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:00.766952 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:01.767627 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:01.767592 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:01.768080 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:01.767774 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:01.768080 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:01.767815 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:01.768080 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:01.767893 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:02.767292 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:02.767249 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:02.767467 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:02.767377 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:03.767545 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:03.767495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:03.768024 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:03.767655 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:03.768024 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:03.767730 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:03.768024 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:03.767809 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:04.767436 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.767193 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:04.767570 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:04.767514 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:04.879028 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.878983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g5nsv" event={"ID":"6c9d46b2-989f-48f1-9c78-03141820208f","Type":"ContainerStarted","Data":"a870f677381dcb108d16a9c6cc765534c797ccfd83fb5a731d22d370387ef537"} Jul 13 18:01:04.882596 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.882563 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" event={"ID":"e3b0789c-2e97-45b0-9380-8aef15a3a467","Type":"ContainerStarted","Data":"e0a5267221a476d20e0e74b53462e0fcda6ab408dc1554874fc05e71e4591e52"} Jul 13 18:01:04.884051 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.884027 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" event={"ID":"71877637-d3c7-400e-a758-c281ee814c44","Type":"ContainerStarted","Data":"580a4dddd2bf9d5d2451a9f563104faeb42698c9731d93ac2d91e4b9d26a50ef"} Jul 13 18:01:04.885884 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.885860 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9f91909-4f5c-4198-aa34-c9da21d0da64" containerID="e8a1b93e6ff8ed778e64d438c46966b838ff17755add750a020fdcfb7f2f83ae" exitCode=0 Jul 13 18:01:04.885967 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.885922 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerDied","Data":"e8a1b93e6ff8ed778e64d438c46966b838ff17755add750a020fdcfb7f2f83ae"} Jul 13 18:01:04.888021 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.887990 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zc5p7" event={"ID":"a054bc5d-3d61-4b56-b677-6071a37cfa1d","Type":"ContainerStarted","Data":"af5829979ac7e5b0e89e6f9f2b8446dc5d14080bddd7c3449de312bd2af2bff7"} Jul 13 18:01:04.889880 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.889853 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l25h6" event={"ID":"160e65f7-afd7-4d9f-a93a-2e675d0b932f","Type":"ContainerStarted","Data":"73fd29ee31981ac9e7c6b625ec6d8a48fb38967f937a03b5e9ea226c948b66a5"} Jul 13 18:01:04.891519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.891488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nq9lq" event={"ID":"2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f","Type":"ContainerStarted","Data":"15793dbbb092bbaf7ce8269d35603cb575f91b79b17648f371493019e1e3a6f1"} Jul 13 18:01:04.895121 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:01:04.895485 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895458 2582 generic.go:356] "Generic (PLEG): container finished" podID="6a18c05a-4e8e-4527-8fab-4ca60906efe5" containerID="81df4bb3f5ebc1418450edb5ac2e6e154ab58367099eff07e1d0591d4e9c0651" exitCode=1 Jul 13 18:01:04.895627 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895549 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"54c8bec8da025b12478148d2103eb1537c19ae7422f2531b3221d52918b1e520"} Jul 13 18:01:04.895627 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895615 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"f51763bcf1b9d752b12cd8870cdb3a2738ce945c516df612e3359bc9c0cbe66f"} Jul 13 18:01:04.895743 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"53010d50a0552c3f0222f7ebfc3fd1a47cfcd34539b8b48ea1f41b27fd8ad0f0"} Jul 13 18:01:04.895743 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"278da56eaa84d0acc5014cce33808240e814e826ff04536afe7dd3bdd5099114"} Jul 13 18:01:04.895850 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895796 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerDied","Data":"81df4bb3f5ebc1418450edb5ac2e6e154ab58367099eff07e1d0591d4e9c0651"} Jul 13 18:01:04.895900 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.895849 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"3ca3c8f6db21979d2868c6555fa935138b0d73f3e53d1d6f811af7ae3174b2ac"} Jul 13 18:01:04.904230 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.903709 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g5nsv" podStartSLOduration=4.581183819 podStartE2EDuration="23.903698151s" totalImagesPullingTime="19.322514332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:04.903604149 +0000 UTC m=+23.622231907" watchObservedRunningTime="2026-07-13 18:01:04.903698151 +0000 UTC m=+23.622325908" Jul 13 18:01:04.945076 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.944537 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l25h6" podStartSLOduration=7.963004147 podStartE2EDuration="22.944515741s" totalImagesPullingTime="14.981511594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:04.91993613 +0000 UTC m=+23.638563889" watchObservedRunningTime="2026-07-13 18:01:04.944515741 +0000 UTC m=+23.663143502" Jul 13 18:01:04.960799 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.960755 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zc5p7" podStartSLOduration=3.691608787 podStartE2EDuration="22.960737989s" totalImagesPullingTime="19.269129202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:04.960504176 +0000 UTC m=+23.679131933" watchObservedRunningTime="2026-07-13 18:01:04.960737989 +0000 UTC m=+23.679365746" Jul 13 18:01:04.981461 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:04.981413 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nq9lq" podStartSLOduration=3.710029806 podStartE2EDuration="22.981398263s" totalImagesPullingTime="19.271368457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:04.981048344 +0000 UTC m=+23.699676102" watchObservedRunningTime="2026-07-13 18:01:04.981398263 +0000 UTC m=+23.700026020" Jul 13 18:01:05.015223 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.015175 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5tbdq" podStartSLOduration=3.741256749 podStartE2EDuration="23.015158637s" totalImagesPullingTime="19.273901888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:05.014815938 +0000 UTC m=+23.733443695" watchObservedRunningTime="2026-07-13 18:01:05.015158637 +0000 UTC m=+23.733786394" Jul 13 18:01:05.750122 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.750092 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 18:01:05.765416 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.765310 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T18:01:05.750117085Z","UUID":"a2506b49-a26e-471b-b7d5-b58d0daa511b","Handler":null,"Name":"","Endpoint":""} Jul 13 18:01:05.766829 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.766809 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:05.766946 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.766832 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 18:01:05.766946 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.766878 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 18:01:05.766946 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.766842 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:05.766946 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:05.766929 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:05.767102 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:05.767023 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:05.899914 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.899877 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" event={"ID":"e3b0789c-2e97-45b0-9380-8aef15a3a467","Type":"ContainerStarted","Data":"dd47cd1e3b9e416532a2afad5269b10efa73aa2bb05e482a1a1e61765ce84f6c"} Jul 13 18:01:05.901441 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.901380 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-954lp" event={"ID":"f2931846-13fd-4ad3-a897-e70445e592bd","Type":"ContainerStarted","Data":"6fdc0bbdf7685c94e65b78142160a349238894859aac6a5b4ec0fbf9a628242c"} Jul 13 18:01:05.919784 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:05.919725 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-954lp" podStartSLOduration=5.650769603 podStartE2EDuration="24.919708462s" totalImagesPullingTime="19.268938859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:05.91919362 +0000 UTC m=+24.637821377" watchObservedRunningTime="2026-07-13 18:01:05.919708462 +0000 UTC m=+24.638336219" Jul 13 18:01:06.767569 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:06.767533 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:06.767807 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:06.767633 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:07.115764 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.115710 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:01:07.116161 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.116100 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:01:07.766888 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.766857 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:07.767109 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:07.766983 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:07.767109 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.767027 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:07.767179 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:07.767114 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:07.909679 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.909654 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:01:07.910089 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.910061 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"86aa985a101327452d36c9b66180b63513f3901355acb3ea61ecc1f6d6464395"} Jul 13 18:01:07.912398 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.912365 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" event={"ID":"e3b0789c-2e97-45b0-9380-8aef15a3a467","Type":"ContainerStarted","Data":"aa27eb66fd3eb25840ad70fb0b12a4535d6f8e921a5d086755cd22f5e6a95404"} Jul 13 18:01:07.912789 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.912766 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:01:07.913094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.913074 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l25h6" Jul 13 18:01:07.959348 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:07.959295 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhqs8" podStartSLOduration=4.264770367 podStartE2EDuration="25.959261856s" totalImagesPullingTime="21.694491489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:07.959120927 +0000 UTC m=+26.677748685" watchObservedRunningTime="2026-07-13 18:01:07.959261856 +0000 UTC m=+26.677889612" Jul 13 18:01:08.767411 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:08.767199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:08.767836 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:08.767490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:09.769701 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.769531 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:09.770392 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.769595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:09.770392 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:09.769761 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:09.770392 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:09.769866 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:09.918017 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.917899 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9f91909-4f5c-4198-aa34-c9da21d0da64" containerID="063be47fc272e12654fdf85053e9f8858c4ebeff5f94e6e0c1067288b258a892" exitCode=0 Jul 13 18:01:09.918017 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.917959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerDied","Data":"063be47fc272e12654fdf85053e9f8858c4ebeff5f94e6e0c1067288b258a892"} Jul 13 18:01:09.921307 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.921272 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:01:09.921723 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.921697 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"74a6f3c1115c508a859eabda78c28153d516600bbf173564e5ea1d59cd77286f"} Jul 13 18:01:09.922048 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:09.922036 2582 scope.go:117] "RemoveContainer" containerID="81df4bb3f5ebc1418450edb5ac2e6e154ab58367099eff07e1d0591d4e9c0651" Jul 13 18:01:10.767334 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.767301 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:10.767573 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:10.767414 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:10.927884 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.927855 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:01:10.928314 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.928217 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" event={"ID":"6a18c05a-4e8e-4527-8fab-4ca60906efe5","Type":"ContainerStarted","Data":"6b114e4e397c87c5c7af50787284aa6c95549fdfda71a413b520ccb251831f20"} Jul 13 18:01:10.928574 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.928551 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:01:10.928722 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.928693 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:01:10.928798 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.928778 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:01:10.944609 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.944583 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:01:10.944740 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.944693 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:01:10.961857 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:10.961799 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" podStartSLOduration=10.60898218 podStartE2EDuration="29.961785231s" totalImagesPullingTime="19.352803051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:10.95871346 +0000 UTC m=+29.677341218" watchObservedRunningTime="2026-07-13 18:01:10.961785231 +0000 UTC m=+29.680412988" Jul 13 18:01:11.362719 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.362687 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n29xm"] Jul 13 18:01:11.362976 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.362841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:11.362976 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:11.362931 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:11.363141 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.363123 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tq6k"] Jul 13 18:01:11.363219 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.363208 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:11.363328 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:11.363312 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:11.365346 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.365322 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tszs5"] Jul 13 18:01:11.365455 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.365401 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:11.365496 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:11.365465 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:11.932819 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.932789 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9f91909-4f5c-4198-aa34-c9da21d0da64" containerID="fe212946cd5f7fb3a118e5f2967193851503ec171028616ec56997aacb6c26a4" exitCode=0 Jul 13 18:01:11.933300 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:11.932883 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerDied","Data":"fe212946cd5f7fb3a118e5f2967193851503ec171028616ec56997aacb6c26a4"} Jul 13 18:01:12.767803 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:12.767774 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:12.767803 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:12.767788 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:12.768043 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:12.767882 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:12.768043 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:12.767963 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:12.768043 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:12.768008 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:12.768138 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:12.768081 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:13.939254 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:13.939003 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9f91909-4f5c-4198-aa34-c9da21d0da64" containerID="3b3d9bb98fc38334a684f4f27c8cbc4a019f71069bb7584bcdde110f218b99c2" exitCode=0 Jul 13 18:01:13.939640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:13.939083 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerDied","Data":"3b3d9bb98fc38334a684f4f27c8cbc4a019f71069bb7584bcdde110f218b99c2"} Jul 13 18:01:14.767331 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:14.767299 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:14.767331 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:14.767327 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:14.767577 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:14.767298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:14.767577 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:14.767415 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:14.767577 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:14.767533 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:14.767708 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:14.767611 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:15.479047 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:15.479012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:15.479503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:15.479057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:15.479503 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.479176 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:01:15.479503 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.479187 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:01:15.479503 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.479230 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:47.479213972 +0000 UTC m=+66.197841708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:01:15.479503 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.479252 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret podName:31f73a1a-a36f-4a68-86c4-6b1439356b48 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:47.479235586 +0000 UTC m=+66.197863326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret") pod "global-pull-secret-syncer-tszs5" (UID: "31f73a1a-a36f-4a68-86c4-6b1439356b48") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:01:15.579454 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:15.579419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:15.579649 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.579626 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:01:15.579649 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.579646 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:01:15.579759 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.579655 2582 projected.go:196] Error preparing data for projected volume kube-api-access-tvwzv for pod openshift-network-diagnostics/network-check-target-7tq6k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:01:15.579759 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:15.579715 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv podName:aa56620a-1d9a-4abc-bfac-0b545f66b537 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:47.579695299 +0000 UTC m=+66.298323043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvwzv" (UniqueName: "kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv") pod "network-check-target-7tq6k" (UID: "aa56620a-1d9a-4abc-bfac-0b545f66b537") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:01:16.767264 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:16.767225 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:16.767264 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:16.767250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:16.767784 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:16.767369 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tszs5" podUID="31f73a1a-a36f-4a68-86c4-6b1439356b48" Jul 13 18:01:16.767784 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:16.767397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:16.767784 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:16.767513 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tq6k" podUID="aa56620a-1d9a-4abc-bfac-0b545f66b537" Jul 13 18:01:16.767784 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:16.767588 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n29xm" podUID="2a12cdcb-1a6e-4e82-b1ae-ccf704382194" Jul 13 18:01:18.098054 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.098026 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeReady" Jul 13 18:01:18.098593 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.098162 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 18:01:18.158193 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.158164 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84884dbc79-sd7f6"] Jul 13 18:01:18.171051 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.171020 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt"] Jul 13 18:01:18.171262 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.171163 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.177570 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.177547 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 18:01:18.177724 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.177619 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 18:01:18.177793 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.177784 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 18:01:18.178209 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.177915 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rh55w\"" Jul 13 18:01:18.191604 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.191576 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7"] Jul 13 18:01:18.191741 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.191701 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.197325 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.197296 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 18:01:18.197325 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.197319 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 18:01:18.197769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.197728 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 18:01:18.198703 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.198675 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 18:01:18.204499 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.204472 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 18:01:18.212183 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.212160 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw"] Jul 13 18:01:18.212307 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.212292 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.217873 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.217856 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 13 18:01:18.218530 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.218508 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 13 18:01:18.218620 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.218551 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 13 18:01:18.218863 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.218850 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 13 18:01:18.230461 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.230440 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt"] Jul 13 18:01:18.230558 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.230484 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84884dbc79-sd7f6"] Jul 13 18:01:18.230558 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.230501 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw"] Jul 13 18:01:18.230558 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.230517 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7"] Jul 13 18:01:18.230558 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.230533 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kz9nw"] Jul 13 18:01:18.230679 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.230594 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.234016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.234000 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8m6ls\"" Jul 13 18:01:18.234100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.234028 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 18:01:18.255012 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.254990 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vl6lr"] Jul 13 18:01:18.255126 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.255107 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.258424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.258405 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 18:01:18.258516 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.258446 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d7lb5\"" Jul 13 18:01:18.259089 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.259076 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 18:01:18.259227 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.259213 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 18:01:18.271378 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.271354 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kz9nw"] Jul 13 18:01:18.271487 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.271388 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.271487 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.271427 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vl6lr"] Jul 13 18:01:18.274237 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.274220 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 18:01:18.274845 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.274828 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 18:01:18.274932 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.274919 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mg7xr\"" Jul 13 18:01:18.301355 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f43482-41c7-487a-b3fc-c9e8eb92692a-tmp\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.301472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-bound-sa-token\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.301472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-ca\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.301472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-certificates\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.301472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-hub\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.301661 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.301661 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x824h\" (UniqueName: \"kubernetes.io/projected/d9f43482-41c7-487a-b3fc-c9e8eb92692a-kube-api-access-x824h\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.301774 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301677 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.301774 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d9f43482-41c7-487a-b3fc-c9e8eb92692a-klusterlet-config\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.301774 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301729 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-installation-pull-secrets\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.301928 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301788 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/516620cc-8297-4a1d-89ce-a3e1a9e305be-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.301928 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301822 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.301928 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phm4f\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-kube-api-access-phm4f\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.301928 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-image-registry-private-configuration\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.302139 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d37c3f93-5563-46fc-becf-ba56367c9b53-ca-trust-extracted\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.302139 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.301995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhjh\" (UniqueName: \"kubernetes.io/projected/516620cc-8297-4a1d-89ce-a3e1a9e305be-kube-api-access-tvhjh\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.302139 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.302025 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-trusted-ca\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.403079 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.402998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f43482-41c7-487a-b3fc-c9e8eb92692a-tmp\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.403079 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-bound-sa-token\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-ca\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403103 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-certificates\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136e43e7-081d-441e-9104-cca7cf0c930a-config-volume\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f-cert\") pod \"ingress-canary-kz9nw\" (UID: \"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f\") " pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403173 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-hub\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136e43e7-081d-441e-9104-cca7cf0c930a-tmp-dir\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.403316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x824h\" (UniqueName: \"kubernetes.io/projected/d9f43482-41c7-487a-b3fc-c9e8eb92692a-kube-api-access-x824h\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d9f43482-41c7-487a-b3fc-c9e8eb92692a-klusterlet-config\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-installation-pull-secrets\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403455 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/516620cc-8297-4a1d-89ce-a3e1a9e305be-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9f43482-41c7-487a-b3fc-c9e8eb92692a-tmp\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403487 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403568 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phm4f\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-kube-api-access-phm4f\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkpz\" (UniqueName: \"kubernetes.io/projected/4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f-kube-api-access-zbkpz\") pod \"ingress-canary-kz9nw\" (UID: \"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f\") " pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wm28\" (UniqueName: \"kubernetes.io/projected/40a18d19-0df7-40df-9405-6bfe7d73a9b3-kube-api-access-6wm28\") pod \"managed-serviceaccount-addon-agent-7b6767dcb4-drqcw\" (UID: \"40a18d19-0df7-40df-9405-6bfe7d73a9b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.403648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40a18d19-0df7-40df-9405-6bfe7d73a9b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b6767dcb4-drqcw\" (UID: \"40a18d19-0df7-40df-9405-6bfe7d73a9b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-image-registry-private-configuration\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403768 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d37c3f93-5563-46fc-becf-ba56367c9b53-ca-trust-extracted\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-certificates\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhjh\" (UniqueName: \"kubernetes.io/projected/516620cc-8297-4a1d-89ce-a3e1a9e305be-kube-api-access-tvhjh\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-trusted-ca\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.404104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.403873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzj7r\" (UniqueName: \"kubernetes.io/projected/136e43e7-081d-441e-9104-cca7cf0c930a-kube-api-access-pzj7r\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.404537 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.404253 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:18.404537 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.404271 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:18.404537 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.404351 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:18.904332131 +0000 UTC m=+37.622959882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:18.404537 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.404369 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/516620cc-8297-4a1d-89ce-a3e1a9e305be-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.405022 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.404965 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d37c3f93-5563-46fc-becf-ba56367c9b53-ca-trust-extracted\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.406226 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.406105 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-trusted-ca\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.408155 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-installation-pull-secrets\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.408241 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408168 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.408241 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408165 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-image-registry-private-configuration\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.408359 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408336 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-hub\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.408396 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408338 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d9f43482-41c7-487a-b3fc-c9e8eb92692a-klusterlet-config\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.408435 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408422 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.408638 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.408622 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/516620cc-8297-4a1d-89ce-a3e1a9e305be-ca\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.426458 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.426431 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhjh\" (UniqueName: \"kubernetes.io/projected/516620cc-8297-4a1d-89ce-a3e1a9e305be-kube-api-access-tvhjh\") pod \"cluster-proxy-proxy-agent-f698c6f85-2zdx7\" (UID: \"516620cc-8297-4a1d-89ce-a3e1a9e305be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.428850 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.428828 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-bound-sa-token\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.431901 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.431881 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x824h\" (UniqueName: \"kubernetes.io/projected/d9f43482-41c7-487a-b3fc-c9e8eb92692a-kube-api-access-x824h\") pod \"klusterlet-addon-workmgr-57847949c9-j2vgt\" (UID: \"d9f43482-41c7-487a-b3fc-c9e8eb92692a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.435885 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.435863 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phm4f\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-kube-api-access-phm4f\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.505020 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.504995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkpz\" (UniqueName: \"kubernetes.io/projected/4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f-kube-api-access-zbkpz\") pod \"ingress-canary-kz9nw\" (UID: \"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f\") " pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.505137 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wm28\" (UniqueName: \"kubernetes.io/projected/40a18d19-0df7-40df-9405-6bfe7d73a9b3-kube-api-access-6wm28\") pod \"managed-serviceaccount-addon-agent-7b6767dcb4-drqcw\" (UID: \"40a18d19-0df7-40df-9405-6bfe7d73a9b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.505137 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.505137 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505056 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40a18d19-0df7-40df-9405-6bfe7d73a9b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b6767dcb4-drqcw\" (UID: \"40a18d19-0df7-40df-9405-6bfe7d73a9b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.505137 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzj7r\" (UniqueName: \"kubernetes.io/projected/136e43e7-081d-441e-9104-cca7cf0c930a-kube-api-access-pzj7r\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.505361 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.505154 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:18.505361 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:18.505361 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.505223 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:01:19.005202691 +0000 UTC m=+37.723830438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:18.505361 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136e43e7-081d-441e-9104-cca7cf0c930a-config-volume\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.505562 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f-cert\") pod \"ingress-canary-kz9nw\" (UID: \"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f\") " pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.505562 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136e43e7-081d-441e-9104-cca7cf0c930a-tmp-dir\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.505675 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505660 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136e43e7-081d-441e-9104-cca7cf0c930a-tmp-dir\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.505813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.505770 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/136e43e7-081d-441e-9104-cca7cf0c930a-config-volume\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.507665 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.507646 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40a18d19-0df7-40df-9405-6bfe7d73a9b3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b6767dcb4-drqcw\" (UID: \"40a18d19-0df7-40df-9405-6bfe7d73a9b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.507764 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.507747 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f-cert\") pod \"ingress-canary-kz9nw\" (UID: \"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f\") " pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.528424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.528395 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkpz\" (UniqueName: \"kubernetes.io/projected/4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f-kube-api-access-zbkpz\") pod \"ingress-canary-kz9nw\" (UID: \"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f\") " pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.528543 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.528510 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wm28\" (UniqueName: \"kubernetes.io/projected/40a18d19-0df7-40df-9405-6bfe7d73a9b3-kube-api-access-6wm28\") pod \"managed-serviceaccount-addon-agent-7b6767dcb4-drqcw\" (UID: \"40a18d19-0df7-40df-9405-6bfe7d73a9b3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.528828 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.528806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzj7r\" (UniqueName: \"kubernetes.io/projected/136e43e7-081d-441e-9104-cca7cf0c930a-kube-api-access-pzj7r\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:18.531637 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.531616 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:01:18.538827 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.538751 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" Jul 13 18:01:18.574832 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.574811 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kz9nw" Jul 13 18:01:18.767464 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.767171 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:18.767858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.767831 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:18.768073 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.768053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:18.773469 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.773435 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t649t\"" Jul 13 18:01:18.773590 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.773518 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 18:01:18.773590 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.773525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 18:01:18.773590 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.773569 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 18:01:18.773745 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.773571 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7ngkz\"" Jul 13 18:01:18.773745 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.773674 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 18:01:18.796020 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.795903 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw"] Jul 13 18:01:18.797303 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.797255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7"] Jul 13 18:01:18.802353 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.802330 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt"] Jul 13 18:01:18.815787 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.815766 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kz9nw"] Jul 13 18:01:18.819211 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:01:18.819186 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40a18d19_0df7_40df_9405_6bfe7d73a9b3.slice/crio-ae791146424dd81caa597d6b665353195fa8c2d6293a0e80eeeeb2dbb75beffc WatchSource:0}: Error finding container ae791146424dd81caa597d6b665353195fa8c2d6293a0e80eeeeb2dbb75beffc: Status 404 returned error can't find the container with id ae791146424dd81caa597d6b665353195fa8c2d6293a0e80eeeeb2dbb75beffc Jul 13 18:01:18.820153 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:01:18.820128 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea6eb3e_58eb_4d19_a272_a0c2f0d86b7f.slice/crio-f8418d7b1390cf2a1c8bee16b3c8a7eee6187c809a6f9d72cd9098f792543b47 WatchSource:0}: Error finding container f8418d7b1390cf2a1c8bee16b3c8a7eee6187c809a6f9d72cd9098f792543b47: Status 404 returned error can't find the container with id f8418d7b1390cf2a1c8bee16b3c8a7eee6187c809a6f9d72cd9098f792543b47 Jul 13 18:01:18.822506 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:01:18.822434 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod516620cc_8297_4a1d_89ce_a3e1a9e305be.slice/crio-18d8a88a0fe424a8670880acc496b3294ac2350919f2ca3feff4cdb2466f8a13 WatchSource:0}: Error finding container 18d8a88a0fe424a8670880acc496b3294ac2350919f2ca3feff4cdb2466f8a13: Status 404 returned error can't find the container with id 18d8a88a0fe424a8670880acc496b3294ac2350919f2ca3feff4cdb2466f8a13 Jul 13 18:01:18.908569 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.908534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:18.908725 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.908710 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:18.908761 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.908728 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:18.908797 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:18.908787 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:19.908768976 +0000 UTC m=+38.627396724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:18.953492 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.953398 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kz9nw" event={"ID":"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f","Type":"ContainerStarted","Data":"f8418d7b1390cf2a1c8bee16b3c8a7eee6187c809a6f9d72cd9098f792543b47"} Jul 13 18:01:18.954451 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.954425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" event={"ID":"d9f43482-41c7-487a-b3fc-c9e8eb92692a","Type":"ContainerStarted","Data":"543a2523efba51e59f7939ccf281fae10d0497eb44d737d95e8b71fc8496fc20"} Jul 13 18:01:18.955401 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.955379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" event={"ID":"516620cc-8297-4a1d-89ce-a3e1a9e305be","Type":"ContainerStarted","Data":"18d8a88a0fe424a8670880acc496b3294ac2350919f2ca3feff4cdb2466f8a13"} Jul 13 18:01:18.957911 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.957888 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9f91909-4f5c-4198-aa34-c9da21d0da64" containerID="73235448cce1a1d7c5d6009eae5639fb22c9c10c663179a64ebc44ce7e2d3cf8" exitCode=0 Jul 13 18:01:18.957996 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.957970 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerDied","Data":"73235448cce1a1d7c5d6009eae5639fb22c9c10c663179a64ebc44ce7e2d3cf8"} Jul 13 18:01:18.959052 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:18.959024 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" event={"ID":"40a18d19-0df7-40df-9405-6bfe7d73a9b3","Type":"ContainerStarted","Data":"ae791146424dd81caa597d6b665353195fa8c2d6293a0e80eeeeb2dbb75beffc"} Jul 13 18:01:19.009856 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:19.009830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:19.009994 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:19.009972 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:19.010041 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:19.010030 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:01:20.01001359 +0000 UTC m=+38.728641327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:19.918884 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:19.918845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:19.919645 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:19.919017 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:19.919645 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:19.919040 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:19.919645 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:19.919104 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:21.919084449 +0000 UTC m=+40.637712184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:19.966415 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:19.966379 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9f91909-4f5c-4198-aa34-c9da21d0da64" containerID="e732584cde893d93710f94a09000eb13adbb7bc9a4ceb9e0a216d8f1187a5fcf" exitCode=0 Jul 13 18:01:19.966590 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:19.966442 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerDied","Data":"e732584cde893d93710f94a09000eb13adbb7bc9a4ceb9e0a216d8f1187a5fcf"} Jul 13 18:01:20.020330 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:20.019858 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:20.020330 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:20.020005 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:20.020330 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:20.020063 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:01:22.020044582 +0000 UTC m=+40.738672329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:20.985029 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:20.983998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" event={"ID":"d9f91909-4f5c-4198-aa34-c9da21d0da64","Type":"ContainerStarted","Data":"c03a4047c4b9c93c520a3277667cac5dfc2303e97b3b2752d7463538d0e8f05e"} Jul 13 18:01:21.016167 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:21.015783 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vx5kv" podStartSLOduration=8.439235315 podStartE2EDuration="39.015759974s" totalImagesPullingTime="30.576524659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:21.013502623 +0000 UTC m=+39.732130384" watchObservedRunningTime="2026-07-13 18:01:21.015759974 +0000 UTC m=+39.734387734" Jul 13 18:01:21.945110 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:21.945068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:21.945542 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:21.945481 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:21.945542 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:21.945544 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:21.945695 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:21.945612 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:25.945591855 +0000 UTC m=+44.664219603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:22.046951 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:22.046575 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:22.046951 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:22.046716 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:22.046951 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:22.046775 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:01:26.046757053 +0000 UTC m=+44.765384803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:25.978182 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:25.978146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:25.978661 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:25.978335 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:25.978661 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:25.978354 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:25.978661 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:25.978406 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:33.97839104 +0000 UTC m=+52.697018774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:26.079616 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:26.079577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:26.079796 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:26.079705 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:26.079796 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:26.079768 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:01:34.079752026 +0000 UTC m=+52.798379764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:28.008342 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.008309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" event={"ID":"516620cc-8297-4a1d-89ce-a3e1a9e305be","Type":"ContainerStarted","Data":"b98c8288f5383b984768d704c06e0ca19c48662e7e787fe142eb79b75dc863bf"} Jul 13 18:01:28.008822 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.008351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" event={"ID":"516620cc-8297-4a1d-89ce-a3e1a9e305be","Type":"ContainerStarted","Data":"eb9a7b3c948980f4f50b0bb3e856c41d0120bd33b8fb5faf6cb35e33617fedbf"} Jul 13 18:01:28.008822 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.008369 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" event={"ID":"516620cc-8297-4a1d-89ce-a3e1a9e305be","Type":"ContainerStarted","Data":"e0139893b8a1c4659bf0804e40f922b702bd908821d601df82e99f83e734f99c"} Jul 13 18:01:28.009788 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.009763 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" event={"ID":"40a18d19-0df7-40df-9405-6bfe7d73a9b3","Type":"ContainerStarted","Data":"66b3dec70c417b0f95f5101a3e4c9201d73b9e0fd6da11240a3f3a63c9c0216f"} Jul 13 18:01:28.011255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.011235 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kz9nw" event={"ID":"4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f","Type":"ContainerStarted","Data":"122e2fa0e71b8ee7f501185bf4dab408457b4ce4d543f6d183b60ea4017d1765"} Jul 13 18:01:28.012504 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.012476 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" event={"ID":"d9f43482-41c7-487a-b3fc-c9e8eb92692a","Type":"ContainerStarted","Data":"ff7e52b001ea6ce11fc85484500e80630b4aed12f6466d30b518db09896d2367"} Jul 13 18:01:28.012685 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.012672 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:28.014330 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.014312 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" Jul 13 18:01:28.032191 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.032148 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" podStartSLOduration=20.832150559 podStartE2EDuration="29.032134488s" totalImagesPullingTime="8.199983929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:28.031507108 +0000 UTC m=+46.750134843" watchObservedRunningTime="2026-07-13 18:01:28.032134488 +0000 UTC m=+46.750762245" Jul 13 18:01:28.059626 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.059581 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b6767dcb4-drqcw" podStartSLOduration=20.857773094 podStartE2EDuration="29.059566441s" totalImagesPullingTime="8.201793347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:28.05895173 +0000 UTC m=+46.777579485" watchObservedRunningTime="2026-07-13 18:01:28.059566441 +0000 UTC m=+46.778194175" Jul 13 18:01:28.080853 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.080804 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57847949c9-j2vgt" podStartSLOduration=20.862244192 podStartE2EDuration="29.080789531s" totalImagesPullingTime="8.218545339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:28.079756408 +0000 UTC m=+46.798384165" watchObservedRunningTime="2026-07-13 18:01:28.080789531 +0000 UTC m=+46.799417287" Jul 13 18:01:28.096145 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:28.096096 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kz9nw" podStartSLOduration=1.894541673 podStartE2EDuration="10.096076865s" totalImagesPullingTime="8.201535192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:28.095753094 +0000 UTC m=+46.814380850" watchObservedRunningTime="2026-07-13 18:01:28.096076865 +0000 UTC m=+46.814704624" Jul 13 18:01:34.044252 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:34.044214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:34.044653 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:34.044340 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:34.044653 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:34.044351 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:34.044653 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:34.044410 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:50.044395842 +0000 UTC m=+68.763023577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:34.144566 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:34.144534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:34.144778 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:34.144682 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:34.144778 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:34.144741 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:01:50.144726739 +0000 UTC m=+68.863354475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:42.949138 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:42.949113 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6t7r" Jul 13 18:01:47.546613 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.546569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:01:47.547089 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.546666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:47.549940 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.549923 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 18:01:47.549988 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.549923 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 18:01:47.557339 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:47.557319 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 18:01:47.557407 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:47.557380 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs podName:2a12cdcb-1a6e-4e82-b1ae-ccf704382194 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:51.557364202 +0000 UTC m=+130.275991937 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs") pod "network-metrics-daemon-n29xm" (UID: "2a12cdcb-1a6e-4e82-b1ae-ccf704382194") : secret "metrics-daemon-secret" not found Jul 13 18:01:47.561263 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.561242 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31f73a1a-a36f-4a68-86c4-6b1439356b48-original-pull-secret\") pod \"global-pull-secret-syncer-tszs5\" (UID: \"31f73a1a-a36f-4a68-86c4-6b1439356b48\") " pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:47.605568 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.605534 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tszs5" Jul 13 18:01:47.647621 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.647578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:47.650532 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.650510 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 18:01:47.660925 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.660899 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 18:01:47.671345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.671268 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwzv\" (UniqueName: \"kubernetes.io/projected/aa56620a-1d9a-4abc-bfac-0b545f66b537-kube-api-access-tvwzv\") pod \"network-check-target-7tq6k\" (UID: \"aa56620a-1d9a-4abc-bfac-0b545f66b537\") " pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:47.728816 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.728776 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tszs5"] Jul 13 18:01:47.732129 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:01:47.732094 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f73a1a_a36f_4a68_86c4_6b1439356b48.slice/crio-81c9783c0145f57e3b5aba6e2f128ff69263a34ce2c6250e82c58513ba0d4f3e WatchSource:0}: Error finding container 81c9783c0145f57e3b5aba6e2f128ff69263a34ce2c6250e82c58513ba0d4f3e: Status 404 returned error can't find the container with id 81c9783c0145f57e3b5aba6e2f128ff69263a34ce2c6250e82c58513ba0d4f3e Jul 13 18:01:47.919683 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.919652 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t649t\"" Jul 13 18:01:47.927019 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:47.927000 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:48.055343 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:48.055313 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tq6k"] Jul 13 18:01:48.059255 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:01:48.059232 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa56620a_1d9a_4abc_bfac_0b545f66b537.slice/crio-e757b649d02d171b9dee24ccd40b222a967a55971c5e67359e96e9a7de06d029 WatchSource:0}: Error finding container e757b649d02d171b9dee24ccd40b222a967a55971c5e67359e96e9a7de06d029: Status 404 returned error can't find the container with id e757b649d02d171b9dee24ccd40b222a967a55971c5e67359e96e9a7de06d029 Jul 13 18:01:48.075016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:48.074988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tszs5" event={"ID":"31f73a1a-a36f-4a68-86c4-6b1439356b48","Type":"ContainerStarted","Data":"81c9783c0145f57e3b5aba6e2f128ff69263a34ce2c6250e82c58513ba0d4f3e"} Jul 13 18:01:48.076007 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:48.075985 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tq6k" event={"ID":"aa56620a-1d9a-4abc-bfac-0b545f66b537","Type":"ContainerStarted","Data":"e757b649d02d171b9dee24ccd40b222a967a55971c5e67359e96e9a7de06d029"} Jul 13 18:01:50.066108 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:50.066060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:01:50.066599 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:50.066236 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 18:01:50.066599 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:50.066261 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84884dbc79-sd7f6: secret "image-registry-tls" not found Jul 13 18:01:50.066599 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:50.066355 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls podName:d37c3f93-5563-46fc-becf-ba56367c9b53 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:22.066332656 +0000 UTC m=+100.784960392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls") pod "image-registry-84884dbc79-sd7f6" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53") : secret "image-registry-tls" not found Jul 13 18:01:50.167519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:50.167473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:01:50.167716 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:50.167655 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 18:01:50.167780 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:50.167733 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls podName:136e43e7-081d-441e-9104-cca7cf0c930a nodeName:}" failed. No retries permitted until 2026-07-13 18:02:22.167712247 +0000 UTC m=+100.886339982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls") pod "dns-default-vl6lr" (UID: "136e43e7-081d-441e-9104-cca7cf0c930a") : secret "dns-default-metrics-tls" not found Jul 13 18:01:51.086622 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:51.086588 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tq6k" event={"ID":"aa56620a-1d9a-4abc-bfac-0b545f66b537","Type":"ContainerStarted","Data":"e7f1f21d2d8e203d43630f2fc180d5426badf53318e77304136f8e1e2058f75e"} Jul 13 18:01:51.087042 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:51.086839 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:01:51.104683 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:51.104488 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7tq6k" podStartSLOduration=67.265826384 podStartE2EDuration="1m10.104468389s" totalImagesPullingTime="2.838642005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:51.104042078 +0000 UTC m=+69.822669838" watchObservedRunningTime="2026-07-13 18:01:51.104468389 +0000 UTC m=+69.823096147" Jul 13 18:01:52.360777 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.360712 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j2gk9"] Jul 13 18:01:52.362951 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.362931 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.365993 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.365965 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 18:01:52.367363 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.367341 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 18:01:52.367502 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.367361 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgd22\"" Jul 13 18:01:52.367502 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.367416 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 18:01:52.367502 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.367361 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 18:01:52.376155 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.376128 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2gk9"] Jul 13 18:01:52.488100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.488064 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.488100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.488112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da7ea96-6733-4798-980e-d1eac58b7360-data-volume\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.488345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.488130 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.488345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.488158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da7ea96-6733-4798-980e-d1eac58b7360-crio-socket\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.488345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.488257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvklk\" (UniqueName: \"kubernetes.io/projected/9da7ea96-6733-4798-980e-d1eac58b7360-kube-api-access-jvklk\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.588977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.588930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.589131 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.588989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da7ea96-6733-4798-980e-d1eac58b7360-data-volume\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.589131 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.589015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.589131 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.589043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da7ea96-6733-4798-980e-d1eac58b7360-crio-socket\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.589131 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:52.589089 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 18:01:52.589131 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.589118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvklk\" (UniqueName: \"kubernetes.io/projected/9da7ea96-6733-4798-980e-d1eac58b7360-kube-api-access-jvklk\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.589333 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:52.589155 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:53.089136573 +0000 UTC m=+71.807764328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : secret "insights-runtime-extractor-tls" not found Jul 13 18:01:52.589333 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.589308 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da7ea96-6733-4798-980e-d1eac58b7360-data-volume\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.589402 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:52.589371 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 18:01:52.589445 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:52.589415 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:53.08940223 +0000 UTC m=+71.808029966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : configmap "kube-rbac-proxy" not found Jul 13 18:01:52.589533 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.589512 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9da7ea96-6733-4798-980e-d1eac58b7360-crio-socket\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:52.598735 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:52.598710 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvklk\" (UniqueName: \"kubernetes.io/projected/9da7ea96-6733-4798-980e-d1eac58b7360-kube-api-access-jvklk\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:53.093322 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:53.093265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:53.093587 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:53.093425 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 18:01:53.093587 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:53.093503 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:54.093481563 +0000 UTC m=+72.812109298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : secret "insights-runtime-extractor-tls" not found Jul 13 18:01:53.099005 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:53.094931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:53.099005 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:53.095096 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 18:01:53.099005 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:53.095151 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:54.095135558 +0000 UTC m=+72.813763309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : configmap "kube-rbac-proxy" not found Jul 13 18:01:54.099231 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:54.099187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tszs5" event={"ID":"31f73a1a-a36f-4a68-86c4-6b1439356b48","Type":"ContainerStarted","Data":"f31d53c9097b56de862c0457479ab1afcf92ad375fdf364c4294c60140230536"} Jul 13 18:01:54.103701 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:54.103682 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:54.103795 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:54.103712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:54.103844 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:54.103830 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 18:01:54.103887 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:54.103834 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 18:01:54.103922 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:54.103895 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:56.1038783 +0000 UTC m=+74.822506050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : configmap "kube-rbac-proxy" not found Jul 13 18:01:54.103922 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:54.103912 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:01:56.103903832 +0000 UTC m=+74.822531567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : secret "insights-runtime-extractor-tls" not found Jul 13 18:01:54.115668 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:54.115622 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tszs5" podStartSLOduration=65.856739756 podStartE2EDuration="1m12.115606751s" totalImagesPullingTime="6.258866995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:54.115100599 +0000 UTC m=+72.833728357" watchObservedRunningTime="2026-07-13 18:01:54.115606751 +0000 UTC m=+72.834234486" Jul 13 18:01:55.445351 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:55.445322 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zc5p7_a054bc5d-3d61-4b56-b677-6071a37cfa1d/dns-node-resolver/0.log" Jul 13 18:01:56.119466 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:56.119431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:56.119466 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:56.119465 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:01:56.119713 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:56.119541 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 18:01:56.119713 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:56.119583 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 18:01:56.119713 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:56.119599 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:00.119585502 +0000 UTC m=+78.838213237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : configmap "kube-rbac-proxy" not found Jul 13 18:01:56.119713 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:01:56.119636 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:00.119623344 +0000 UTC m=+78.838251083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : secret "insights-runtime-extractor-tls" not found Jul 13 18:01:56.448486 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:56.448410 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nq9lq_2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f/node-ca/0.log" Jul 13 18:01:56.846730 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:01:56.846700 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kz9nw_4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f/serve-healthcheck-canary/0.log" Jul 13 18:02:00.151371 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:00.151328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:00.151371 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:00.151376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:00.151871 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:02:00.151498 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 18:02:00.151871 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:02:00.151502 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 18:02:00.151871 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:02:00.151551 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:08.151537583 +0000 UTC m=+86.870165317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : configmap "kube-rbac-proxy" not found Jul 13 18:02:00.151871 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:02:00.151582 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:08.151563797 +0000 UTC m=+86.870191532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : secret "insights-runtime-extractor-tls" not found Jul 13 18:02:08.217982 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:08.217923 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:08.217982 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:08.217983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:08.218584 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:02:08.218110 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 18:02:08.218584 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:02:08.218198 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls podName:9da7ea96-6733-4798-980e-d1eac58b7360 nodeName:}" failed. No retries permitted until 2026-07-13 18:02:24.218175472 +0000 UTC m=+102.936803213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j2gk9" (UID: "9da7ea96-6733-4798-980e-d1eac58b7360") : secret "insights-runtime-extractor-tls" not found Jul 13 18:02:08.218584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:08.218460 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9da7ea96-6733-4798-980e-d1eac58b7360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:22.092839 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.092810 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7tq6k" Jul 13 18:02:22.128159 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.128123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:02:22.130611 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.130582 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"image-registry-84884dbc79-sd7f6\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:02:22.228691 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.228653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:02:22.231070 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.231040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/136e43e7-081d-441e-9104-cca7cf0c930a-metrics-tls\") pod \"dns-default-vl6lr\" (UID: \"136e43e7-081d-441e-9104-cca7cf0c930a\") " pod="openshift-dns/dns-default-vl6lr" Jul 13 18:02:22.383271 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.383203 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rh55w\"" Jul 13 18:02:22.390656 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.390635 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:02:22.483515 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.483479 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mg7xr\"" Jul 13 18:02:22.491325 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.491300 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vl6lr" Jul 13 18:02:22.523253 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.523231 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84884dbc79-sd7f6"] Jul 13 18:02:22.525334 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:02:22.525271 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37c3f93_5563_46fc_becf_ba56367c9b53.slice/crio-88ec314d46a26f4f023fbd9653086153f713d5555602c6147791d0f73f4bf439 WatchSource:0}: Error finding container 88ec314d46a26f4f023fbd9653086153f713d5555602c6147791d0f73f4bf439: Status 404 returned error can't find the container with id 88ec314d46a26f4f023fbd9653086153f713d5555602c6147791d0f73f4bf439 Jul 13 18:02:22.636178 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:22.636158 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vl6lr"] Jul 13 18:02:22.638702 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:02:22.638676 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136e43e7_081d_441e_9104_cca7cf0c930a.slice/crio-c08899f700142e8ff1ec139376e767c50ca45922646eb46ccdc1a349c488e216 WatchSource:0}: Error finding container c08899f700142e8ff1ec139376e767c50ca45922646eb46ccdc1a349c488e216: Status 404 returned error can't find the container with id c08899f700142e8ff1ec139376e767c50ca45922646eb46ccdc1a349c488e216 Jul 13 18:02:23.184944 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:23.184905 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vl6lr" event={"ID":"136e43e7-081d-441e-9104-cca7cf0c930a","Type":"ContainerStarted","Data":"c08899f700142e8ff1ec139376e767c50ca45922646eb46ccdc1a349c488e216"} Jul 13 18:02:23.186232 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:23.186210 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" event={"ID":"d37c3f93-5563-46fc-becf-ba56367c9b53","Type":"ContainerStarted","Data":"227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7"} Jul 13 18:02:23.186338 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:23.186250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" event={"ID":"d37c3f93-5563-46fc-becf-ba56367c9b53","Type":"ContainerStarted","Data":"88ec314d46a26f4f023fbd9653086153f713d5555602c6147791d0f73f4bf439"} Jul 13 18:02:23.186421 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:23.186348 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:02:23.210120 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:23.210068 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" podStartSLOduration=101.210054155 podStartE2EDuration="1m41.210054155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:02:23.20824453 +0000 UTC m=+101.926872289" watchObservedRunningTime="2026-07-13 18:02:23.210054155 +0000 UTC m=+101.928681904" Jul 13 18:02:24.245535 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:24.245499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:24.247999 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:24.247980 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9da7ea96-6733-4798-980e-d1eac58b7360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2gk9\" (UID: \"9da7ea96-6733-4798-980e-d1eac58b7360\") " pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:24.474350 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:24.474316 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2gk9" Jul 13 18:02:24.640404 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:24.638608 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2gk9"] Jul 13 18:02:24.642184 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:02:24.642149 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da7ea96_6733_4798_980e_d1eac58b7360.slice/crio-be9db3669735ed55ca5eee25e14d5b61d9c09fcc1ef7d0066c37acd0daf655c7 WatchSource:0}: Error finding container be9db3669735ed55ca5eee25e14d5b61d9c09fcc1ef7d0066c37acd0daf655c7: Status 404 returned error can't find the container with id be9db3669735ed55ca5eee25e14d5b61d9c09fcc1ef7d0066c37acd0daf655c7 Jul 13 18:02:25.193797 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:25.193753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2gk9" event={"ID":"9da7ea96-6733-4798-980e-d1eac58b7360","Type":"ContainerStarted","Data":"be9db3669735ed55ca5eee25e14d5b61d9c09fcc1ef7d0066c37acd0daf655c7"} Jul 13 18:02:29.211483 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:29.211446 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vl6lr" event={"ID":"136e43e7-081d-441e-9104-cca7cf0c930a","Type":"ContainerStarted","Data":"7702ade77c9a0d85b192e3a11cfce6e7757c24f1b31f36a63f003beb3a74ded1"} Jul 13 18:02:29.211951 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:29.211506 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vl6lr" Jul 13 18:02:29.211951 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:29.211533 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vl6lr" event={"ID":"136e43e7-081d-441e-9104-cca7cf0c930a","Type":"ContainerStarted","Data":"baab709b6671e4bfcd2c3560e6fbaad66fe15769fa2a44ab0a466a97cab1eceb"} Jul 13 18:02:29.212840 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:29.212818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2gk9" event={"ID":"9da7ea96-6733-4798-980e-d1eac58b7360","Type":"ContainerStarted","Data":"34e111e83f6aed7271831d5373ff29d4daf466a711b65b863421812eedc102c0"} Jul 13 18:02:29.228509 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:29.228457 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vl6lr" podStartSLOduration=65.25573156 podStartE2EDuration="1m11.228443128s" totalImagesPullingTime="5.972711568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:02:29.227723152 +0000 UTC m=+107.946350910" watchObservedRunningTime="2026-07-13 18:02:29.228443128 +0000 UTC m=+107.947070886" Jul 13 18:02:32.227858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.227817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2gk9" event={"ID":"9da7ea96-6733-4798-980e-d1eac58b7360","Type":"ContainerStarted","Data":"4886ddee574037348c2ef2efe25dadf9fc0c06a01573c3702ce520ca6be6decc"} Jul 13 18:02:32.683901 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.683868 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qhl8w"] Jul 13 18:02:32.687220 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.687200 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.690458 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.690435 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 18:02:32.690775 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.690759 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 18:02:32.690987 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.690975 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 18:02:32.691911 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.691887 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 18:02:32.692911 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.692892 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 18:02:32.693000 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.692924 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7b64z\"" Jul 13 18:02:32.693463 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.693450 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 18:02:32.811821 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.811786 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-root\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.811854 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-tls\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.811890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-textfile\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.811921 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4729eb80-af14-4133-9701-ae48d314797f-metrics-client-ca\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.811956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.811981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phj6f\" (UniqueName: \"kubernetes.io/projected/4729eb80-af14-4133-9701-ae48d314797f-kube-api-access-phj6f\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.812004 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-wtmp\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.812023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-accelerators-collector-config\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.812255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.812039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-sys\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913374 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phj6f\" (UniqueName: \"kubernetes.io/projected/4729eb80-af14-4133-9701-ae48d314797f-kube-api-access-phj6f\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-wtmp\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913432 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-accelerators-collector-config\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913456 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-sys\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-root\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-tls\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913862 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-textfile\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913862 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913590 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-sys\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913862 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913605 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-wtmp\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913862 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4729eb80-af14-4133-9701-ae48d314797f-metrics-client-ca\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.913862 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.913703 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4729eb80-af14-4133-9701-ae48d314797f-root\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.914101 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.914047 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-textfile\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.914304 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.914256 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4729eb80-af14-4133-9701-ae48d314797f-metrics-client-ca\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.914403 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.914356 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-accelerators-collector-config\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.916180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.916151 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.918099 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.918076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4729eb80-af14-4133-9701-ae48d314797f-node-exporter-tls\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.922982 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.922936 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phj6f\" (UniqueName: \"kubernetes.io/projected/4729eb80-af14-4133-9701-ae48d314797f-kube-api-access-phj6f\") pod \"node-exporter-qhl8w\" (UID: \"4729eb80-af14-4133-9701-ae48d314797f\") " pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:32.996091 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:32.996015 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qhl8w" Jul 13 18:02:33.007536 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:02:33.007506 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4729eb80_af14_4133_9701_ae48d314797f.slice/crio-abeedec36de4542725083195cd66c558bc0d71840bccb1222d1f423e82e8f599 WatchSource:0}: Error finding container abeedec36de4542725083195cd66c558bc0d71840bccb1222d1f423e82e8f599: Status 404 returned error can't find the container with id abeedec36de4542725083195cd66c558bc0d71840bccb1222d1f423e82e8f599 Jul 13 18:02:33.233419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:33.233383 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhl8w" event={"ID":"4729eb80-af14-4133-9701-ae48d314797f","Type":"ContainerStarted","Data":"abeedec36de4542725083195cd66c558bc0d71840bccb1222d1f423e82e8f599"} Jul 13 18:02:35.242464 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:35.242433 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2gk9" event={"ID":"9da7ea96-6733-4798-980e-d1eac58b7360","Type":"ContainerStarted","Data":"edb62e3ea778247cb141129c12b6c2f034c4ac2d38bf736b9668a292377739d7"} Jul 13 18:02:35.243878 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:35.243855 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhl8w" event={"ID":"4729eb80-af14-4133-9701-ae48d314797f","Type":"ContainerStarted","Data":"804f4ade9c65e45244029f047bbc9f2eb04a123ad1efb9295074e10cbbd92d68"} Jul 13 18:02:35.262185 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:35.262127 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j2gk9" podStartSLOduration=32.91703089 podStartE2EDuration="43.262112072s" totalImagesPullingTime="10.345081182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:01:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:02:35.259960017 +0000 UTC m=+113.978587773" watchObservedRunningTime="2026-07-13 18:02:35.262112072 +0000 UTC m=+113.980739829" Jul 13 18:02:36.247963 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:36.247929 2582 generic.go:356] "Generic (PLEG): container finished" podID="4729eb80-af14-4133-9701-ae48d314797f" containerID="804f4ade9c65e45244029f047bbc9f2eb04a123ad1efb9295074e10cbbd92d68" exitCode=0 Jul 13 18:02:36.248385 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:36.248022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhl8w" event={"ID":"4729eb80-af14-4133-9701-ae48d314797f","Type":"ContainerDied","Data":"804f4ade9c65e45244029f047bbc9f2eb04a123ad1efb9295074e10cbbd92d68"} Jul 13 18:02:36.333530 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:36.333503 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84884dbc79-sd7f6"] Jul 13 18:02:37.254266 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:37.254236 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhl8w" event={"ID":"4729eb80-af14-4133-9701-ae48d314797f","Type":"ContainerStarted","Data":"e3b973499780b5295b63a660f83f3ab01ebce7055804fcdb6204f04adb098302"} Jul 13 18:02:37.254658 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:37.254311 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qhl8w" event={"ID":"4729eb80-af14-4133-9701-ae48d314797f","Type":"ContainerStarted","Data":"3f5ce9120e3ca0f67e4e576e1a6486959a2a4230121e01dda147c1ff8d9b864d"} Jul 13 18:02:37.277840 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:37.277796 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qhl8w" podStartSLOduration=3.128251066 podStartE2EDuration="5.277779589s" totalImagesPullingTime="2.078947413s" totalInitContainerRuntime="70.58111ms" isStatefulPod=true podCreationTimestamp="2026-07-13 18:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:02:37.275686672 +0000 UTC m=+115.994314429" watchObservedRunningTime="2026-07-13 18:02:37.277779589 +0000 UTC m=+115.996407347" Jul 13 18:02:38.532879 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:38.532835 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" podUID="516620cc-8297-4a1d-89ce-a3e1a9e305be" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 13 18:02:39.219086 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:39.219055 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vl6lr" Jul 13 18:02:46.339380 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:46.339350 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:02:48.532949 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:48.532913 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" podUID="516620cc-8297-4a1d-89ce-a3e1a9e305be" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 13 18:02:51.570249 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:51.570209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:02:51.572718 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:51.572687 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a12cdcb-1a6e-4e82-b1ae-ccf704382194-metrics-certs\") pod \"network-metrics-daemon-n29xm\" (UID: \"2a12cdcb-1a6e-4e82-b1ae-ccf704382194\") " pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:02:51.814418 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:51.814387 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7ngkz\"" Jul 13 18:02:51.822315 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:51.822252 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n29xm" Jul 13 18:02:51.949770 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:51.949746 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n29xm"] Jul 13 18:02:51.952135 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:02:51.952109 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a12cdcb_1a6e_4e82_b1ae_ccf704382194.slice/crio-994d48da96acce05c99cea24f7f490a261681393f74ff4ee786ebf8434d0b519 WatchSource:0}: Error finding container 994d48da96acce05c99cea24f7f490a261681393f74ff4ee786ebf8434d0b519: Status 404 returned error can't find the container with id 994d48da96acce05c99cea24f7f490a261681393f74ff4ee786ebf8434d0b519 Jul 13 18:02:52.307456 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:52.307421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n29xm" event={"ID":"2a12cdcb-1a6e-4e82-b1ae-ccf704382194","Type":"ContainerStarted","Data":"994d48da96acce05c99cea24f7f490a261681393f74ff4ee786ebf8434d0b519"} Jul 13 18:02:53.312380 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:53.312297 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n29xm" event={"ID":"2a12cdcb-1a6e-4e82-b1ae-ccf704382194","Type":"ContainerStarted","Data":"a81bbb6e7f06077a5fc2a84ef901a44c6ac2f01458c4f3c5f47a5c1ea1ae331e"} Jul 13 18:02:53.312380 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:53.312360 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n29xm" event={"ID":"2a12cdcb-1a6e-4e82-b1ae-ccf704382194","Type":"ContainerStarted","Data":"c0a5a36a7c9bc727768ca5d9818c55f81d1c692f55c6d2b071c393d58de25212"} Jul 13 18:02:53.331211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:53.331162 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n29xm" podStartSLOduration=131.341386156 podStartE2EDuration="2m12.331146453s" totalImagesPullingTime="989.760297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:02:53.330499833 +0000 UTC m=+132.049127590" watchObservedRunningTime="2026-07-13 18:02:53.331146453 +0000 UTC m=+132.049774210" Jul 13 18:02:58.533311 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:58.533250 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" podUID="516620cc-8297-4a1d-89ce-a3e1a9e305be" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 13 18:02:58.533694 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:58.533338 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" Jul 13 18:02:58.533841 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:58.533812 2582 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b98c8288f5383b984768d704c06e0ca19c48662e7e787fe142eb79b75dc863bf"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 13 18:02:58.533881 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:58.533863 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" podUID="516620cc-8297-4a1d-89ce-a3e1a9e305be" containerName="service-proxy" containerID="cri-o://b98c8288f5383b984768d704c06e0ca19c48662e7e787fe142eb79b75dc863bf" gracePeriod=30 Jul 13 18:02:59.333342 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:59.333307 2582 generic.go:356] "Generic (PLEG): container finished" podID="516620cc-8297-4a1d-89ce-a3e1a9e305be" containerID="b98c8288f5383b984768d704c06e0ca19c48662e7e787fe142eb79b75dc863bf" exitCode=2 Jul 13 18:02:59.333493 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:59.333380 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" event={"ID":"516620cc-8297-4a1d-89ce-a3e1a9e305be","Type":"ContainerDied","Data":"b98c8288f5383b984768d704c06e0ca19c48662e7e787fe142eb79b75dc863bf"} Jul 13 18:02:59.333493 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:02:59.333420 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f698c6f85-2zdx7" event={"ID":"516620cc-8297-4a1d-89ce-a3e1a9e305be","Type":"ContainerStarted","Data":"8d3787331106e9f43d84f25f2e6e842231a9e91062526bfd54acf521d93ba9d4"} Jul 13 18:03:01.363043 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.362990 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" podUID="d37c3f93-5563-46fc-becf-ba56367c9b53" containerName="registry" containerID="cri-o://227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7" gracePeriod=30 Jul 13 18:03:01.605175 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.605147 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:03:01.745521 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745435 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-image-registry-private-configuration\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745521 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745478 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-bound-sa-token\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745521 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745499 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-trusted-ca\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745524 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-installation-pull-secrets\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745548 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-certificates\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745590 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d37c3f93-5563-46fc-becf-ba56367c9b53-ca-trust-extracted\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745620 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.745876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.745646 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phm4f\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-kube-api-access-phm4f\") pod \"d37c3f93-5563-46fc-becf-ba56367c9b53\" (UID: \"d37c3f93-5563-46fc-becf-ba56367c9b53\") " Jul 13 18:03:01.746130 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.746019 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:03:01.746448 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.746406 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:03:01.748237 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.748204 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:03:01.748367 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.748245 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:03:01.748467 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.748434 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:03:01.748531 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.748483 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:03:01.748568 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.748530 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-kube-api-access-phm4f" (OuterVolumeSpecName: "kube-api-access-phm4f") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "kube-api-access-phm4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:03:01.754591 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.754565 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37c3f93-5563-46fc-becf-ba56367c9b53-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d37c3f93-5563-46fc-becf-ba56367c9b53" (UID: "d37c3f93-5563-46fc-becf-ba56367c9b53"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:03:01.846747 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846712 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d37c3f93-5563-46fc-becf-ba56367c9b53-ca-trust-extracted\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846747 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846741 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-tls\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846747 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846750 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phm4f\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-kube-api-access-phm4f\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846760 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-image-registry-private-configuration\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846771 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d37c3f93-5563-46fc-becf-ba56367c9b53-bound-sa-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846779 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-trusted-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846786 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d37c3f93-5563-46fc-becf-ba56367c9b53-installation-pull-secrets\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:01.846977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:01.846793 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d37c3f93-5563-46fc-becf-ba56367c9b53-registry-certificates\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:03:02.343481 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.343444 2582 generic.go:356] "Generic (PLEG): container finished" podID="d37c3f93-5563-46fc-becf-ba56367c9b53" containerID="227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7" exitCode=0 Jul 13 18:03:02.343692 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.343492 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" Jul 13 18:03:02.343692 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.343529 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" event={"ID":"d37c3f93-5563-46fc-becf-ba56367c9b53","Type":"ContainerDied","Data":"227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7"} Jul 13 18:03:02.343692 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.343594 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84884dbc79-sd7f6" event={"ID":"d37c3f93-5563-46fc-becf-ba56367c9b53","Type":"ContainerDied","Data":"88ec314d46a26f4f023fbd9653086153f713d5555602c6147791d0f73f4bf439"} Jul 13 18:03:02.343692 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.343623 2582 scope.go:117] "RemoveContainer" containerID="227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7" Jul 13 18:03:02.351701 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.351679 2582 scope.go:117] "RemoveContainer" containerID="227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7" Jul 13 18:03:02.351962 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:03:02.351942 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7\": container with ID starting with 227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7 not found: ID does not exist" containerID="227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7" Jul 13 18:03:02.352016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.351972 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7"} err="failed to get container status \"227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7\": rpc error: code = NotFound desc = could not find container \"227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7\": container with ID starting with 227099758ca01455597e5998209bfeac8bbdc96d4082d093db2a652ee90b4bb7 not found: ID does not exist" Jul 13 18:03:02.362008 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.361985 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84884dbc79-sd7f6"] Jul 13 18:03:02.365562 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:02.365541 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84884dbc79-sd7f6"] Jul 13 18:03:03.771829 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:03:03.771795 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37c3f93-5563-46fc-becf-ba56367c9b53" path="/var/lib/kubelet/pods/d37c3f93-5563-46fc-becf-ba56367c9b53/volumes" Jul 13 18:05:41.708110 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:05:41.708082 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:05:41.710821 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:05:41.710800 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 18:05:41.712937 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:05:41.712918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:06:25.673167 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.673134 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595"] Jul 13 18:06:25.673584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.673364 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37c3f93-5563-46fc-becf-ba56367c9b53" containerName="registry" Jul 13 18:06:25.673584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.673375 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37c3f93-5563-46fc-becf-ba56367c9b53" containerName="registry" Jul 13 18:06:25.673584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.673416 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37c3f93-5563-46fc-becf-ba56367c9b53" containerName="registry" Jul 13 18:06:25.676091 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.676075 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.678993 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.678968 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 18:06:25.679104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.678971 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 18:06:25.679104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.679023 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dkdv5\"" Jul 13 18:06:25.686266 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.686247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595"] Jul 13 18:06:25.689597 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.689564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.689706 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.689605 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xsjp\" (UniqueName: \"kubernetes.io/projected/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-kube-api-access-9xsjp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.689706 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.689640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.790528 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.790499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.790701 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.790546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xsjp\" (UniqueName: \"kubernetes.io/projected/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-kube-api-access-9xsjp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.790701 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.790580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.791002 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.790914 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.791002 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.790972 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.798989 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.798962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xsjp\" (UniqueName: \"kubernetes.io/projected/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-kube-api-access-9xsjp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:25.985122 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:25.985045 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:26.109222 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:26.109142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595"] Jul 13 18:06:26.111370 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:06:26.111327 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4a13ed_c02e_4276_a4e6_ecf93497d5bb.slice/crio-f70d8a708939a84fdf0b9b77b882959619f0bd3b507b51f28a3dd6a55ea5f495 WatchSource:0}: Error finding container f70d8a708939a84fdf0b9b77b882959619f0bd3b507b51f28a3dd6a55ea5f495: Status 404 returned error can't find the container with id f70d8a708939a84fdf0b9b77b882959619f0bd3b507b51f28a3dd6a55ea5f495 Jul 13 18:06:26.113315 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:26.113296 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 18:06:27.011377 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:27.011338 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" event={"ID":"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb","Type":"ContainerStarted","Data":"f70d8a708939a84fdf0b9b77b882959619f0bd3b507b51f28a3dd6a55ea5f495"} Jul 13 18:06:33.035485 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:33.035454 2582 generic.go:356] "Generic (PLEG): container finished" podID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerID="4f69c4738415d12b1ee9fedf3ae3db74b7eb5ab18fa5d4a25886b64cb2ceaacc" exitCode=0 Jul 13 18:06:33.035872 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:33.035514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" event={"ID":"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb","Type":"ContainerDied","Data":"4f69c4738415d12b1ee9fedf3ae3db74b7eb5ab18fa5d4a25886b64cb2ceaacc"} Jul 13 18:06:36.048649 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:36.048565 2582 generic.go:356] "Generic (PLEG): container finished" podID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerID="c60c681b3a2372fb379698453fe551eecb4c8ae2b6c265efdb8ecee990bc55c8" exitCode=0 Jul 13 18:06:36.048649 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:36.048629 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" event={"ID":"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb","Type":"ContainerDied","Data":"c60c681b3a2372fb379698453fe551eecb4c8ae2b6c265efdb8ecee990bc55c8"} Jul 13 18:06:45.080426 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:45.080338 2582 generic.go:356] "Generic (PLEG): container finished" podID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerID="b1ba7950e11b5d7fac9336589979cb72d1c2c33edbdf347b52640bcdc5c5d7cb" exitCode=0 Jul 13 18:06:45.080775 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:45.080432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" event={"ID":"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb","Type":"ContainerDied","Data":"b1ba7950e11b5d7fac9336589979cb72d1c2c33edbdf347b52640bcdc5c5d7cb"} Jul 13 18:06:46.199453 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.199431 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:46.233120 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.233095 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-util\") pod \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " Jul 13 18:06:46.233306 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.233154 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xsjp\" (UniqueName: \"kubernetes.io/projected/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-kube-api-access-9xsjp\") pod \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " Jul 13 18:06:46.233306 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.233176 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-bundle\") pod \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\" (UID: \"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb\") " Jul 13 18:06:46.233625 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.233601 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-bundle" (OuterVolumeSpecName: "bundle") pod "fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" (UID: "fd4a13ed-c02e-4276-a4e6-ecf93497d5bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:06:46.235510 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.235485 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-kube-api-access-9xsjp" (OuterVolumeSpecName: "kube-api-access-9xsjp") pod "fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" (UID: "fd4a13ed-c02e-4276-a4e6-ecf93497d5bb"). InnerVolumeSpecName "kube-api-access-9xsjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:06:46.237427 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.237404 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-util" (OuterVolumeSpecName: "util") pod "fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" (UID: "fd4a13ed-c02e-4276-a4e6-ecf93497d5bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:06:46.333653 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.333623 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xsjp\" (UniqueName: \"kubernetes.io/projected/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-kube-api-access-9xsjp\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:06:46.333653 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.333647 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:06:46.333653 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:46.333657 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd4a13ed-c02e-4276-a4e6-ecf93497d5bb-util\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:06:47.089265 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:47.089238 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" Jul 13 18:06:47.089265 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:47.089238 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpz595" event={"ID":"fd4a13ed-c02e-4276-a4e6-ecf93497d5bb","Type":"ContainerDied","Data":"f70d8a708939a84fdf0b9b77b882959619f0bd3b507b51f28a3dd6a55ea5f495"} Jul 13 18:06:47.089521 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:47.089309 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f70d8a708939a84fdf0b9b77b882959619f0bd3b507b51f28a3dd6a55ea5f495" Jul 13 18:06:49.733174 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733141 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m"] Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733464 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="extract" Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733482 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="extract" Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733496 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="util" Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733505 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="util" Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733514 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="pull" Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733522 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="pull" Jul 13 18:06:49.733672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.733604 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd4a13ed-c02e-4276-a4e6-ecf93497d5bb" containerName="extract" Jul 13 18:06:49.774072 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.774045 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m"] Jul 13 18:06:49.774241 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.774174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:49.777034 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.777007 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 18:06:49.777211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.777087 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 18:06:49.778382 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.778356 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-52j6m\"" Jul 13 18:06:49.859384 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.859347 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4wms\" (UniqueName: \"kubernetes.io/projected/e53f1061-bc2a-4f97-ab49-974014367280-kube-api-access-b4wms\") pod \"openshift-lws-operator-fd8ccff4c-ppg8m\" (UID: \"e53f1061-bc2a-4f97-ab49-974014367280\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:49.859384 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.859391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e53f1061-bc2a-4f97-ab49-974014367280-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ppg8m\" (UID: \"e53f1061-bc2a-4f97-ab49-974014367280\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:49.960341 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.960311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4wms\" (UniqueName: \"kubernetes.io/projected/e53f1061-bc2a-4f97-ab49-974014367280-kube-api-access-b4wms\") pod \"openshift-lws-operator-fd8ccff4c-ppg8m\" (UID: \"e53f1061-bc2a-4f97-ab49-974014367280\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:49.960465 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.960361 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e53f1061-bc2a-4f97-ab49-974014367280-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ppg8m\" (UID: \"e53f1061-bc2a-4f97-ab49-974014367280\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:49.960735 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.960714 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e53f1061-bc2a-4f97-ab49-974014367280-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ppg8m\" (UID: \"e53f1061-bc2a-4f97-ab49-974014367280\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:49.969410 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:49.969389 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4wms\" (UniqueName: \"kubernetes.io/projected/e53f1061-bc2a-4f97-ab49-974014367280-kube-api-access-b4wms\") pod \"openshift-lws-operator-fd8ccff4c-ppg8m\" (UID: \"e53f1061-bc2a-4f97-ab49-974014367280\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:50.083554 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:50.083478 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" Jul 13 18:06:50.227316 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:50.227270 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m"] Jul 13 18:06:50.230467 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:06:50.230425 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode53f1061_bc2a_4f97_ab49_974014367280.slice/crio-2ece227543ad78c19f58404c2e02198dbb984371cd3f07db71b00335905dab31 WatchSource:0}: Error finding container 2ece227543ad78c19f58404c2e02198dbb984371cd3f07db71b00335905dab31: Status 404 returned error can't find the container with id 2ece227543ad78c19f58404c2e02198dbb984371cd3f07db71b00335905dab31 Jul 13 18:06:51.104725 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:51.104689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" event={"ID":"e53f1061-bc2a-4f97-ab49-974014367280","Type":"ContainerStarted","Data":"2ece227543ad78c19f58404c2e02198dbb984371cd3f07db71b00335905dab31"} Jul 13 18:06:54.116397 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:54.116357 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" event={"ID":"e53f1061-bc2a-4f97-ab49-974014367280","Type":"ContainerStarted","Data":"354fac28b64018033853764153781c63988fb4ae105f9f9050c8fd02df73204c"} Jul 13 18:06:54.131945 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:54.131890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ppg8m" podStartSLOduration=1.663866637 podStartE2EDuration="5.131875616s" totalImagesPullingTime="3.468008979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:06:54.131514616 +0000 UTC m=+372.850142364" watchObservedRunningTime="2026-07-13 18:06:54.131875616 +0000 UTC m=+372.850503373" Jul 13 18:06:56.932980 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:56.932944 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n"] Jul 13 18:06:56.935045 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:56.935029 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:56.937743 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:56.937713 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 18:06:56.937844 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:56.937774 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 18:06:56.939143 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:56.939119 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dkdv5\"" Jul 13 18:06:56.944131 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:56.944112 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n"] Jul 13 18:06:57.011978 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.011942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.011978 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.011980 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.012195 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.012005 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkn92\" (UniqueName: \"kubernetes.io/projected/5173bb44-32eb-4002-853f-1d0239dc7a59-kube-api-access-gkn92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.112846 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.112814 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.112948 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.112853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkn92\" (UniqueName: \"kubernetes.io/projected/5173bb44-32eb-4002-853f-1d0239dc7a59-kube-api-access-gkn92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.112948 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.112925 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.113322 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.113272 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.113364 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.113271 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.121656 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.121634 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkn92\" (UniqueName: \"kubernetes.io/projected/5173bb44-32eb-4002-853f-1d0239dc7a59-kube-api-access-gkn92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.244069 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.243975 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:06:57.376488 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:57.376456 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n"] Jul 13 18:06:57.379308 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:06:57.379267 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5173bb44_32eb_4002_853f_1d0239dc7a59.slice/crio-58d86befac3396a7631f51ebf5089842073dbb8d1011985fecc8871624ce6ec2 WatchSource:0}: Error finding container 58d86befac3396a7631f51ebf5089842073dbb8d1011985fecc8871624ce6ec2: Status 404 returned error can't find the container with id 58d86befac3396a7631f51ebf5089842073dbb8d1011985fecc8871624ce6ec2 Jul 13 18:06:58.132033 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:58.132004 2582 generic.go:356] "Generic (PLEG): container finished" podID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerID="215524573b3815ef57859a47bf135ad638e3d56a3a5b2c64a70d0d654ffab7ef" exitCode=0 Jul 13 18:06:58.132469 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:58.132042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" event={"ID":"5173bb44-32eb-4002-853f-1d0239dc7a59","Type":"ContainerDied","Data":"215524573b3815ef57859a47bf135ad638e3d56a3a5b2c64a70d0d654ffab7ef"} Jul 13 18:06:58.132469 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:58.132086 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" event={"ID":"5173bb44-32eb-4002-853f-1d0239dc7a59","Type":"ContainerStarted","Data":"58d86befac3396a7631f51ebf5089842073dbb8d1011985fecc8871624ce6ec2"} Jul 13 18:06:59.141186 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:59.141154 2582 generic.go:356] "Generic (PLEG): container finished" podID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerID="ddfb07866e3d68d2ea6cce07c009fa8fe67ff0b246235d58f3c1871a30088596" exitCode=0 Jul 13 18:06:59.141567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:06:59.141226 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" event={"ID":"5173bb44-32eb-4002-853f-1d0239dc7a59","Type":"ContainerDied","Data":"ddfb07866e3d68d2ea6cce07c009fa8fe67ff0b246235d58f3c1871a30088596"} Jul 13 18:07:00.147440 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:00.147406 2582 generic.go:356] "Generic (PLEG): container finished" podID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerID="2a218d109f1ad791cda7eeb032a46d52841825e5e59f330299f9d1de1940f3fe" exitCode=0 Jul 13 18:07:00.147816 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:00.147474 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" event={"ID":"5173bb44-32eb-4002-853f-1d0239dc7a59","Type":"ContainerDied","Data":"2a218d109f1ad791cda7eeb032a46d52841825e5e59f330299f9d1de1940f3fe"} Jul 13 18:07:01.274816 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.274794 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:07:01.345097 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.345070 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkn92\" (UniqueName: \"kubernetes.io/projected/5173bb44-32eb-4002-853f-1d0239dc7a59-kube-api-access-gkn92\") pod \"5173bb44-32eb-4002-853f-1d0239dc7a59\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " Jul 13 18:07:01.345254 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.345110 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-util\") pod \"5173bb44-32eb-4002-853f-1d0239dc7a59\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " Jul 13 18:07:01.345254 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.345177 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-bundle\") pod \"5173bb44-32eb-4002-853f-1d0239dc7a59\" (UID: \"5173bb44-32eb-4002-853f-1d0239dc7a59\") " Jul 13 18:07:01.345913 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.345851 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-bundle" (OuterVolumeSpecName: "bundle") pod "5173bb44-32eb-4002-853f-1d0239dc7a59" (UID: "5173bb44-32eb-4002-853f-1d0239dc7a59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:01.347258 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.347233 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5173bb44-32eb-4002-853f-1d0239dc7a59-kube-api-access-gkn92" (OuterVolumeSpecName: "kube-api-access-gkn92") pod "5173bb44-32eb-4002-853f-1d0239dc7a59" (UID: "5173bb44-32eb-4002-853f-1d0239dc7a59"). InnerVolumeSpecName "kube-api-access-gkn92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:07:01.350559 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.350477 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-util" (OuterVolumeSpecName: "util") pod "5173bb44-32eb-4002-853f-1d0239dc7a59" (UID: "5173bb44-32eb-4002-853f-1d0239dc7a59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:01.446649 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.446577 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:01.446649 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.446600 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkn92\" (UniqueName: \"kubernetes.io/projected/5173bb44-32eb-4002-853f-1d0239dc7a59-kube-api-access-gkn92\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:01.446649 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:01.446610 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5173bb44-32eb-4002-853f-1d0239dc7a59-util\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:02.155602 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:02.155576 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" Jul 13 18:07:02.155602 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:02.155585 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjfn4n" event={"ID":"5173bb44-32eb-4002-853f-1d0239dc7a59","Type":"ContainerDied","Data":"58d86befac3396a7631f51ebf5089842073dbb8d1011985fecc8871624ce6ec2"} Jul 13 18:07:02.155801 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:02.155626 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58d86befac3396a7631f51ebf5089842073dbb8d1011985fecc8871624ce6ec2" Jul 13 18:07:12.827042 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827011 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x"] Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827237 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="util" Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827249 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="util" Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827256 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="extract" Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827262 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="extract" Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827304 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="pull" Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827312 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="pull" Jul 13 18:07:12.827419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.827359 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5173bb44-32eb-4002-853f-1d0239dc7a59" containerName="extract" Jul 13 18:07:12.829214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.829191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:12.832503 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.832480 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 18:07:12.833002 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.832980 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lbbpr\"" Jul 13 18:07:12.833621 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.833601 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 18:07:12.833724 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.833601 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 18:07:12.833724 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.833643 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 18:07:12.847620 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.847598 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x"] Jul 13 18:07:12.930082 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.930054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c888484-90f7-476d-a33a-0de8d343fa41-manifests\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:12.930216 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.930098 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c888484-90f7-476d-a33a-0de8d343fa41-tmp\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:12.930216 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.930126 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c888484-90f7-476d-a33a-0de8d343fa41-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:12.930216 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.930184 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c888484-90f7-476d-a33a-0de8d343fa41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:12.930216 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:12.930213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p8mw\" (UniqueName: \"kubernetes.io/projected/5c888484-90f7-476d-a33a-0de8d343fa41-kube-api-access-9p8mw\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.030548 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.030514 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c888484-90f7-476d-a33a-0de8d343fa41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.030548 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.030552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p8mw\" (UniqueName: \"kubernetes.io/projected/5c888484-90f7-476d-a33a-0de8d343fa41-kube-api-access-9p8mw\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.030748 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.030580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c888484-90f7-476d-a33a-0de8d343fa41-manifests\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.030748 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.030629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c888484-90f7-476d-a33a-0de8d343fa41-tmp\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.030748 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.030669 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c888484-90f7-476d-a33a-0de8d343fa41-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.031081 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.031051 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c888484-90f7-476d-a33a-0de8d343fa41-manifests\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.032920 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.032896 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c888484-90f7-476d-a33a-0de8d343fa41-tmp\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.033129 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.033111 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c888484-90f7-476d-a33a-0de8d343fa41-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.033187 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.033178 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c888484-90f7-476d-a33a-0de8d343fa41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.039224 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.039203 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p8mw\" (UniqueName: \"kubernetes.io/projected/5c888484-90f7-476d-a33a-0de8d343fa41-kube-api-access-9p8mw\") pod \"opendatahub-operator-controller-manager-6c99bf77dc-mng9x\" (UID: \"5c888484-90f7-476d-a33a-0de8d343fa41\") " pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.139412 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.139378 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:13.280020 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:13.279991 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x"] Jul 13 18:07:13.283345 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:13.283314 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c888484_90f7_476d_a33a_0de8d343fa41.slice/crio-b3ec37bb362d53f2020532396c8f9b58fec615cc52462d9dd24257d921d2235b WatchSource:0}: Error finding container b3ec37bb362d53f2020532396c8f9b58fec615cc52462d9dd24257d921d2235b: Status 404 returned error can't find the container with id b3ec37bb362d53f2020532396c8f9b58fec615cc52462d9dd24257d921d2235b Jul 13 18:07:14.201841 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:14.201802 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" event={"ID":"5c888484-90f7-476d-a33a-0de8d343fa41","Type":"ContainerStarted","Data":"b3ec37bb362d53f2020532396c8f9b58fec615cc52462d9dd24257d921d2235b"} Jul 13 18:07:18.218964 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:18.218921 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" event={"ID":"5c888484-90f7-476d-a33a-0de8d343fa41","Type":"ContainerStarted","Data":"4a3fc479d40c1ff9f293bb61ac242f53d78553fc3f60595d6b7f6bbfcd57356d"} Jul 13 18:07:19.224204 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:19.224166 2582 generic.go:356] "Generic (PLEG): container finished" podID="5c888484-90f7-476d-a33a-0de8d343fa41" containerID="4a3fc479d40c1ff9f293bb61ac242f53d78553fc3f60595d6b7f6bbfcd57356d" exitCode=0 Jul 13 18:07:19.224613 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:19.224234 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" event={"ID":"5c888484-90f7-476d-a33a-0de8d343fa41","Type":"ContainerDied","Data":"4a3fc479d40c1ff9f293bb61ac242f53d78553fc3f60595d6b7f6bbfcd57356d"} Jul 13 18:07:21.233611 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:21.233576 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" event={"ID":"5c888484-90f7-476d-a33a-0de8d343fa41","Type":"ContainerStarted","Data":"4668685384d24b7f69b4e3c015d608747f0b30b4fdec96832c7e368958e1a107"} Jul 13 18:07:21.234034 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:21.233729 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:21.257494 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:21.257446 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" podStartSLOduration=2.861715919 podStartE2EDuration="9.257430736s" totalImagesPullingTime="5.329086651s" totalInitContainerRuntime="1.066628166s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:21.256565467 +0000 UTC m=+399.975193224" watchObservedRunningTime="2026-07-13 18:07:21.257430736 +0000 UTC m=+399.976058493" Jul 13 18:07:32.239171 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:32.239142 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c99bf77dc-mng9x" Jul 13 18:07:36.178757 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.178721 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7"] Jul 13 18:07:36.181897 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.181875 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.184784 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.184684 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 18:07:36.184784 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.184747 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 18:07:36.184924 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.184888 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qbngj\"" Jul 13 18:07:36.186177 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.186155 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 18:07:36.186942 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.186928 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 18:07:36.193246 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.193228 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7"] Jul 13 18:07:36.293566 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.293531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8125be9e-a8a3-42ae-aca5-68829503a4eb-tls-certs\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.293732 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.293576 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/8125be9e-a8a3-42ae-aca5-68829503a4eb-kube-api-access-np5xw\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.293732 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.293632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8125be9e-a8a3-42ae-aca5-68829503a4eb-tmp\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.304461 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.304430 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mftg7"] Jul 13 18:07:36.307494 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.307475 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:36.310320 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.310296 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cvnbs\"" Jul 13 18:07:36.310432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.310333 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 13 18:07:36.318349 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.318330 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mftg7"] Jul 13 18:07:36.394754 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.394713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8125be9e-a8a3-42ae-aca5-68829503a4eb-tmp\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.394934 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.394763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/822c63d6-feb7-4bd4-bc4f-df92bd915699-cert\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:36.394934 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.394784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qpf\" (UniqueName: \"kubernetes.io/projected/822c63d6-feb7-4bd4-bc4f-df92bd915699-kube-api-access-54qpf\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:36.394934 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.394807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8125be9e-a8a3-42ae-aca5-68829503a4eb-tls-certs\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.394934 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.394874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/8125be9e-a8a3-42ae-aca5-68829503a4eb-kube-api-access-np5xw\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.397112 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.397082 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8125be9e-a8a3-42ae-aca5-68829503a4eb-tmp\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.397327 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.397309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8125be9e-a8a3-42ae-aca5-68829503a4eb-tls-certs\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.403983 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.403962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/8125be9e-a8a3-42ae-aca5-68829503a4eb-kube-api-access-np5xw\") pod \"kube-auth-proxy-7d57c78c9f-7rmp7\" (UID: \"8125be9e-a8a3-42ae-aca5-68829503a4eb\") " pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.491552 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.491465 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" Jul 13 18:07:36.495642 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.495620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/822c63d6-feb7-4bd4-bc4f-df92bd915699-cert\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:36.495713 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.495651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qpf\" (UniqueName: \"kubernetes.io/projected/822c63d6-feb7-4bd4-bc4f-df92bd915699-kube-api-access-54qpf\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:36.495778 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:07:36.495757 2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 13 18:07:36.495840 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:07:36.495831 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822c63d6-feb7-4bd4-bc4f-df92bd915699-cert podName:822c63d6-feb7-4bd4-bc4f-df92bd915699 nodeName:}" failed. No retries permitted until 2026-07-13 18:07:36.995813019 +0000 UTC m=+415.714440754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/822c63d6-feb7-4bd4-bc4f-df92bd915699-cert") pod "odh-model-controller-7998c67dc4-mftg7" (UID: "822c63d6-feb7-4bd4-bc4f-df92bd915699") : secret "odh-model-controller-webhook-cert" not found Jul 13 18:07:36.506994 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.506959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qpf\" (UniqueName: \"kubernetes.io/projected/822c63d6-feb7-4bd4-bc4f-df92bd915699-kube-api-access-54qpf\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:36.620051 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.620020 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7"] Jul 13 18:07:36.622339 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:36.622311 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8125be9e_a8a3_42ae_aca5_68829503a4eb.slice/crio-bcd5ddeab95e01d4fce7cbd247fc6cd6b3ca11d1ce12447c276b081aa3429caa WatchSource:0}: Error finding container bcd5ddeab95e01d4fce7cbd247fc6cd6b3ca11d1ce12447c276b081aa3429caa: Status 404 returned error can't find the container with id bcd5ddeab95e01d4fce7cbd247fc6cd6b3ca11d1ce12447c276b081aa3429caa Jul 13 18:07:36.663986 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.663948 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wms9v"] Jul 13 18:07:36.668246 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.668225 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.670834 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.670813 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 13 18:07:36.678780 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.678755 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wms9v"] Jul 13 18:07:36.798870 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.798787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n6w7\" (UniqueName: \"kubernetes.io/projected/bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044-kube-api-access-4n6w7\") pod \"model-serving-api-54d89bd5fc-wms9v\" (UID: \"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.798870 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.798845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wms9v\" (UID: \"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.900765 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.900057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n6w7\" (UniqueName: \"kubernetes.io/projected/bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044-kube-api-access-4n6w7\") pod \"model-serving-api-54d89bd5fc-wms9v\" (UID: \"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.900765 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.900182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wms9v\" (UID: \"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.903962 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.903923 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044-tls-certs\") pod \"model-serving-api-54d89bd5fc-wms9v\" (UID: \"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.914100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.914080 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n6w7\" (UniqueName: \"kubernetes.io/projected/bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044-kube-api-access-4n6w7\") pod \"model-serving-api-54d89bd5fc-wms9v\" (UID: \"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044\") " pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:36.977840 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:36.977818 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:37.001004 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.000978 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/822c63d6-feb7-4bd4-bc4f-df92bd915699-cert\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:37.003582 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.003550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/822c63d6-feb7-4bd4-bc4f-df92bd915699-cert\") pod \"odh-model-controller-7998c67dc4-mftg7\" (UID: \"822c63d6-feb7-4bd4-bc4f-df92bd915699\") " pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:37.116778 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.116749 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wms9v"] Jul 13 18:07:37.119462 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:37.119435 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2fd0fd_c758_4f01_a9f4_f9a7d2ad2044.slice/crio-e3b61f968d729c9f82df2d145a855c27a5aac590a97021e6d008245d6e58989b WatchSource:0}: Error finding container e3b61f968d729c9f82df2d145a855c27a5aac590a97021e6d008245d6e58989b: Status 404 returned error can't find the container with id e3b61f968d729c9f82df2d145a855c27a5aac590a97021e6d008245d6e58989b Jul 13 18:07:37.216770 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.216732 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:37.290041 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.290007 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" event={"ID":"8125be9e-a8a3-42ae-aca5-68829503a4eb","Type":"ContainerStarted","Data":"bcd5ddeab95e01d4fce7cbd247fc6cd6b3ca11d1ce12447c276b081aa3429caa"} Jul 13 18:07:37.291190 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.291161 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" event={"ID":"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044","Type":"ContainerStarted","Data":"e3b61f968d729c9f82df2d145a855c27a5aac590a97021e6d008245d6e58989b"} Jul 13 18:07:37.344703 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.344677 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mftg7"] Jul 13 18:07:37.347088 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:37.347061 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822c63d6_feb7_4bd4_bc4f_df92bd915699.slice/crio-fccc5afc8b20dd7c6979da0463249f13b1eee61fde0e8116039f34dcb91ef6fd WatchSource:0}: Error finding container fccc5afc8b20dd7c6979da0463249f13b1eee61fde0e8116039f34dcb91ef6fd: Status 404 returned error can't find the container with id fccc5afc8b20dd7c6979da0463249f13b1eee61fde0e8116039f34dcb91ef6fd Jul 13 18:07:37.377164 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.377134 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f68sp"] Jul 13 18:07:37.381401 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.381385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.384273 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.384231 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 18:07:37.384273 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.384249 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 18:07:37.384273 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.384260 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 18:07:37.384273 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.384250 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 18:07:37.384504 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.384301 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nj8qv\"" Jul 13 18:07:37.392909 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.392887 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f68sp"] Jul 13 18:07:37.504935 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.504898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.504935 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.504930 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-cacerts\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.505127 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.504949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q5z9\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-kube-api-access-6q5z9\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.505127 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.505024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-token\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.505127 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.505068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.505127 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.505087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-local-certs\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.505127 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.505114 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606441 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606441 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606417 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606441 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606444 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-cacerts\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606700 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606467 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q5z9\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-kube-api-access-6q5z9\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606700 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-token\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606700 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.606700 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.606574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-local-certs\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.607110 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.607083 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.609151 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.609127 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.609239 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.609127 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-local-certs\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.609239 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.609181 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.609239 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.609190 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-cacerts\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.615223 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.615193 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q5z9\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-kube-api-access-6q5z9\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.615323 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.615195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-token\") pod \"istiod-openshift-gateway-7574459656-f68sp\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.690484 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.690439 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:37.828214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:37.828182 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f68sp"] Jul 13 18:07:37.831258 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:37.831229 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76027ff_fa0a_43f9_bb85_3945c4aaff5e.slice/crio-5f50d963ae4e6ccc3e015e8e015d587ee8261cdc28c469c1d4b8736b334022b4 WatchSource:0}: Error finding container 5f50d963ae4e6ccc3e015e8e015d587ee8261cdc28c469c1d4b8736b334022b4: Status 404 returned error can't find the container with id 5f50d963ae4e6ccc3e015e8e015d587ee8261cdc28c469c1d4b8736b334022b4 Jul 13 18:07:38.298344 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:38.298301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" event={"ID":"f76027ff-fa0a-43f9-bb85-3945c4aaff5e","Type":"ContainerStarted","Data":"5f50d963ae4e6ccc3e015e8e015d587ee8261cdc28c469c1d4b8736b334022b4"} Jul 13 18:07:38.299858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:38.299831 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" event={"ID":"822c63d6-feb7-4bd4-bc4f-df92bd915699","Type":"ContainerStarted","Data":"fccc5afc8b20dd7c6979da0463249f13b1eee61fde0e8116039f34dcb91ef6fd"} Jul 13 18:07:41.926765 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:41.926740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 18:07:42.320612 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:42.320531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" event={"ID":"bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044","Type":"ContainerStarted","Data":"9e1daae275cdcf4e965e659884fae896ab85b2b56833513180bc1a4c39a7f9b2"} Jul 13 18:07:42.320794 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:42.320669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:42.337342 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:42.337290 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" podStartSLOduration=1.5400688809999998 podStartE2EDuration="6.337255337s" totalImagesPullingTime="4.797186456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:42.335677836 +0000 UTC m=+421.054305611" watchObservedRunningTime="2026-07-13 18:07:42.337255337 +0000 UTC m=+421.055883096" Jul 13 18:07:42.503293 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:42.503230 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:07:42.503451 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:42.503342 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:07:43.327504 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.327467 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" event={"ID":"f76027ff-fa0a-43f9-bb85-3945c4aaff5e","Type":"ContainerStarted","Data":"152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9"} Jul 13 18:07:43.328108 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.327652 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:43.329582 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.329547 2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-f68sp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 18:07:43.329716 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.329616 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" podUID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 18:07:43.330133 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.330101 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" event={"ID":"8125be9e-a8a3-42ae-aca5-68829503a4eb","Type":"ContainerStarted","Data":"bbc31a299ddd301526f40a06b3447d353bda7bf252e98330d4b1f134011fa209"} Jul 13 18:07:43.331769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.331740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" event={"ID":"822c63d6-feb7-4bd4-bc4f-df92bd915699","Type":"ContainerStarted","Data":"ccfe90115778def6c721e2bb720d2127ecbc97e061a67b1e62579f9ff236ff0c"} Jul 13 18:07:43.364831 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.364770 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" podStartSLOduration=1.695574218 podStartE2EDuration="6.364746655s" totalImagesPullingTime="4.669172437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:43.363789843 +0000 UTC m=+422.082417601" watchObservedRunningTime="2026-07-13 18:07:43.364746655 +0000 UTC m=+422.083374413" Jul 13 18:07:43.390303 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.390230 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d57c78c9f-7rmp7" podStartSLOduration=2.090194462 podStartE2EDuration="7.390215169s" totalImagesPullingTime="5.300020707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:43.389530221 +0000 UTC m=+422.108157991" watchObservedRunningTime="2026-07-13 18:07:43.390215169 +0000 UTC m=+422.108842926" Jul 13 18:07:43.409641 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:43.409577 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" podStartSLOduration=2.202966712 podStartE2EDuration="7.409556858s" totalImagesPullingTime="5.206590146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:43.409011328 +0000 UTC m=+422.127639087" watchObservedRunningTime="2026-07-13 18:07:43.409556858 +0000 UTC m=+422.128184617" Jul 13 18:07:44.119945 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.119908 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5"] Jul 13 18:07:44.123146 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.123131 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.128035 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.128015 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hjpjp\"" Jul 13 18:07:44.146201 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.146177 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5"] Jul 13 18:07:44.258652 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.258838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.258838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258696 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.258838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258736 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.258838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258778 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7m2g\" (UniqueName: \"kubernetes.io/projected/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-kube-api-access-j7m2g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.258838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.259100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.259100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258881 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.259100 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.258949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.335674 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.335639 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:07:44.336196 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.336178 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:44.360271 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360244 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360427 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360427 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360525 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360503 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360534 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360682 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360682 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360682 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7m2g\" (UniqueName: \"kubernetes.io/projected/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-kube-api-access-j7m2g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360713 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360774 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.360988 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.360967 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.361122 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.361107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.361218 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.361196 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.362921 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.362904 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.363016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.362953 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.376676 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.376623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.377374 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.377351 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7m2g\" (UniqueName: \"kubernetes.io/projected/d7ae35b7-e826-4415-bb78-d3cf29e41eaf-kube-api-access-j7m2g\") pod \"data-science-gateway-data-science-gateway-class-6576859cf486pj5\" (UID: \"d7ae35b7-e826-4415-bb78-d3cf29e41eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.433164 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.433123 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:44.582167 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:44.582125 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ae35b7_e826_4415_bb78_d3cf29e41eaf.slice/crio-c144ecdbd1a2a1f570484c2b6ba23e50161098596bbea29b083fd5f394a209c5 WatchSource:0}: Error finding container c144ecdbd1a2a1f570484c2b6ba23e50161098596bbea29b083fd5f394a209c5: Status 404 returned error can't find the container with id c144ecdbd1a2a1f570484c2b6ba23e50161098596bbea29b083fd5f394a209c5 Jul 13 18:07:44.583420 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:44.583396 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5"] Jul 13 18:07:45.341658 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:45.341602 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" event={"ID":"d7ae35b7-e826-4415-bb78-d3cf29e41eaf","Type":"ContainerStarted","Data":"c144ecdbd1a2a1f570484c2b6ba23e50161098596bbea29b083fd5f394a209c5"} Jul 13 18:07:46.738204 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.738166 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh"] Jul 13 18:07:46.745682 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.745654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:46.749972 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.749948 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 13 18:07:46.749972 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.749965 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zbz5v\"" Jul 13 18:07:46.750320 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.750303 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s"] Jul 13 18:07:46.753606 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.753585 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:46.756763 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.756735 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 13 18:07:46.756763 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.756740 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vrtmr\"" Jul 13 18:07:46.772855 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.772830 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh"] Jul 13 18:07:46.774584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.774557 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s"] Jul 13 18:07:46.884106 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.884069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh9n\" (UniqueName: \"kubernetes.io/projected/81cfe289-66b3-4546-adc8-2d2a06f8d147-kube-api-access-fmh9n\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:46.884311 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.884168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cfe289-66b3-4546-adc8-2d2a06f8d147-cert\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:46.884311 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.884199 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/682b5814-bb37-47ec-b70c-db4d81b72e5e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mzd4s\" (UID: \"682b5814-bb37-47ec-b70c-db4d81b72e5e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:46.884311 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.884292 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqkcn\" (UniqueName: \"kubernetes.io/projected/682b5814-bb37-47ec-b70c-db4d81b72e5e-kube-api-access-kqkcn\") pod \"llmisvc-controller-manager-777c6bd7d5-mzd4s\" (UID: \"682b5814-bb37-47ec-b70c-db4d81b72e5e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:46.985717 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.985677 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cfe289-66b3-4546-adc8-2d2a06f8d147-cert\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:46.985912 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.985725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/682b5814-bb37-47ec-b70c-db4d81b72e5e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mzd4s\" (UID: \"682b5814-bb37-47ec-b70c-db4d81b72e5e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:46.985912 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.985782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqkcn\" (UniqueName: \"kubernetes.io/projected/682b5814-bb37-47ec-b70c-db4d81b72e5e-kube-api-access-kqkcn\") pod \"llmisvc-controller-manager-777c6bd7d5-mzd4s\" (UID: \"682b5814-bb37-47ec-b70c-db4d81b72e5e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:46.985912 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:07:46.985814 2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 13 18:07:46.985912 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:07:46.985891 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81cfe289-66b3-4546-adc8-2d2a06f8d147-cert podName:81cfe289-66b3-4546-adc8-2d2a06f8d147 nodeName:}" failed. No retries permitted until 2026-07-13 18:07:47.485872502 +0000 UTC m=+426.204500238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/81cfe289-66b3-4546-adc8-2d2a06f8d147-cert") pod "kserve-controller-manager-d6f4b65b8-tz4mh" (UID: "81cfe289-66b3-4546-adc8-2d2a06f8d147") : secret "kserve-webhook-server-cert" not found Jul 13 18:07:46.986130 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.985985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh9n\" (UniqueName: \"kubernetes.io/projected/81cfe289-66b3-4546-adc8-2d2a06f8d147-kube-api-access-fmh9n\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:46.988680 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:46.988627 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/682b5814-bb37-47ec-b70c-db4d81b72e5e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mzd4s\" (UID: \"682b5814-bb37-47ec-b70c-db4d81b72e5e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:47.003446 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.003417 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh9n\" (UniqueName: \"kubernetes.io/projected/81cfe289-66b3-4546-adc8-2d2a06f8d147-kube-api-access-fmh9n\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:47.003791 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.003760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqkcn\" (UniqueName: \"kubernetes.io/projected/682b5814-bb37-47ec-b70c-db4d81b72e5e-kube-api-access-kqkcn\") pod \"llmisvc-controller-manager-777c6bd7d5-mzd4s\" (UID: \"682b5814-bb37-47ec-b70c-db4d81b72e5e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:47.067836 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.067803 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:47.255725 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.255685 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:07:47.255817 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.255761 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:07:47.255817 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.255792 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:07:47.319858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.319764 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s"] Jul 13 18:07:47.321757 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:47.321731 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod682b5814_bb37_47ec_b70c_db4d81b72e5e.slice/crio-993c3fc3f46e28886c55ad5a71070cf1478d2922b04e16b8563602f5d0081e42 WatchSource:0}: Error finding container 993c3fc3f46e28886c55ad5a71070cf1478d2922b04e16b8563602f5d0081e42: Status 404 returned error can't find the container with id 993c3fc3f46e28886c55ad5a71070cf1478d2922b04e16b8563602f5d0081e42 Jul 13 18:07:47.354735 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.354701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" event={"ID":"682b5814-bb37-47ec-b70c-db4d81b72e5e","Type":"ContainerStarted","Data":"993c3fc3f46e28886c55ad5a71070cf1478d2922b04e16b8563602f5d0081e42"} Jul 13 18:07:47.356447 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.356417 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" event={"ID":"d7ae35b7-e826-4415-bb78-d3cf29e41eaf","Type":"ContainerStarted","Data":"11f89c19f6c4dcc6b54d24352bbc6512161e531fc960f3b8fb41413926fe05ce"} Jul 13 18:07:47.380592 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.380520 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" podStartSLOduration=0.709494904 podStartE2EDuration="3.380503005s" totalImagesPullingTime="2.671008101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:47.379037363 +0000 UTC m=+426.097665119" watchObservedRunningTime="2026-07-13 18:07:47.380503005 +0000 UTC m=+426.099130828" Jul 13 18:07:47.433963 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.433931 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:47.495479 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.490452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cfe289-66b3-4546-adc8-2d2a06f8d147-cert\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:47.495479 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.494952 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cfe289-66b3-4546-adc8-2d2a06f8d147-cert\") pod \"kserve-controller-manager-d6f4b65b8-tz4mh\" (UID: \"81cfe289-66b3-4546-adc8-2d2a06f8d147\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:47.660712 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.660681 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:47.797635 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.797474 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh"] Jul 13 18:07:47.800204 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:07:47.800178 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cfe289_66b3_4546_adc8_2d2a06f8d147.slice/crio-a707698643a84870c3258b41aae65d2e6478c53eb833f0a312414bbd1db0faee WatchSource:0}: Error finding container a707698643a84870c3258b41aae65d2e6478c53eb833f0a312414bbd1db0faee: Status 404 returned error can't find the container with id a707698643a84870c3258b41aae65d2e6478c53eb833f0a312414bbd1db0faee Jul 13 18:07:47.939834 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.939740 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f68sp"] Jul 13 18:07:47.939956 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:47.939927 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" podUID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" containerName="discovery" containerID="cri-o://152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9" gracePeriod=30 Jul 13 18:07:48.179942 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.179916 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:48.298741 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298664 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-kubeconfig\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.298741 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298724 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q5z9\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-kube-api-access-6q5z9\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.298952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298789 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-dns-cert\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.298952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298830 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-cacerts\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.298952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298861 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-ca-configmap\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.298952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298895 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-token\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.298952 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.298924 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-local-certs\") pod \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\" (UID: \"f76027ff-fa0a-43f9-bb85-3945c4aaff5e\") " Jul 13 18:07:48.299396 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.299257 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:07:48.301257 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.301212 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-local-certs" (OuterVolumeSpecName: "local-certs") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:07:48.301514 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.301426 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:07:48.301514 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.301447 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-kube-api-access-6q5z9" (OuterVolumeSpecName: "kube-api-access-6q5z9") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "kube-api-access-6q5z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:07:48.301514 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.301465 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:07:48.301514 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.301473 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:07:48.301514 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.301446 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-cacerts" (OuterVolumeSpecName: "cacerts") pod "f76027ff-fa0a-43f9-bb85-3945c4aaff5e" (UID: "f76027ff-fa0a-43f9-bb85-3945c4aaff5e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:07:48.361472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.361444 2582 generic.go:356] "Generic (PLEG): container finished" podID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" containerID="152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9" exitCode=0 Jul 13 18:07:48.361620 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.361487 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" Jul 13 18:07:48.361620 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.361532 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" event={"ID":"f76027ff-fa0a-43f9-bb85-3945c4aaff5e","Type":"ContainerDied","Data":"152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9"} Jul 13 18:07:48.361620 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.361575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-f68sp" event={"ID":"f76027ff-fa0a-43f9-bb85-3945c4aaff5e","Type":"ContainerDied","Data":"5f50d963ae4e6ccc3e015e8e015d587ee8261cdc28c469c1d4b8736b334022b4"} Jul 13 18:07:48.361620 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.361596 2582 scope.go:117] "RemoveContainer" containerID="152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9" Jul 13 18:07:48.362844 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.362819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" event={"ID":"81cfe289-66b3-4546-adc8-2d2a06f8d147","Type":"ContainerStarted","Data":"a707698643a84870c3258b41aae65d2e6478c53eb833f0a312414bbd1db0faee"} Jul 13 18:07:48.370858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.370839 2582 scope.go:117] "RemoveContainer" containerID="152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9" Jul 13 18:07:48.371121 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:07:48.371103 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9\": container with ID starting with 152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9 not found: ID does not exist" containerID="152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9" Jul 13 18:07:48.371176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.371129 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9"} err="failed to get container status \"152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9\": rpc error: code = NotFound desc = could not find container \"152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9\": container with ID starting with 152aeee624a63fa47665b1859994f2ad806e2ddafe04f18115cfa07af28f11b9 not found: ID does not exist" Jul 13 18:07:48.385522 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.385498 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f68sp"] Jul 13 18:07:48.398840 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.398807 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-f68sp"] Jul 13 18:07:48.402062 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402038 2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-kubeconfig\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.402176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402066 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q5z9\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-kube-api-access-6q5z9\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.402176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402081 2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-dns-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.402176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402094 2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-cacerts\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.402176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402106 2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-csr-ca-configmap\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.402176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402118 2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.402176 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.402129 2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f76027ff-fa0a-43f9-bb85-3945c4aaff5e-local-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:07:48.439970 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:48.439942 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:49.368864 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:49.368838 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:49.369730 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:49.369711 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf486pj5" Jul 13 18:07:49.773852 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:49.773770 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" path="/var/lib/kubelet/pods/f76027ff-fa0a-43f9-bb85-3945c4aaff5e/volumes" Jul 13 18:07:52.383054 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:52.383018 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" event={"ID":"682b5814-bb37-47ec-b70c-db4d81b72e5e","Type":"ContainerStarted","Data":"ae7b5012c86eecf2cf5a150606017f804ed7b1942afab0eb5f3b228178b8bbf7"} Jul 13 18:07:52.383534 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:52.383114 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:07:52.384516 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:52.384495 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" event={"ID":"81cfe289-66b3-4546-adc8-2d2a06f8d147","Type":"ContainerStarted","Data":"226c2c633fd49d8bbfd1c87c4f82d56504b406117affbef9f0a7822b033e8ea5"} Jul 13 18:07:52.384599 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:52.384535 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:07:52.400694 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:52.400650 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" podStartSLOduration=2.136090383 podStartE2EDuration="6.400635743s" totalImagesPullingTime="4.26454536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:52.400321177 +0000 UTC m=+431.118948934" watchObservedRunningTime="2026-07-13 18:07:52.400635743 +0000 UTC m=+431.119263482" Jul 13 18:07:52.417743 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:52.417696 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" podStartSLOduration=2.69834571 podStartE2EDuration="6.417683691s" totalImagesPullingTime="3.719337981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:07:52.416508007 +0000 UTC m=+431.135135764" watchObservedRunningTime="2026-07-13 18:07:52.417683691 +0000 UTC m=+431.136311499" Jul 13 18:07:53.337618 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:53.337589 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wms9v" Jul 13 18:07:55.344291 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:07:55.344257 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mftg7" Jul 13 18:08:23.401498 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:23.401471 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mzd4s" Jul 13 18:08:23.404575 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:23.404552 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tz4mh" Jul 13 18:08:35.882554 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.882516 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrkts"] Jul 13 18:08:35.883018 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.882803 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" containerName="discovery" Jul 13 18:08:35.883018 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.882813 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" containerName="discovery" Jul 13 18:08:35.883018 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.882868 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f76027ff-fa0a-43f9-bb85-3945c4aaff5e" containerName="discovery" Jul 13 18:08:35.885521 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.885505 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:35.888650 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.888624 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 18:08:35.888801 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.888673 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7ljrj\"" Jul 13 18:08:35.890071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.890048 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 18:08:35.894705 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.894671 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrkts"] Jul 13 18:08:35.972045 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:35.972010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwrx2\" (UniqueName: \"kubernetes.io/projected/3d92209b-0942-4c0e-a940-2e4e1ed1e757-kube-api-access-mwrx2\") pod \"kuadrant-operator-catalog-lrkts\" (UID: \"3d92209b-0942-4c0e-a940-2e4e1ed1e757\") " pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:36.072454 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.072411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwrx2\" (UniqueName: \"kubernetes.io/projected/3d92209b-0942-4c0e-a940-2e4e1ed1e757-kube-api-access-mwrx2\") pod \"kuadrant-operator-catalog-lrkts\" (UID: \"3d92209b-0942-4c0e-a940-2e4e1ed1e757\") " pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:36.081041 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.081016 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwrx2\" (UniqueName: \"kubernetes.io/projected/3d92209b-0942-4c0e-a940-2e4e1ed1e757-kube-api-access-mwrx2\") pod \"kuadrant-operator-catalog-lrkts\" (UID: \"3d92209b-0942-4c0e-a940-2e4e1ed1e757\") " pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:36.196826 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.196734 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:36.330615 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.330583 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrkts"] Jul 13 18:08:36.334196 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:08:36.334166 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d92209b_0942_4c0e_a940_2e4e1ed1e757.slice/crio-3a7738a35e5e9c5d3a8d66042214e476cb162ceb0c2f59334a043b9c6b8b36e8 WatchSource:0}: Error finding container 3a7738a35e5e9c5d3a8d66042214e476cb162ceb0c2f59334a043b9c6b8b36e8: Status 404 returned error can't find the container with id 3a7738a35e5e9c5d3a8d66042214e476cb162ceb0c2f59334a043b9c6b8b36e8 Jul 13 18:08:36.409903 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.409870 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrkts"] Jul 13 18:08:36.457885 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.457806 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tvns9"] Jul 13 18:08:36.461754 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.461731 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:36.469474 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.469452 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tvns9"] Jul 13 18:08:36.576647 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.576616 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-855l4\" (UniqueName: \"kubernetes.io/projected/8afa58fc-670e-4b44-af2a-32139a923333-kube-api-access-855l4\") pod \"kuadrant-operator-catalog-tvns9\" (UID: \"8afa58fc-670e-4b44-af2a-32139a923333\") " pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:36.581019 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.580992 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" event={"ID":"3d92209b-0942-4c0e-a940-2e4e1ed1e757","Type":"ContainerStarted","Data":"3a7738a35e5e9c5d3a8d66042214e476cb162ceb0c2f59334a043b9c6b8b36e8"} Jul 13 18:08:36.677688 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.677652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855l4\" (UniqueName: \"kubernetes.io/projected/8afa58fc-670e-4b44-af2a-32139a923333-kube-api-access-855l4\") pod \"kuadrant-operator-catalog-tvns9\" (UID: \"8afa58fc-670e-4b44-af2a-32139a923333\") " pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:36.686567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.686534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-855l4\" (UniqueName: \"kubernetes.io/projected/8afa58fc-670e-4b44-af2a-32139a923333-kube-api-access-855l4\") pod \"kuadrant-operator-catalog-tvns9\" (UID: \"8afa58fc-670e-4b44-af2a-32139a923333\") " pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:36.771692 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.771613 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:36.923302 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:36.923262 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tvns9"] Jul 13 18:08:36.946571 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:08:36.946531 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afa58fc_670e_4b44_af2a_32139a923333.slice/crio-84215a15d05e7dfe3176d2a486589eb1b99e7b764cabb100fbf9c9d74e1e19d0 WatchSource:0}: Error finding container 84215a15d05e7dfe3176d2a486589eb1b99e7b764cabb100fbf9c9d74e1e19d0: Status 404 returned error can't find the container with id 84215a15d05e7dfe3176d2a486589eb1b99e7b764cabb100fbf9c9d74e1e19d0 Jul 13 18:08:37.592468 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:37.592431 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" event={"ID":"8afa58fc-670e-4b44-af2a-32139a923333","Type":"ContainerStarted","Data":"84215a15d05e7dfe3176d2a486589eb1b99e7b764cabb100fbf9c9d74e1e19d0"} Jul 13 18:08:39.603255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:39.603208 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" event={"ID":"3d92209b-0942-4c0e-a940-2e4e1ed1e757","Type":"ContainerStarted","Data":"74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea"} Jul 13 18:08:39.603763 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:39.603240 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" podUID="3d92209b-0942-4c0e-a940-2e4e1ed1e757" containerName="registry-server" containerID="cri-o://74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea" gracePeriod=2 Jul 13 18:08:39.604784 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:39.604761 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" event={"ID":"8afa58fc-670e-4b44-af2a-32139a923333","Type":"ContainerStarted","Data":"e195f47cb7b097ba5f214d31d9bdae4f84d5536a5f60c658256ac43186ce719a"} Jul 13 18:08:39.619698 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:39.619654 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" podStartSLOduration=1.8970999229999999 podStartE2EDuration="4.619637668s" totalImagesPullingTime="2.722537745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:08:39.618652434 +0000 UTC m=+478.337280190" watchObservedRunningTime="2026-07-13 18:08:39.619637668 +0000 UTC m=+478.338265425" Jul 13 18:08:39.636193 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:39.636143 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" podStartSLOduration=1.193800982 podStartE2EDuration="3.636129176s" totalImagesPullingTime="2.442328194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:08:39.634784737 +0000 UTC m=+478.353412496" watchObservedRunningTime="2026-07-13 18:08:39.636129176 +0000 UTC m=+478.354756933" Jul 13 18:08:39.848478 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:39.848456 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:40.013355 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.013231 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwrx2\" (UniqueName: \"kubernetes.io/projected/3d92209b-0942-4c0e-a940-2e4e1ed1e757-kube-api-access-mwrx2\") pod \"3d92209b-0942-4c0e-a940-2e4e1ed1e757\" (UID: \"3d92209b-0942-4c0e-a940-2e4e1ed1e757\") " Jul 13 18:08:40.015630 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.015606 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d92209b-0942-4c0e-a940-2e4e1ed1e757-kube-api-access-mwrx2" (OuterVolumeSpecName: "kube-api-access-mwrx2") pod "3d92209b-0942-4c0e-a940-2e4e1ed1e757" (UID: "3d92209b-0942-4c0e-a940-2e4e1ed1e757"). InnerVolumeSpecName "kube-api-access-mwrx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:08:40.114193 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.114154 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwrx2\" (UniqueName: \"kubernetes.io/projected/3d92209b-0942-4c0e-a940-2e4e1ed1e757-kube-api-access-mwrx2\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:40.610381 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.610346 2582 generic.go:356] "Generic (PLEG): container finished" podID="3d92209b-0942-4c0e-a940-2e4e1ed1e757" containerID="74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea" exitCode=0 Jul 13 18:08:40.610787 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.610394 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" Jul 13 18:08:40.610787 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.610441 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" event={"ID":"3d92209b-0942-4c0e-a940-2e4e1ed1e757","Type":"ContainerDied","Data":"74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea"} Jul 13 18:08:40.610787 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.610488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrkts" event={"ID":"3d92209b-0942-4c0e-a940-2e4e1ed1e757","Type":"ContainerDied","Data":"3a7738a35e5e9c5d3a8d66042214e476cb162ceb0c2f59334a043b9c6b8b36e8"} Jul 13 18:08:40.610787 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.610507 2582 scope.go:117] "RemoveContainer" containerID="74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea" Jul 13 18:08:40.619485 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.619465 2582 scope.go:117] "RemoveContainer" containerID="74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea" Jul 13 18:08:40.619729 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:08:40.619711 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea\": container with ID starting with 74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea not found: ID does not exist" containerID="74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea" Jul 13 18:08:40.619779 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.619738 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea"} err="failed to get container status \"74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea\": rpc error: code = NotFound desc = could not find container \"74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea\": container with ID starting with 74b1ecc4295b163afa028aa915c4be55eacba2c3d03e65917a49f7bea0cfc6ea not found: ID does not exist" Jul 13 18:08:40.631160 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.631136 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrkts"] Jul 13 18:08:40.634878 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:40.634854 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrkts"] Jul 13 18:08:41.772014 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:41.771984 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d92209b-0942-4c0e-a940-2e4e1ed1e757" path="/var/lib/kubelet/pods/3d92209b-0942-4c0e-a940-2e4e1ed1e757/volumes" Jul 13 18:08:46.771744 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:46.771709 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:46.771744 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:46.771753 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:46.794294 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:46.794254 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:47.664038 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:47.664010 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tvns9" Jul 13 18:08:51.496090 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.496054 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx"] Jul 13 18:08:51.496494 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.496348 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d92209b-0942-4c0e-a940-2e4e1ed1e757" containerName="registry-server" Jul 13 18:08:51.496494 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.496361 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d92209b-0942-4c0e-a940-2e4e1ed1e757" containerName="registry-server" Jul 13 18:08:51.496494 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.496424 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d92209b-0942-4c0e-a940-2e4e1ed1e757" containerName="registry-server" Jul 13 18:08:51.500706 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.500689 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.503389 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.503371 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5p5gd\"" Jul 13 18:08:51.507869 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.507847 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx"] Jul 13 18:08:51.608072 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.608033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4kg\" (UniqueName: \"kubernetes.io/projected/308ff3f5-40fd-4d3b-af59-99395b34953e-kube-api-access-ks4kg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.608072 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.608072 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.608273 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.608095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.709203 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.709167 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4kg\" (UniqueName: \"kubernetes.io/projected/308ff3f5-40fd-4d3b-af59-99395b34953e-kube-api-access-ks4kg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.709203 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.709207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.709424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.709228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.709617 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.709598 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.709669 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.709651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.718269 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.718233 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4kg\" (UniqueName: \"kubernetes.io/projected/308ff3f5-40fd-4d3b-af59-99395b34953e-kube-api-access-ks4kg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.810449 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.810362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:51.894336 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.894301 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr"] Jul 13 18:08:51.898432 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.898407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:51.905910 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.905841 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr"] Jul 13 18:08:51.963513 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:51.963492 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx"] Jul 13 18:08:51.965711 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:08:51.965686 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308ff3f5_40fd_4d3b_af59_99395b34953e.slice/crio-3b73287f7aafe8f0dc3535ebeeb81c01915bbf00b39872efa45e9253da8e1a4e WatchSource:0}: Error finding container 3b73287f7aafe8f0dc3535ebeeb81c01915bbf00b39872efa45e9253da8e1a4e: Status 404 returned error can't find the container with id 3b73287f7aafe8f0dc3535ebeeb81c01915bbf00b39872efa45e9253da8e1a4e Jul 13 18:08:52.012248 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.012223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.012401 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.012254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.012401 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.012297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5jc\" (UniqueName: \"kubernetes.io/projected/7cce81f6-a558-4b88-9812-6a8ddccf0918-kube-api-access-dr5jc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.112762 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.112732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.112762 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.112762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.113001 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.112790 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5jc\" (UniqueName: \"kubernetes.io/projected/7cce81f6-a558-4b88-9812-6a8ddccf0918-kube-api-access-dr5jc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.113150 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.113128 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.113217 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.113145 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.120813 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.120791 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5jc\" (UniqueName: \"kubernetes.io/projected/7cce81f6-a558-4b88-9812-6a8ddccf0918-kube-api-access-dr5jc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.208673 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.208629 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:52.292810 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.292785 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl"] Jul 13 18:08:52.297336 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.297313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.305756 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.305728 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl"] Jul 13 18:08:52.352080 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.351897 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr"] Jul 13 18:08:52.354741 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:08:52.354711 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cce81f6_a558_4b88_9812_6a8ddccf0918.slice/crio-1d4fba67a9d0a2a85f5b174a08c42f940a908c31afff72e8b8f8939b385e3b4d WatchSource:0}: Error finding container 1d4fba67a9d0a2a85f5b174a08c42f940a908c31afff72e8b8f8939b385e3b4d: Status 404 returned error can't find the container with id 1d4fba67a9d0a2a85f5b174a08c42f940a908c31afff72e8b8f8939b385e3b4d Jul 13 18:08:52.415072 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.415046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.415174 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.415082 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8l9z\" (UniqueName: \"kubernetes.io/projected/daa0e9db-662e-4173-b202-1b9766dc9670-kube-api-access-t8l9z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.415221 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.415177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.516006 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.515969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.516604 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.516047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.516604 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.516069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8l9z\" (UniqueName: \"kubernetes.io/projected/daa0e9db-662e-4173-b202-1b9766dc9670-kube-api-access-t8l9z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.516604 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.516444 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.516604 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.516522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.525238 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.525214 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8l9z\" (UniqueName: \"kubernetes.io/projected/daa0e9db-662e-4173-b202-1b9766dc9670-kube-api-access-t8l9z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.612852 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.612772 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:52.666460 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.666428 2582 generic.go:356] "Generic (PLEG): container finished" podID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerID="f7989329de66e71df72d3571c2d348db5ab771911ea7e204370814365c65e5e8" exitCode=0 Jul 13 18:08:52.666608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.666508 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" event={"ID":"308ff3f5-40fd-4d3b-af59-99395b34953e","Type":"ContainerDied","Data":"f7989329de66e71df72d3571c2d348db5ab771911ea7e204370814365c65e5e8"} Jul 13 18:08:52.666608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.666598 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" event={"ID":"308ff3f5-40fd-4d3b-af59-99395b34953e","Type":"ContainerStarted","Data":"3b73287f7aafe8f0dc3535ebeeb81c01915bbf00b39872efa45e9253da8e1a4e"} Jul 13 18:08:52.668567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.668543 2582 generic.go:356] "Generic (PLEG): container finished" podID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerID="4b6c280d518495aa334a715d97b2fd62795e62b59305305548d185519d6a7558" exitCode=0 Jul 13 18:08:52.668685 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.668590 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" event={"ID":"7cce81f6-a558-4b88-9812-6a8ddccf0918","Type":"ContainerDied","Data":"4b6c280d518495aa334a715d97b2fd62795e62b59305305548d185519d6a7558"} Jul 13 18:08:52.668685 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.668618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" event={"ID":"7cce81f6-a558-4b88-9812-6a8ddccf0918","Type":"ContainerStarted","Data":"1d4fba67a9d0a2a85f5b174a08c42f940a908c31afff72e8b8f8939b385e3b4d"} Jul 13 18:08:52.692936 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.692907 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv"] Jul 13 18:08:52.697392 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.697376 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.703758 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.703731 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv"] Jul 13 18:08:52.752580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.752554 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl"] Jul 13 18:08:52.755777 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:08:52.755745 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa0e9db_662e_4173_b202_1b9766dc9670.slice/crio-dabdb5c64ba6eba3604c0fe68898e8ecc972b9a133b87ef69c91ebdd2f4f029b WatchSource:0}: Error finding container dabdb5c64ba6eba3604c0fe68898e8ecc972b9a133b87ef69c91ebdd2f4f029b: Status 404 returned error can't find the container with id dabdb5c64ba6eba3604c0fe68898e8ecc972b9a133b87ef69c91ebdd2f4f029b Jul 13 18:08:52.818225 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.818196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.818378 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.818227 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vwrx\" (UniqueName: \"kubernetes.io/projected/9829562d-6776-411c-b199-fe2e21465dc4-kube-api-access-2vwrx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.818378 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.818364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.919870 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.919780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.920046 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.919880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.920046 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.919899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vwrx\" (UniqueName: \"kubernetes.io/projected/9829562d-6776-411c-b199-fe2e21465dc4-kube-api-access-2vwrx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.920245 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.920226 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.920331 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.920312 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:52.928410 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:52.928391 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vwrx\" (UniqueName: \"kubernetes.io/projected/9829562d-6776-411c-b199-fe2e21465dc4-kube-api-access-2vwrx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:53.011464 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.011433 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:53.143933 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.143899 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv"] Jul 13 18:08:53.146924 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:08:53.146897 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9829562d_6776_411c_b199_fe2e21465dc4.slice/crio-2ee42378d69dfab2e57f22eee53ffe68325a1af1d9ecfda978603827a9f4d241 WatchSource:0}: Error finding container 2ee42378d69dfab2e57f22eee53ffe68325a1af1d9ecfda978603827a9f4d241: Status 404 returned error can't find the container with id 2ee42378d69dfab2e57f22eee53ffe68325a1af1d9ecfda978603827a9f4d241 Jul 13 18:08:53.674956 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.674925 2582 generic.go:356] "Generic (PLEG): container finished" podID="9829562d-6776-411c-b199-fe2e21465dc4" containerID="5419c95e32d6769b7486eaf1b3e97db36948781234c841637004d069ff8f4fb4" exitCode=0 Jul 13 18:08:53.675404 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.675002 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" event={"ID":"9829562d-6776-411c-b199-fe2e21465dc4","Type":"ContainerDied","Data":"5419c95e32d6769b7486eaf1b3e97db36948781234c841637004d069ff8f4fb4"} Jul 13 18:08:53.675404 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.675041 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" event={"ID":"9829562d-6776-411c-b199-fe2e21465dc4","Type":"ContainerStarted","Data":"2ee42378d69dfab2e57f22eee53ffe68325a1af1d9ecfda978603827a9f4d241"} Jul 13 18:08:53.677224 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.677202 2582 generic.go:356] "Generic (PLEG): container finished" podID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerID="f62c5cc55d8e75e3ad981adb2a3dbf125bfc0f30e02302e7db9ad3098a0c85a2" exitCode=0 Jul 13 18:08:53.677372 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.677309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" event={"ID":"7cce81f6-a558-4b88-9812-6a8ddccf0918","Type":"ContainerDied","Data":"f62c5cc55d8e75e3ad981adb2a3dbf125bfc0f30e02302e7db9ad3098a0c85a2"} Jul 13 18:08:53.679355 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.679330 2582 generic.go:356] "Generic (PLEG): container finished" podID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerID="0883c591dfa8321974a9aa354a1afc2ab71952fd2967b962f52d2370fd98512f" exitCode=0 Jul 13 18:08:53.679449 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.679396 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" event={"ID":"308ff3f5-40fd-4d3b-af59-99395b34953e","Type":"ContainerDied","Data":"0883c591dfa8321974a9aa354a1afc2ab71952fd2967b962f52d2370fd98512f"} Jul 13 18:08:53.681085 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.681064 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa0e9db-662e-4173-b202-1b9766dc9670" containerID="e19aab86440cf7855a375299b7022170034c018cbac3d3b67ab51b470ef2cb59" exitCode=0 Jul 13 18:08:53.681170 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.681086 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" event={"ID":"daa0e9db-662e-4173-b202-1b9766dc9670","Type":"ContainerDied","Data":"e19aab86440cf7855a375299b7022170034c018cbac3d3b67ab51b470ef2cb59"} Jul 13 18:08:53.681170 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:53.681124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" event={"ID":"daa0e9db-662e-4173-b202-1b9766dc9670","Type":"ContainerStarted","Data":"dabdb5c64ba6eba3604c0fe68898e8ecc972b9a133b87ef69c91ebdd2f4f029b"} Jul 13 18:08:54.688133 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:54.688098 2582 generic.go:356] "Generic (PLEG): container finished" podID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerID="4cb220c18d9fb7719f34188a80f4a04b5c7ab9e5cc36afc1cca4fb7017027d56" exitCode=0 Jul 13 18:08:54.688584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:54.688182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" event={"ID":"7cce81f6-a558-4b88-9812-6a8ddccf0918","Type":"ContainerDied","Data":"4cb220c18d9fb7719f34188a80f4a04b5c7ab9e5cc36afc1cca4fb7017027d56"} Jul 13 18:08:54.690235 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:54.690216 2582 generic.go:356] "Generic (PLEG): container finished" podID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerID="6811148a4bf029188b37b3fa08ce18b016ba61d67e0b1165445f60a957a56089" exitCode=0 Jul 13 18:08:54.690371 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:54.690311 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" event={"ID":"308ff3f5-40fd-4d3b-af59-99395b34953e","Type":"ContainerDied","Data":"6811148a4bf029188b37b3fa08ce18b016ba61d67e0b1165445f60a957a56089"} Jul 13 18:08:54.692043 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:54.692024 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa0e9db-662e-4173-b202-1b9766dc9670" containerID="861659c4f22aecb84e6ca2c83f4c19e24729856759b14f15b95baa42b435f632" exitCode=0 Jul 13 18:08:54.692171 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:54.692098 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" event={"ID":"daa0e9db-662e-4173-b202-1b9766dc9670","Type":"ContainerDied","Data":"861659c4f22aecb84e6ca2c83f4c19e24729856759b14f15b95baa42b435f632"} Jul 13 18:08:55.700004 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.699973 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa0e9db-662e-4173-b202-1b9766dc9670" containerID="45d9562fa4174d8f27741e9024c1993d3b364a1b9cccedbaf8db5e65a7f93994" exitCode=0 Jul 13 18:08:55.700449 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.700053 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" event={"ID":"daa0e9db-662e-4173-b202-1b9766dc9670","Type":"ContainerDied","Data":"45d9562fa4174d8f27741e9024c1993d3b364a1b9cccedbaf8db5e65a7f93994"} Jul 13 18:08:55.838871 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.838841 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:55.845584 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.845565 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks4kg\" (UniqueName: \"kubernetes.io/projected/308ff3f5-40fd-4d3b-af59-99395b34953e-kube-api-access-ks4kg\") pod \"308ff3f5-40fd-4d3b-af59-99395b34953e\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " Jul 13 18:08:55.845660 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.845603 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-util\") pod \"308ff3f5-40fd-4d3b-af59-99395b34953e\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " Jul 13 18:08:55.845660 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.845630 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-bundle\") pod \"308ff3f5-40fd-4d3b-af59-99395b34953e\" (UID: \"308ff3f5-40fd-4d3b-af59-99395b34953e\") " Jul 13 18:08:55.846313 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.846252 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-bundle" (OuterVolumeSpecName: "bundle") pod "308ff3f5-40fd-4d3b-af59-99395b34953e" (UID: "308ff3f5-40fd-4d3b-af59-99395b34953e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:55.848116 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.848090 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308ff3f5-40fd-4d3b-af59-99395b34953e-kube-api-access-ks4kg" (OuterVolumeSpecName: "kube-api-access-ks4kg") pod "308ff3f5-40fd-4d3b-af59-99395b34953e" (UID: "308ff3f5-40fd-4d3b-af59-99395b34953e"). InnerVolumeSpecName "kube-api-access-ks4kg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:08:55.852138 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.852078 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-util" (OuterVolumeSpecName: "util") pod "308ff3f5-40fd-4d3b-af59-99395b34953e" (UID: "308ff3f5-40fd-4d3b-af59-99395b34953e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:55.861175 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.861149 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:55.946390 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946359 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-bundle\") pod \"7cce81f6-a558-4b88-9812-6a8ddccf0918\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " Jul 13 18:08:55.946570 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946413 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr5jc\" (UniqueName: \"kubernetes.io/projected/7cce81f6-a558-4b88-9812-6a8ddccf0918-kube-api-access-dr5jc\") pod \"7cce81f6-a558-4b88-9812-6a8ddccf0918\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " Jul 13 18:08:55.946570 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946446 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-util\") pod \"7cce81f6-a558-4b88-9812-6a8ddccf0918\" (UID: \"7cce81f6-a558-4b88-9812-6a8ddccf0918\") " Jul 13 18:08:55.946570 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946566 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks4kg\" (UniqueName: \"kubernetes.io/projected/308ff3f5-40fd-4d3b-af59-99395b34953e-kube-api-access-ks4kg\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:55.946683 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946581 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-util\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:55.946683 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946595 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/308ff3f5-40fd-4d3b-af59-99395b34953e-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:55.946969 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.946934 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-bundle" (OuterVolumeSpecName: "bundle") pod "7cce81f6-a558-4b88-9812-6a8ddccf0918" (UID: "7cce81f6-a558-4b88-9812-6a8ddccf0918"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:55.948865 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.948832 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cce81f6-a558-4b88-9812-6a8ddccf0918-kube-api-access-dr5jc" (OuterVolumeSpecName: "kube-api-access-dr5jc") pod "7cce81f6-a558-4b88-9812-6a8ddccf0918" (UID: "7cce81f6-a558-4b88-9812-6a8ddccf0918"). InnerVolumeSpecName "kube-api-access-dr5jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:08:55.951872 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:55.951814 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-util" (OuterVolumeSpecName: "util") pod "7cce81f6-a558-4b88-9812-6a8ddccf0918" (UID: "7cce81f6-a558-4b88-9812-6a8ddccf0918"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:56.047060 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.047026 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr5jc\" (UniqueName: \"kubernetes.io/projected/7cce81f6-a558-4b88-9812-6a8ddccf0918-kube-api-access-dr5jc\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:56.047060 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.047051 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-util\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:56.047060 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.047062 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cce81f6-a558-4b88-9812-6a8ddccf0918-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:56.706572 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.706487 2582 generic.go:356] "Generic (PLEG): container finished" podID="9829562d-6776-411c-b199-fe2e21465dc4" containerID="3ed418442e079c0a1ab133bdaf3c429b27fa34f5426d8fbc8b79f8d6625d2c2c" exitCode=0 Jul 13 18:08:56.706572 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.706553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" event={"ID":"9829562d-6776-411c-b199-fe2e21465dc4","Type":"ContainerDied","Data":"3ed418442e079c0a1ab133bdaf3c429b27fa34f5426d8fbc8b79f8d6625d2c2c"} Jul 13 18:08:56.708502 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.708488 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" Jul 13 18:08:56.708585 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.708518 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr" event={"ID":"7cce81f6-a558-4b88-9812-6a8ddccf0918","Type":"ContainerDied","Data":"1d4fba67a9d0a2a85f5b174a08c42f940a908c31afff72e8b8f8939b385e3b4d"} Jul 13 18:08:56.708585 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.708555 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d4fba67a9d0a2a85f5b174a08c42f940a908c31afff72e8b8f8939b385e3b4d" Jul 13 18:08:56.710419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.710398 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" Jul 13 18:08:56.710419 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.710399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx" event={"ID":"308ff3f5-40fd-4d3b-af59-99395b34953e","Type":"ContainerDied","Data":"3b73287f7aafe8f0dc3535ebeeb81c01915bbf00b39872efa45e9253da8e1a4e"} Jul 13 18:08:56.710633 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.710443 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b73287f7aafe8f0dc3535ebeeb81c01915bbf00b39872efa45e9253da8e1a4e" Jul 13 18:08:56.852107 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.852075 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:56.952580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.952547 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-util\") pod \"daa0e9db-662e-4173-b202-1b9766dc9670\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " Jul 13 18:08:56.952736 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.952619 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8l9z\" (UniqueName: \"kubernetes.io/projected/daa0e9db-662e-4173-b202-1b9766dc9670-kube-api-access-t8l9z\") pod \"daa0e9db-662e-4173-b202-1b9766dc9670\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " Jul 13 18:08:56.952790 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.952743 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-bundle\") pod \"daa0e9db-662e-4173-b202-1b9766dc9670\" (UID: \"daa0e9db-662e-4173-b202-1b9766dc9670\") " Jul 13 18:08:56.953150 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.953119 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-bundle" (OuterVolumeSpecName: "bundle") pod "daa0e9db-662e-4173-b202-1b9766dc9670" (UID: "daa0e9db-662e-4173-b202-1b9766dc9670"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:56.954803 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.954779 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa0e9db-662e-4173-b202-1b9766dc9670-kube-api-access-t8l9z" (OuterVolumeSpecName: "kube-api-access-t8l9z") pod "daa0e9db-662e-4173-b202-1b9766dc9670" (UID: "daa0e9db-662e-4173-b202-1b9766dc9670"). InnerVolumeSpecName "kube-api-access-t8l9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:08:56.957769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:56.957712 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-util" (OuterVolumeSpecName: "util") pod "daa0e9db-662e-4173-b202-1b9766dc9670" (UID: "daa0e9db-662e-4173-b202-1b9766dc9670"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:57.054151 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.054116 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:57.054151 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.054142 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/daa0e9db-662e-4173-b202-1b9766dc9670-util\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:57.054151 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.054151 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8l9z\" (UniqueName: \"kubernetes.io/projected/daa0e9db-662e-4173-b202-1b9766dc9670-kube-api-access-t8l9z\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:57.718371 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.718334 2582 generic.go:356] "Generic (PLEG): container finished" podID="9829562d-6776-411c-b199-fe2e21465dc4" containerID="5da43e68e48d330b67b89050844ba51531f527547d7fa2c87858d7f1403d347c" exitCode=0 Jul 13 18:08:57.718789 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.718420 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" event={"ID":"9829562d-6776-411c-b199-fe2e21465dc4","Type":"ContainerDied","Data":"5da43e68e48d330b67b89050844ba51531f527547d7fa2c87858d7f1403d347c"} Jul 13 18:08:57.723073 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.723048 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" event={"ID":"daa0e9db-662e-4173-b202-1b9766dc9670","Type":"ContainerDied","Data":"dabdb5c64ba6eba3604c0fe68898e8ecc972b9a133b87ef69c91ebdd2f4f029b"} Jul 13 18:08:57.723073 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.723063 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl" Jul 13 18:08:57.723303 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:57.723086 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dabdb5c64ba6eba3604c0fe68898e8ecc972b9a133b87ef69c91ebdd2f4f029b" Jul 13 18:08:58.862063 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.862042 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:58.865242 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.865223 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vwrx\" (UniqueName: \"kubernetes.io/projected/9829562d-6776-411c-b199-fe2e21465dc4-kube-api-access-2vwrx\") pod \"9829562d-6776-411c-b199-fe2e21465dc4\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " Jul 13 18:08:58.865327 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.865270 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-util\") pod \"9829562d-6776-411c-b199-fe2e21465dc4\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " Jul 13 18:08:58.865327 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.865312 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-bundle\") pod \"9829562d-6776-411c-b199-fe2e21465dc4\" (UID: \"9829562d-6776-411c-b199-fe2e21465dc4\") " Jul 13 18:08:58.865890 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.865859 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-bundle" (OuterVolumeSpecName: "bundle") pod "9829562d-6776-411c-b199-fe2e21465dc4" (UID: "9829562d-6776-411c-b199-fe2e21465dc4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:58.867527 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.867505 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9829562d-6776-411c-b199-fe2e21465dc4-kube-api-access-2vwrx" (OuterVolumeSpecName: "kube-api-access-2vwrx") pod "9829562d-6776-411c-b199-fe2e21465dc4" (UID: "9829562d-6776-411c-b199-fe2e21465dc4"). InnerVolumeSpecName "kube-api-access-2vwrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:08:58.870076 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.870043 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-util" (OuterVolumeSpecName: "util") pod "9829562d-6776-411c-b199-fe2e21465dc4" (UID: "9829562d-6776-411c-b199-fe2e21465dc4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:08:58.965931 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.965891 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vwrx\" (UniqueName: \"kubernetes.io/projected/9829562d-6776-411c-b199-fe2e21465dc4-kube-api-access-2vwrx\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:58.965931 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.965922 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-util\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:58.965931 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:58.965933 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9829562d-6776-411c-b199-fe2e21465dc4-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:08:59.733438 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:59.733409 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" Jul 13 18:08:59.733608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:59.733413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv" event={"ID":"9829562d-6776-411c-b199-fe2e21465dc4","Type":"ContainerDied","Data":"2ee42378d69dfab2e57f22eee53ffe68325a1af1d9ecfda978603827a9f4d241"} Jul 13 18:08:59.733608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:08:59.733518 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ee42378d69dfab2e57f22eee53ffe68325a1af1d9ecfda978603827a9f4d241" Jul 13 18:09:07.384225 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384189 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm"] Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384470 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384480 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384487 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384493 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384500 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384506 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384512 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384518 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384522 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384527 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384537 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384541 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384546 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384550 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384556 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384562 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384570 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384575 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384583 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384589 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="util" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384598 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384603 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384609 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384614 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="pull" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384657 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9829562d-6776-411c-b199-fe2e21465dc4" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384666 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa0e9db-662e-4173-b202-1b9766dc9670" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384672 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="308ff3f5-40fd-4d3b-af59-99395b34953e" containerName="extract" Jul 13 18:09:07.384672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.384677 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cce81f6-a558-4b88-9812-6a8ddccf0918" containerName="extract" Jul 13 18:09:07.390673 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.390657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:07.397470 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.397450 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 18:09:07.397586 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.397495 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nlbxm\"" Jul 13 18:09:07.400790 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.400769 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm"] Jul 13 18:09:07.430544 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.430517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j22tm\" (UniqueName: \"kubernetes.io/projected/578945b5-5e09-4328-b24e-5db36c455353-kube-api-access-j22tm\") pod \"dns-operator-controller-manager-864dd78c4c-86hpm\" (UID: \"578945b5-5e09-4328-b24e-5db36c455353\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:07.531713 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.531682 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j22tm\" (UniqueName: \"kubernetes.io/projected/578945b5-5e09-4328-b24e-5db36c455353-kube-api-access-j22tm\") pod \"dns-operator-controller-manager-864dd78c4c-86hpm\" (UID: \"578945b5-5e09-4328-b24e-5db36c455353\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:07.551116 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.551091 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j22tm\" (UniqueName: \"kubernetes.io/projected/578945b5-5e09-4328-b24e-5db36c455353-kube-api-access-j22tm\") pod \"dns-operator-controller-manager-864dd78c4c-86hpm\" (UID: \"578945b5-5e09-4328-b24e-5db36c455353\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:07.701186 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.701095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:07.839481 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:07.838165 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm"] Jul 13 18:09:08.779404 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:08.779353 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" event={"ID":"578945b5-5e09-4328-b24e-5db36c455353","Type":"ContainerStarted","Data":"38faca1bf779ef23b15014ba507821a49c182997d44a8fb006de8ec635e5b528"} Jul 13 18:09:11.794261 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:11.794179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" event={"ID":"578945b5-5e09-4328-b24e-5db36c455353","Type":"ContainerStarted","Data":"d60ca72e5de419d0afb884ec6982bd8ba11b0bac762bec9bf494c96f7f87fb25"} Jul 13 18:09:11.794628 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:11.794316 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:11.832980 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:11.832930 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" podStartSLOduration=1.229990963 podStartE2EDuration="4.832914819s" totalImagesPullingTime="3.602923856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:11.831718616 +0000 UTC m=+510.550346373" watchObservedRunningTime="2026-07-13 18:09:11.832914819 +0000 UTC m=+510.551542576" Jul 13 18:09:12.774472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.774439 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc"] Jul 13 18:09:12.777996 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.777970 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:12.782109 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.782089 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h9s5g\"" Jul 13 18:09:12.804939 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.804914 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc"] Jul 13 18:09:12.874285 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.874253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76e84055-e837-40be-bcf1-f19b8b48d7c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:12.874490 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.874339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hrxb\" (UniqueName: \"kubernetes.io/projected/76e84055-e837-40be-bcf1-f19b8b48d7c4-kube-api-access-5hrxb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:12.974979 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.974946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76e84055-e837-40be-bcf1-f19b8b48d7c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:12.974979 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.974987 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hrxb\" (UniqueName: \"kubernetes.io/projected/76e84055-e837-40be-bcf1-f19b8b48d7c4-kube-api-access-5hrxb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:12.975360 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:12.975339 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76e84055-e837-40be-bcf1-f19b8b48d7c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:13.000639 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:13.000604 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hrxb\" (UniqueName: \"kubernetes.io/projected/76e84055-e837-40be-bcf1-f19b8b48d7c4-kube-api-access-5hrxb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:13.088828 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:13.088731 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:13.242517 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:13.242495 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc"] Jul 13 18:09:13.244497 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:09:13.244470 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e84055_e837_40be_bcf1_f19b8b48d7c4.slice/crio-cb04a627b1e0ccfe47edad28d4f96dc5d2ff11bb6fa07bdb86dbcbb8f08d10c0 WatchSource:0}: Error finding container cb04a627b1e0ccfe47edad28d4f96dc5d2ff11bb6fa07bdb86dbcbb8f08d10c0: Status 404 returned error can't find the container with id cb04a627b1e0ccfe47edad28d4f96dc5d2ff11bb6fa07bdb86dbcbb8f08d10c0 Jul 13 18:09:13.805696 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:13.805657 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" event={"ID":"76e84055-e837-40be-bcf1-f19b8b48d7c4","Type":"ContainerStarted","Data":"cb04a627b1e0ccfe47edad28d4f96dc5d2ff11bb6fa07bdb86dbcbb8f08d10c0"} Jul 13 18:09:16.046720 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.046687 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z"] Jul 13 18:09:16.050231 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.050208 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:16.053181 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.053162 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qkf9d\"" Jul 13 18:09:16.058953 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.058923 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z"] Jul 13 18:09:16.102546 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.102508 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxrbm\" (UniqueName: \"kubernetes.io/projected/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f-kube-api-access-kxrbm\") pod \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" (UID: \"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:16.203839 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.203807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxrbm\" (UniqueName: \"kubernetes.io/projected/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f-kube-api-access-kxrbm\") pod \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" (UID: \"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:16.224068 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.224044 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxrbm\" (UniqueName: \"kubernetes.io/projected/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f-kube-api-access-kxrbm\") pod \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" (UID: \"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:16.362790 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.362758 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:16.510086 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.510067 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z"] Jul 13 18:09:16.512098 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:09:16.512074 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a956cf_99fc_49f8_b7de_dbf52ab87a6f.slice/crio-10a3f8f104942a7b0f6ce9dbac176751368c18059e49edc74605fd61aa3693ce WatchSource:0}: Error finding container 10a3f8f104942a7b0f6ce9dbac176751368c18059e49edc74605fd61aa3693ce: Status 404 returned error can't find the container with id 10a3f8f104942a7b0f6ce9dbac176751368c18059e49edc74605fd61aa3693ce Jul 13 18:09:16.822332 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:16.822232 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" event={"ID":"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f","Type":"ContainerStarted","Data":"10a3f8f104942a7b0f6ce9dbac176751368c18059e49edc74605fd61aa3693ce"} Jul 13 18:09:18.991140 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:18.991107 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7569r"] Jul 13 18:09:18.994376 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:18.994360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:18.997447 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:18.997427 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-l7tmb\"" Jul 13 18:09:19.007553 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.007531 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7569r"] Jul 13 18:09:19.126699 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.126655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2lq\" (UniqueName: \"kubernetes.io/projected/84492e5b-e2d2-46fd-9b90-51baf13b26b3-kube-api-access-wt2lq\") pod \"authorino-operator-75cc8d5cb7-7569r\" (UID: \"84492e5b-e2d2-46fd-9b90-51baf13b26b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:19.227812 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.227776 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2lq\" (UniqueName: \"kubernetes.io/projected/84492e5b-e2d2-46fd-9b90-51baf13b26b3-kube-api-access-wt2lq\") pod \"authorino-operator-75cc8d5cb7-7569r\" (UID: \"84492e5b-e2d2-46fd-9b90-51baf13b26b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:19.242805 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.242734 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2lq\" (UniqueName: \"kubernetes.io/projected/84492e5b-e2d2-46fd-9b90-51baf13b26b3-kube-api-access-wt2lq\") pod \"authorino-operator-75cc8d5cb7-7569r\" (UID: \"84492e5b-e2d2-46fd-9b90-51baf13b26b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:19.304718 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.304682 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:19.441624 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.441592 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7569r"] Jul 13 18:09:19.443609 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:09:19.443580 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84492e5b_e2d2_46fd_9b90_51baf13b26b3.slice/crio-1db7a62fa925132d5c4ec74e2e3a30b70625fe42c5af88ea18e61aecf7a9516b WatchSource:0}: Error finding container 1db7a62fa925132d5c4ec74e2e3a30b70625fe42c5af88ea18e61aecf7a9516b: Status 404 returned error can't find the container with id 1db7a62fa925132d5c4ec74e2e3a30b70625fe42c5af88ea18e61aecf7a9516b Jul 13 18:09:19.838941 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:19.838904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" event={"ID":"84492e5b-e2d2-46fd-9b90-51baf13b26b3","Type":"ContainerStarted","Data":"1db7a62fa925132d5c4ec74e2e3a30b70625fe42c5af88ea18e61aecf7a9516b"} Jul 13 18:09:22.802196 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:22.802168 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86hpm" Jul 13 18:09:23.863104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.863065 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" event={"ID":"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f","Type":"ContainerStarted","Data":"15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d"} Jul 13 18:09:23.863549 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.863189 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:23.864849 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.864821 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" event={"ID":"76e84055-e837-40be-bcf1-f19b8b48d7c4","Type":"ContainerStarted","Data":"a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4"} Jul 13 18:09:23.864967 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.864871 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:23.866324 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.866304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" event={"ID":"84492e5b-e2d2-46fd-9b90-51baf13b26b3","Type":"ContainerStarted","Data":"d53fb299d9db81459b9db1c2c762fb6a874c8f277583094db98fe02941f6033a"} Jul 13 18:09:23.866430 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.866356 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:23.881108 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.881067 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" podStartSLOduration=1.178358163 podStartE2EDuration="7.881054807s" totalImagesPullingTime="6.702696644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:23.879691031 +0000 UTC m=+522.598318788" watchObservedRunningTime="2026-07-13 18:09:23.881054807 +0000 UTC m=+522.599682562" Jul 13 18:09:23.897695 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.897646 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" podStartSLOduration=2.116855058 podStartE2EDuration="5.897629669s" totalImagesPullingTime="3.780774611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:23.896642622 +0000 UTC m=+522.615270379" watchObservedRunningTime="2026-07-13 18:09:23.897629669 +0000 UTC m=+522.616257426" Jul 13 18:09:23.925975 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:23.925922 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" podStartSLOduration=1.955780796 podStartE2EDuration="11.925901512s" totalImagesPullingTime="9.970120716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:23.92538829 +0000 UTC m=+522.644016048" watchObservedRunningTime="2026-07-13 18:09:23.925901512 +0000 UTC m=+522.644529270" Jul 13 18:09:34.873165 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:34.873077 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:34.873537 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:34.873261 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:34.873537 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:34.873343 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7569r" Jul 13 18:09:36.986882 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:36.986846 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc"] Jul 13 18:09:36.987253 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:36.987074 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" containerName="manager" containerID="cri-o://a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4" gracePeriod=2 Jul 13 18:09:36.994979 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:36.994948 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc"] Jul 13 18:09:37.016352 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.016316 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z"] Jul 13 18:09:37.016540 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.016516 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" containerName="manager" containerID="cri-o://15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d" gracePeriod=2 Jul 13 18:09:37.020039 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.020006 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.023731 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.023692 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.024143 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.024119 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z"] Jul 13 18:09:37.032094 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032068 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v"] Jul 13 18:09:37.032458 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032438 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" containerName="manager" Jul 13 18:09:37.032458 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032458 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" containerName="manager" Jul 13 18:09:37.032600 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032485 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" containerName="manager" Jul 13 18:09:37.032600 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032493 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" containerName="manager" Jul 13 18:09:37.032600 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032558 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" containerName="manager" Jul 13 18:09:37.032600 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.032574 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" containerName="manager" Jul 13 18:09:37.035596 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.035576 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.038572 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.038549 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.041191 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.041169 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.074907 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.074459 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v"] Jul 13 18:09:37.076219 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.076193 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh"] Jul 13 18:09:37.079345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.079325 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:09:37.093231 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.093204 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh"] Jul 13 18:09:37.096655 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.096621 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.118981 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.118953 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.169207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.169163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5kqx\" (UniqueName: \"kubernetes.io/projected/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-kube-api-access-k5kqx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nkq5v\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.169207 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.169210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nkq5v\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.169458 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.169235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf47k\" (UniqueName: \"kubernetes.io/projected/034d29d7-ee18-4c03-8ec8-0523c08018db-kube-api-access-jf47k\") pod \"limitador-operator-controller-manager-859d7b78bd-8bjmh\" (UID: \"034d29d7-ee18-4c03-8ec8-0523c08018db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:09:37.259716 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.259692 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.262371 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.262353 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.262583 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.262561 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.264942 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.264922 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.267087 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.267065 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-td6nc\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.269169 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.269152 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-c4q9z\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.270479 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.270461 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5kqx\" (UniqueName: \"kubernetes.io/projected/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-kube-api-access-k5kqx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nkq5v\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.270534 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.270488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nkq5v\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.270534 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.270506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf47k\" (UniqueName: \"kubernetes.io/projected/034d29d7-ee18-4c03-8ec8-0523c08018db-kube-api-access-jf47k\") pod \"limitador-operator-controller-manager-859d7b78bd-8bjmh\" (UID: \"034d29d7-ee18-4c03-8ec8-0523c08018db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:09:37.270800 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.270781 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nkq5v\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.283940 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.283919 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5kqx\" (UniqueName: \"kubernetes.io/projected/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-kube-api-access-k5kqx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nkq5v\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.284031 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.283947 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf47k\" (UniqueName: \"kubernetes.io/projected/034d29d7-ee18-4c03-8ec8-0523c08018db-kube-api-access-jf47k\") pod \"limitador-operator-controller-manager-859d7b78bd-8bjmh\" (UID: \"034d29d7-ee18-4c03-8ec8-0523c08018db\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:09:37.370921 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.370893 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hrxb\" (UniqueName: \"kubernetes.io/projected/76e84055-e837-40be-bcf1-f19b8b48d7c4-kube-api-access-5hrxb\") pod \"76e84055-e837-40be-bcf1-f19b8b48d7c4\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " Jul 13 18:09:37.371088 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.370956 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxrbm\" (UniqueName: \"kubernetes.io/projected/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f-kube-api-access-kxrbm\") pod \"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f\" (UID: \"d9a956cf-99fc-49f8-b7de-dbf52ab87a6f\") " Jul 13 18:09:37.371088 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.370997 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76e84055-e837-40be-bcf1-f19b8b48d7c4-extensions-socket-volume\") pod \"76e84055-e837-40be-bcf1-f19b8b48d7c4\" (UID: \"76e84055-e837-40be-bcf1-f19b8b48d7c4\") " Jul 13 18:09:37.371577 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.371539 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e84055-e837-40be-bcf1-f19b8b48d7c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "76e84055-e837-40be-bcf1-f19b8b48d7c4" (UID: "76e84055-e837-40be-bcf1-f19b8b48d7c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:09:37.373331 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.373305 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e84055-e837-40be-bcf1-f19b8b48d7c4-kube-api-access-5hrxb" (OuterVolumeSpecName: "kube-api-access-5hrxb") pod "76e84055-e837-40be-bcf1-f19b8b48d7c4" (UID: "76e84055-e837-40be-bcf1-f19b8b48d7c4"). InnerVolumeSpecName "kube-api-access-5hrxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:09:37.373422 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.373405 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f-kube-api-access-kxrbm" (OuterVolumeSpecName: "kube-api-access-kxrbm") pod "d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" (UID: "d9a956cf-99fc-49f8-b7de-dbf52ab87a6f"). InnerVolumeSpecName "kube-api-access-kxrbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:09:37.421343 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.421312 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.427427 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.427405 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:09:37.472684 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.472249 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxrbm\" (UniqueName: \"kubernetes.io/projected/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f-kube-api-access-kxrbm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:09:37.472684 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.472325 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76e84055-e837-40be-bcf1-f19b8b48d7c4-extensions-socket-volume\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:09:37.472684 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.472347 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hrxb\" (UniqueName: \"kubernetes.io/projected/76e84055-e837-40be-bcf1-f19b8b48d7c4-kube-api-access-5hrxb\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:09:37.582514 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.582390 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v"] Jul 13 18:09:37.585130 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:09:37.585101 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170b0fe0_ac00_420b_b6a8_c5c756bbf5ad.slice/crio-60a9c261a43cf4014c18c9e51396877fe834072c9f76114dea30ecc6aea12929 WatchSource:0}: Error finding container 60a9c261a43cf4014c18c9e51396877fe834072c9f76114dea30ecc6aea12929: Status 404 returned error can't find the container with id 60a9c261a43cf4014c18c9e51396877fe834072c9f76114dea30ecc6aea12929 Jul 13 18:09:37.596800 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.596781 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh"] Jul 13 18:09:37.598295 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:09:37.598259 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034d29d7_ee18_4c03_8ec8_0523c08018db.slice/crio-c063b3a17b0cb2bec9398c51ea7dd404a7434572b922bcca26745e4b3b77a2dd WatchSource:0}: Error finding container c063b3a17b0cb2bec9398c51ea7dd404a7434572b922bcca26745e4b3b77a2dd: Status 404 returned error can't find the container with id c063b3a17b0cb2bec9398c51ea7dd404a7434572b922bcca26745e4b3b77a2dd Jul 13 18:09:37.772654 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.772576 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76e84055-e837-40be-bcf1-f19b8b48d7c4" path="/var/lib/kubelet/pods/76e84055-e837-40be-bcf1-f19b8b48d7c4/volumes" Jul 13 18:09:37.772894 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.772881 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" path="/var/lib/kubelet/pods/d9a956cf-99fc-49f8-b7de-dbf52ab87a6f/volumes" Jul 13 18:09:37.934762 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.934734 2582 generic.go:356] "Generic (PLEG): container finished" podID="76e84055-e837-40be-bcf1-f19b8b48d7c4" containerID="a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4" exitCode=0 Jul 13 18:09:37.934922 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.934787 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-td6nc" Jul 13 18:09:37.934922 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.934828 2582 scope.go:117] "RemoveContainer" containerID="a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4" Jul 13 18:09:37.936924 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.936896 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" event={"ID":"034d29d7-ee18-4c03-8ec8-0523c08018db","Type":"ContainerStarted","Data":"d21ab2d31fab255541448f6ca19b730b068aa9dc13dda66ece99989cb2e41035"} Jul 13 18:09:37.937043 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.936954 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" event={"ID":"034d29d7-ee18-4c03-8ec8-0523c08018db","Type":"ContainerStarted","Data":"c063b3a17b0cb2bec9398c51ea7dd404a7434572b922bcca26745e4b3b77a2dd"} Jul 13 18:09:37.937130 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.937056 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:09:37.938903 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.938882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" event={"ID":"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad","Type":"ContainerStarted","Data":"0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b"} Jul 13 18:09:37.939008 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.938918 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" event={"ID":"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad","Type":"ContainerStarted","Data":"60a9c261a43cf4014c18c9e51396877fe834072c9f76114dea30ecc6aea12929"} Jul 13 18:09:37.939008 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.938988 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:37.940543 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.940525 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9a956cf-99fc-49f8-b7de-dbf52ab87a6f" containerID="15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d" exitCode=0 Jul 13 18:09:37.940632 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.940566 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-c4q9z" Jul 13 18:09:37.944769 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.944754 2582 scope.go:117] "RemoveContainer" containerID="a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4" Jul 13 18:09:37.944992 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.944974 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4\": container with ID starting with a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4 not found: ID does not exist" containerID="a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4" Jul 13 18:09:37.945032 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.944999 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4"} err="failed to get container status \"a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4\": rpc error: code = NotFound desc = could not find container \"a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4\": container with ID starting with a4ade54a30d697dc1a1e4fc8d788bbcbcc6351e818d3cbfceb455920c014e5b4 not found: ID does not exist" Jul 13 18:09:37.945032 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.945014 2582 scope.go:117] "RemoveContainer" containerID="15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d" Jul 13 18:09:37.953058 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.953040 2582 scope.go:117] "RemoveContainer" containerID="15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d" Jul 13 18:09:37.953330 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:09:37.953312 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d\": container with ID starting with 15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d not found: ID does not exist" containerID="15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d" Jul 13 18:09:37.953395 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.953337 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d"} err="failed to get container status \"15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d\": rpc error: code = NotFound desc = could not find container \"15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d\": container with ID starting with 15bf4f155667cf53fbdc631f43b1982db674fbf4425cd9ef18551abc1dd9081d not found: ID does not exist" Jul 13 18:09:37.957167 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.957127 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" podStartSLOduration=0.957114708 podStartE2EDuration="957.114708ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:37.954980644 +0000 UTC m=+536.673608402" watchObservedRunningTime="2026-07-13 18:09:37.957114708 +0000 UTC m=+536.675742465" Jul 13 18:09:37.977534 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:37.977492 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" podStartSLOduration=1.977477835 podStartE2EDuration="1.977477835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:37.975429608 +0000 UTC m=+536.694057402" watchObservedRunningTime="2026-07-13 18:09:37.977477835 +0000 UTC m=+536.696105594" Jul 13 18:09:48.950243 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:48.950209 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:09:48.950720 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:09:48.950372 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8bjmh" Jul 13 18:10:08.357066 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.357028 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v"] Jul 13 18:10:08.357530 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.357327 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" podUID="170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" containerName="manager" containerID="cri-o://0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b" gracePeriod=10 Jul 13 18:10:08.602103 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.602080 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:10:08.622876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.622816 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-extensions-socket-volume\") pod \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " Jul 13 18:10:08.622876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.622857 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5kqx\" (UniqueName: \"kubernetes.io/projected/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-kube-api-access-k5kqx\") pod \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\" (UID: \"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad\") " Jul 13 18:10:08.623180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.623160 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" (UID: "170b0fe0-ac00-420b-b6a8-c5c756bbf5ad"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:10:08.625174 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.625151 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-kube-api-access-k5kqx" (OuterVolumeSpecName: "kube-api-access-k5kqx") pod "170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" (UID: "170b0fe0-ac00-420b-b6a8-c5c756bbf5ad"). InnerVolumeSpecName "kube-api-access-k5kqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:10:08.639798 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.639769 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s"] Jul 13 18:10:08.640127 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.640112 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" containerName="manager" Jul 13 18:10:08.640201 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.640131 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" containerName="manager" Jul 13 18:10:08.640253 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.640230 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" containerName="manager" Jul 13 18:10:08.643140 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.643123 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.657527 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.657505 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s"] Jul 13 18:10:08.723690 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.723659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rz45s\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.723858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.723702 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56xv\" (UniqueName: \"kubernetes.io/projected/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-kube-api-access-g56xv\") pod \"kuadrant-operator-controller-manager-86878c769f-rz45s\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.723858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.723743 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5kqx\" (UniqueName: \"kubernetes.io/projected/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-kube-api-access-k5kqx\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:10:08.723858 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.723755 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad-extensions-socket-volume\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:10:08.824120 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.824086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rz45s\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.824309 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.824135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g56xv\" (UniqueName: \"kubernetes.io/projected/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-kube-api-access-g56xv\") pod \"kuadrant-operator-controller-manager-86878c769f-rz45s\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.824475 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.824456 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rz45s\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.832803 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.832780 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56xv\" (UniqueName: \"kubernetes.io/projected/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-kube-api-access-g56xv\") pod \"kuadrant-operator-controller-manager-86878c769f-rz45s\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:08.953740 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:08.953656 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:09.086780 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.086712 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s"] Jul 13 18:10:09.090376 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:10:09.090336 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf413551_92b1_4dc5_9e4e_83d1cdf8488d.slice/crio-cbc482129c115fd1fa22279da9c2de150ea5eb9ffba102a3e54d0aa2107e288f WatchSource:0}: Error finding container cbc482129c115fd1fa22279da9c2de150ea5eb9ffba102a3e54d0aa2107e288f: Status 404 returned error can't find the container with id cbc482129c115fd1fa22279da9c2de150ea5eb9ffba102a3e54d0aa2107e288f Jul 13 18:10:09.093648 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.093626 2582 generic.go:356] "Generic (PLEG): container finished" podID="170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" containerID="0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b" exitCode=0 Jul 13 18:10:09.093716 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.093667 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" Jul 13 18:10:09.093716 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.093701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" event={"ID":"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad","Type":"ContainerDied","Data":"0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b"} Jul 13 18:10:09.093788 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.093757 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v" event={"ID":"170b0fe0-ac00-420b-b6a8-c5c756bbf5ad","Type":"ContainerDied","Data":"60a9c261a43cf4014c18c9e51396877fe834072c9f76114dea30ecc6aea12929"} Jul 13 18:10:09.093821 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.093786 2582 scope.go:117] "RemoveContainer" containerID="0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b" Jul 13 18:10:09.108533 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.108508 2582 scope.go:117] "RemoveContainer" containerID="0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b" Jul 13 18:10:09.108847 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:10:09.108828 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b\": container with ID starting with 0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b not found: ID does not exist" containerID="0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b" Jul 13 18:10:09.108909 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.108860 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b"} err="failed to get container status \"0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b\": rpc error: code = NotFound desc = could not find container \"0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b\": container with ID starting with 0621fa4afa1ffdd193c1f8f0716140cf52e51abbc288a54c3905237787dabb1b not found: ID does not exist" Jul 13 18:10:09.119730 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.119706 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v"] Jul 13 18:10:09.123816 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.123795 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nkq5v"] Jul 13 18:10:09.773133 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:09.773097 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170b0fe0-ac00-420b-b6a8-c5c756bbf5ad" path="/var/lib/kubelet/pods/170b0fe0-ac00-420b-b6a8-c5c756bbf5ad/volumes" Jul 13 18:10:10.100029 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:10.099994 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" event={"ID":"cf413551-92b1-4dc5-9e4e-83d1cdf8488d","Type":"ContainerStarted","Data":"71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d"} Jul 13 18:10:10.100214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:10.100045 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" event={"ID":"cf413551-92b1-4dc5-9e4e-83d1cdf8488d","Type":"ContainerStarted","Data":"cbc482129c115fd1fa22279da9c2de150ea5eb9ffba102a3e54d0aa2107e288f"} Jul 13 18:10:10.100214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:10.100070 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:10.129257 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:10.129207 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" podStartSLOduration=2.129191225 podStartE2EDuration="2.129191225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:10:10.129071095 +0000 UTC m=+568.847698852" watchObservedRunningTime="2026-07-13 18:10:10.129191225 +0000 UTC m=+568.847818981" Jul 13 18:10:21.107506 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:21.107474 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:10:24.771168 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.771131 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb"] Jul 13 18:10:24.776076 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.776058 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.778954 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.778934 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-68lx9\"" Jul 13 18:10:24.784385 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.784359 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb"] Jul 13 18:10:24.840458 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840420 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840480 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840567 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840586 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk6r9\" (UniqueName: \"kubernetes.io/projected/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-kube-api-access-dk6r9\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.840640 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.840630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942013 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.941976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942162 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942162 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942162 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942162 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk6r9\" (UniqueName: \"kubernetes.io/projected/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-kube-api-access-dk6r9\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942162 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942463 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942463 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942463 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942259 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942616 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942508 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942616 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942579 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942725 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942636 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.942725 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.942668 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.943116 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.943092 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.944388 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.944371 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.944681 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.944664 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.952948 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.952917 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:24.953039 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:24.952975 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk6r9\" (UniqueName: \"kubernetes.io/projected/7b10b8a4-b228-4b71-94c2-f74de0d6f63c-kube-api-access-dk6r9\") pod \"maas-default-gateway-openshift-default-56654dcf7-cwnhb\" (UID: \"7b10b8a4-b228-4b71-94c2-f74de0d6f63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:25.087986 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:25.087898 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:25.242551 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:25.242527 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb"] Jul 13 18:10:25.244765 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:10:25.244734 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b10b8a4_b228_4b71_94c2_f74de0d6f63c.slice/crio-242d48d5725b1a56f2470a08132ba324d0cf6c05594b36dbe3184bc623fe74a5 WatchSource:0}: Error finding container 242d48d5725b1a56f2470a08132ba324d0cf6c05594b36dbe3184bc623fe74a5: Status 404 returned error can't find the container with id 242d48d5725b1a56f2470a08132ba324d0cf6c05594b36dbe3184bc623fe74a5 Jul 13 18:10:25.246605 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:25.246569 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:10:25.246696 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:25.246646 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:10:25.246696 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:25.246687 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:10:26.178296 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:26.178234 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" event={"ID":"7b10b8a4-b228-4b71-94c2-f74de0d6f63c","Type":"ContainerStarted","Data":"99570a8e876e3a3db92e79700a8c396e1a6e59039f324466c10434abc0aad869"} Jul 13 18:10:26.178665 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:26.178318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" event={"ID":"7b10b8a4-b228-4b71-94c2-f74de0d6f63c","Type":"ContainerStarted","Data":"242d48d5725b1a56f2470a08132ba324d0cf6c05594b36dbe3184bc623fe74a5"} Jul 13 18:10:26.204687 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:26.204640 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" podStartSLOduration=2.204623829 podStartE2EDuration="2.204623829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:10:26.202678836 +0000 UTC m=+584.921306593" watchObservedRunningTime="2026-07-13 18:10:26.204623829 +0000 UTC m=+584.923251585" Jul 13 18:10:27.088529 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:27.088483 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:27.093146 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:27.093119 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:27.183451 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:27.183418 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:27.184392 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:27.184370 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:10:29.224786 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.224751 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-j9mxz"] Jul 13 18:10:29.227884 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.227867 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:29.230925 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.230902 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jn2wt\"" Jul 13 18:10:29.237461 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.237434 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9mxz"] Jul 13 18:10:29.282266 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.282235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69rks\" (UniqueName: \"kubernetes.io/projected/ef2b0ba2-8433-4538-85d0-04404cc044cd-kube-api-access-69rks\") pod \"authorino-58cd955675-j9mxz\" (UID: \"ef2b0ba2-8433-4538-85d0-04404cc044cd\") " pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:29.383641 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.383608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69rks\" (UniqueName: \"kubernetes.io/projected/ef2b0ba2-8433-4538-85d0-04404cc044cd-kube-api-access-69rks\") pod \"authorino-58cd955675-j9mxz\" (UID: \"ef2b0ba2-8433-4538-85d0-04404cc044cd\") " pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:29.392310 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.392263 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69rks\" (UniqueName: \"kubernetes.io/projected/ef2b0ba2-8433-4538-85d0-04404cc044cd-kube-api-access-69rks\") pod \"authorino-58cd955675-j9mxz\" (UID: \"ef2b0ba2-8433-4538-85d0-04404cc044cd\") " pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:29.538852 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.538768 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:29.672083 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:29.672056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9mxz"] Jul 13 18:10:29.674414 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:10:29.674381 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef2b0ba2_8433_4538_85d0_04404cc044cd.slice/crio-f9a79273abcf7d25b7baa923b3e14fdbfded5b37057e39fd3c4116f7c590b0c2 WatchSource:0}: Error finding container f9a79273abcf7d25b7baa923b3e14fdbfded5b37057e39fd3c4116f7c590b0c2: Status 404 returned error can't find the container with id f9a79273abcf7d25b7baa923b3e14fdbfded5b37057e39fd3c4116f7c590b0c2 Jul 13 18:10:30.200250 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:30.200183 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9mxz" event={"ID":"ef2b0ba2-8433-4538-85d0-04404cc044cd","Type":"ContainerStarted","Data":"f9a79273abcf7d25b7baa923b3e14fdbfded5b37057e39fd3c4116f7c590b0c2"} Jul 13 18:10:34.229073 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:34.229036 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9mxz" event={"ID":"ef2b0ba2-8433-4538-85d0-04404cc044cd","Type":"ContainerStarted","Data":"c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91"} Jul 13 18:10:34.246196 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:34.246142 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-j9mxz" podStartSLOduration=1.527999812 podStartE2EDuration="5.246121104s" totalImagesPullingTime="3.718121292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:10:34.24544784 +0000 UTC m=+592.964075597" watchObservedRunningTime="2026-07-13 18:10:34.246121104 +0000 UTC m=+592.964748862" Jul 13 18:10:34.518494 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:34.518416 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9mxz"] Jul 13 18:10:36.239553 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:36.239513 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-j9mxz" podUID="ef2b0ba2-8433-4538-85d0-04404cc044cd" containerName="authorino" containerID="cri-o://c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91" gracePeriod=30 Jul 13 18:10:36.485454 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:36.485431 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:36.547982 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:36.547893 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69rks\" (UniqueName: \"kubernetes.io/projected/ef2b0ba2-8433-4538-85d0-04404cc044cd-kube-api-access-69rks\") pod \"ef2b0ba2-8433-4538-85d0-04404cc044cd\" (UID: \"ef2b0ba2-8433-4538-85d0-04404cc044cd\") " Jul 13 18:10:36.550019 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:36.549988 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2b0ba2-8433-4538-85d0-04404cc044cd-kube-api-access-69rks" (OuterVolumeSpecName: "kube-api-access-69rks") pod "ef2b0ba2-8433-4538-85d0-04404cc044cd" (UID: "ef2b0ba2-8433-4538-85d0-04404cc044cd"). InnerVolumeSpecName "kube-api-access-69rks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:10:36.649452 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:36.649417 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69rks\" (UniqueName: \"kubernetes.io/projected/ef2b0ba2-8433-4538-85d0-04404cc044cd-kube-api-access-69rks\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:10:37.245065 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.245035 2582 generic.go:356] "Generic (PLEG): container finished" podID="ef2b0ba2-8433-4538-85d0-04404cc044cd" containerID="c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91" exitCode=0 Jul 13 18:10:37.245567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.245077 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9mxz" Jul 13 18:10:37.245567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.245131 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9mxz" event={"ID":"ef2b0ba2-8433-4538-85d0-04404cc044cd","Type":"ContainerDied","Data":"c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91"} Jul 13 18:10:37.245567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.245178 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9mxz" event={"ID":"ef2b0ba2-8433-4538-85d0-04404cc044cd","Type":"ContainerDied","Data":"f9a79273abcf7d25b7baa923b3e14fdbfded5b37057e39fd3c4116f7c590b0c2"} Jul 13 18:10:37.245567 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.245201 2582 scope.go:117] "RemoveContainer" containerID="c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91" Jul 13 18:10:37.254255 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.254238 2582 scope.go:117] "RemoveContainer" containerID="c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91" Jul 13 18:10:37.254535 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:10:37.254516 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91\": container with ID starting with c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91 not found: ID does not exist" containerID="c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91" Jul 13 18:10:37.254582 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.254552 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91"} err="failed to get container status \"c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91\": rpc error: code = NotFound desc = could not find container \"c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91\": container with ID starting with c1857457b1677c602bbaaa74344fddeb4585a721866123da5a579b9df8376c91 not found: ID does not exist" Jul 13 18:10:37.266807 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.266786 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9mxz"] Jul 13 18:10:37.270430 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.270409 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9mxz"] Jul 13 18:10:37.772991 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:37.772958 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2b0ba2-8433-4538-85d0-04404cc044cd" path="/var/lib/kubelet/pods/ef2b0ba2-8433-4538-85d0-04404cc044cd/volumes" Jul 13 18:10:41.740403 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:41.740373 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:10:41.742379 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:10:41.742360 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:11:01.360741 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.360711 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-btmmg"] Jul 13 18:11:01.361236 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.361087 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2b0ba2-8433-4538-85d0-04404cc044cd" containerName="authorino" Jul 13 18:11:01.361236 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.361099 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2b0ba2-8433-4538-85d0-04404cc044cd" containerName="authorino" Jul 13 18:11:01.361236 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.361153 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2b0ba2-8433-4538-85d0-04404cc044cd" containerName="authorino" Jul 13 18:11:01.368753 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.368732 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:01.372838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.372224 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jn2wt\"" Jul 13 18:11:01.378149 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.376599 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-btmmg"] Jul 13 18:11:01.458475 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.458441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67pb5\" (UniqueName: \"kubernetes.io/projected/1027717d-3c38-4b9b-8244-13b50e012fae-kube-api-access-67pb5\") pod \"authorino-5d4b67c446-btmmg\" (UID: \"1027717d-3c38-4b9b-8244-13b50e012fae\") " pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:01.559851 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.559808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67pb5\" (UniqueName: \"kubernetes.io/projected/1027717d-3c38-4b9b-8244-13b50e012fae-kube-api-access-67pb5\") pod \"authorino-5d4b67c446-btmmg\" (UID: \"1027717d-3c38-4b9b-8244-13b50e012fae\") " pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:01.567737 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.567705 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67pb5\" (UniqueName: \"kubernetes.io/projected/1027717d-3c38-4b9b-8244-13b50e012fae-kube-api-access-67pb5\") pod \"authorino-5d4b67c446-btmmg\" (UID: \"1027717d-3c38-4b9b-8244-13b50e012fae\") " pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:01.592190 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.592158 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-btmmg"] Jul 13 18:11:01.592441 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.592426 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:01.619547 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.619470 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79885d9dcb-hzm7b"] Jul 13 18:11:01.623546 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.623523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:01.629589 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.629565 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79885d9dcb-hzm7b"] Jul 13 18:11:01.731977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.731954 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-btmmg"] Jul 13 18:11:01.734414 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:11:01.734387 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1027717d_3c38_4b9b_8244_13b50e012fae.slice/crio-fd1463f1b3d087fbb673e4e5572faa2176f1e99ebb64b11cd7fcc7161c6d9b0f WatchSource:0}: Error finding container fd1463f1b3d087fbb673e4e5572faa2176f1e99ebb64b11cd7fcc7161c6d9b0f: Status 404 returned error can't find the container with id fd1463f1b3d087fbb673e4e5572faa2176f1e99ebb64b11cd7fcc7161c6d9b0f Jul 13 18:11:01.761838 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.761809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dmld\" (UniqueName: \"kubernetes.io/projected/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9-kube-api-access-6dmld\") pod \"authorino-79885d9dcb-hzm7b\" (UID: \"117ffd0a-8bbc-43ba-8113-8ef1b18d49b9\") " pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:01.801069 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.801040 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79885d9dcb-hzm7b"] Jul 13 18:11:01.801307 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:11:01.801288 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6dmld], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-79885d9dcb-hzm7b" podUID="117ffd0a-8bbc-43ba-8113-8ef1b18d49b9" Jul 13 18:11:01.862304 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.862235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dmld\" (UniqueName: \"kubernetes.io/projected/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9-kube-api-access-6dmld\") pod \"authorino-79885d9dcb-hzm7b\" (UID: \"117ffd0a-8bbc-43ba-8113-8ef1b18d49b9\") " pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:01.871085 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:01.871021 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dmld\" (UniqueName: \"kubernetes.io/projected/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9-kube-api-access-6dmld\") pod \"authorino-79885d9dcb-hzm7b\" (UID: \"117ffd0a-8bbc-43ba-8113-8ef1b18d49b9\") " pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:02.370173 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:02.370142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-btmmg" event={"ID":"1027717d-3c38-4b9b-8244-13b50e012fae","Type":"ContainerStarted","Data":"fd1463f1b3d087fbb673e4e5572faa2176f1e99ebb64b11cd7fcc7161c6d9b0f"} Jul 13 18:11:02.370585 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:02.370191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:02.377409 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:02.377393 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:02.466474 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:02.466441 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dmld\" (UniqueName: \"kubernetes.io/projected/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9-kube-api-access-6dmld\") pod \"117ffd0a-8bbc-43ba-8113-8ef1b18d49b9\" (UID: \"117ffd0a-8bbc-43ba-8113-8ef1b18d49b9\") " Jul 13 18:11:02.468913 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:02.468874 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9-kube-api-access-6dmld" (OuterVolumeSpecName: "kube-api-access-6dmld") pod "117ffd0a-8bbc-43ba-8113-8ef1b18d49b9" (UID: "117ffd0a-8bbc-43ba-8113-8ef1b18d49b9"). InnerVolumeSpecName "kube-api-access-6dmld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:11:02.567358 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:02.567321 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dmld\" (UniqueName: \"kubernetes.io/projected/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9-kube-api-access-6dmld\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:11:03.376661 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.376631 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79885d9dcb-hzm7b" Jul 13 18:11:03.377119 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.376677 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-btmmg" podUID="1027717d-3c38-4b9b-8244-13b50e012fae" containerName="authorino" containerID="cri-o://6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858" gracePeriod=30 Jul 13 18:11:03.377119 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.376679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-btmmg" event={"ID":"1027717d-3c38-4b9b-8244-13b50e012fae","Type":"ContainerStarted","Data":"6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858"} Jul 13 18:11:03.402007 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.401955 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-btmmg" podStartSLOduration=1.7732136349999998 podStartE2EDuration="2.401934949s" totalImagesPullingTime="628.721314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:11:03.399379694 +0000 UTC m=+622.118007466" watchObservedRunningTime="2026-07-13 18:11:03.401934949 +0000 UTC m=+622.120562707" Jul 13 18:11:03.423844 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.423819 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79885d9dcb-hzm7b"] Jul 13 18:11:03.427688 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.427662 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79885d9dcb-hzm7b"] Jul 13 18:11:03.629363 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.629305 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:03.773180 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.773143 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="117ffd0a-8bbc-43ba-8113-8ef1b18d49b9" path="/var/lib/kubelet/pods/117ffd0a-8bbc-43ba-8113-8ef1b18d49b9/volumes" Jul 13 18:11:03.777071 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.777036 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67pb5\" (UniqueName: \"kubernetes.io/projected/1027717d-3c38-4b9b-8244-13b50e012fae-kube-api-access-67pb5\") pod \"1027717d-3c38-4b9b-8244-13b50e012fae\" (UID: \"1027717d-3c38-4b9b-8244-13b50e012fae\") " Jul 13 18:11:03.779157 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.779134 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1027717d-3c38-4b9b-8244-13b50e012fae-kube-api-access-67pb5" (OuterVolumeSpecName: "kube-api-access-67pb5") pod "1027717d-3c38-4b9b-8244-13b50e012fae" (UID: "1027717d-3c38-4b9b-8244-13b50e012fae"). InnerVolumeSpecName "kube-api-access-67pb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:11:03.878402 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:03.878364 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67pb5\" (UniqueName: \"kubernetes.io/projected/1027717d-3c38-4b9b-8244-13b50e012fae-kube-api-access-67pb5\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:11:04.382430 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.382396 2582 generic.go:356] "Generic (PLEG): container finished" podID="1027717d-3c38-4b9b-8244-13b50e012fae" containerID="6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858" exitCode=0 Jul 13 18:11:04.382835 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.382439 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-btmmg" Jul 13 18:11:04.382835 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.382484 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-btmmg" event={"ID":"1027717d-3c38-4b9b-8244-13b50e012fae","Type":"ContainerDied","Data":"6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858"} Jul 13 18:11:04.382835 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.382524 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-btmmg" event={"ID":"1027717d-3c38-4b9b-8244-13b50e012fae","Type":"ContainerDied","Data":"fd1463f1b3d087fbb673e4e5572faa2176f1e99ebb64b11cd7fcc7161c6d9b0f"} Jul 13 18:11:04.382835 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.382541 2582 scope.go:117] "RemoveContainer" containerID="6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858" Jul 13 18:11:04.393662 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.393644 2582 scope.go:117] "RemoveContainer" containerID="6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858" Jul 13 18:11:04.393930 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:11:04.393906 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858\": container with ID starting with 6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858 not found: ID does not exist" containerID="6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858" Jul 13 18:11:04.393969 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.393941 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858"} err="failed to get container status \"6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858\": rpc error: code = NotFound desc = could not find container \"6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858\": container with ID starting with 6ace8ea827cc656937b2c78b371df309c12f28d9d9bd29960421862033eed858 not found: ID does not exist" Jul 13 18:11:04.408313 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.408262 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-btmmg"] Jul 13 18:11:04.412097 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:04.412068 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-btmmg"] Jul 13 18:11:05.773638 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:05.773604 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1027717d-3c38-4b9b-8244-13b50e012fae" path="/var/lib/kubelet/pods/1027717d-3c38-4b9b-8244-13b50e012fae/volumes" Jul 13 18:11:47.207933 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.207897 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-5fnnb"] Jul 13 18:11:47.208363 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.208238 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1027717d-3c38-4b9b-8244-13b50e012fae" containerName="authorino" Jul 13 18:11:47.208363 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.208250 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1027717d-3c38-4b9b-8244-13b50e012fae" containerName="authorino" Jul 13 18:11:47.208363 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.208324 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1027717d-3c38-4b9b-8244-13b50e012fae" containerName="authorino" Jul 13 18:11:47.212454 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.212437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.215471 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.215448 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tj758\"" Jul 13 18:11:47.215605 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.215452 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 18:11:47.220925 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.220902 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-5fnnb"] Jul 13 18:11:47.258522 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.258495 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d65pj"] Jul 13 18:11:47.261554 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.261539 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.271089 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.271070 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d65pj"] Jul 13 18:11:47.323483 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.323454 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvn6s\" (UniqueName: \"kubernetes.io/projected/ca2af1a9-b94a-4baf-87e7-f03d0970d026-kube-api-access-wvn6s\") pod \"payload-processing-f9b8d9b9b-5fnnb\" (UID: \"ca2af1a9-b94a-4baf-87e7-f03d0970d026\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.323664 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.323490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l7vg\" (UniqueName: \"kubernetes.io/projected/44e0eddb-4a45-469f-8d8a-7c42f5643125-kube-api-access-2l7vg\") pod \"payload-pre-processing-74584bb9f8-d65pj\" (UID: \"44e0eddb-4a45-469f-8d8a-7c42f5643125\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.323664 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.323561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca2af1a9-b94a-4baf-87e7-f03d0970d026-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-5fnnb\" (UID: \"ca2af1a9-b94a-4baf-87e7-f03d0970d026\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.323664 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.323594 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0eddb-4a45-469f-8d8a-7c42f5643125-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d65pj\" (UID: \"44e0eddb-4a45-469f-8d8a-7c42f5643125\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.424126 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.424088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca2af1a9-b94a-4baf-87e7-f03d0970d026-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-5fnnb\" (UID: \"ca2af1a9-b94a-4baf-87e7-f03d0970d026\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.424364 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.424132 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0eddb-4a45-469f-8d8a-7c42f5643125-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d65pj\" (UID: \"44e0eddb-4a45-469f-8d8a-7c42f5643125\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.424364 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.424177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvn6s\" (UniqueName: \"kubernetes.io/projected/ca2af1a9-b94a-4baf-87e7-f03d0970d026-kube-api-access-wvn6s\") pod \"payload-processing-f9b8d9b9b-5fnnb\" (UID: \"ca2af1a9-b94a-4baf-87e7-f03d0970d026\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.424364 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.424205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l7vg\" (UniqueName: \"kubernetes.io/projected/44e0eddb-4a45-469f-8d8a-7c42f5643125-kube-api-access-2l7vg\") pod \"payload-pre-processing-74584bb9f8-d65pj\" (UID: \"44e0eddb-4a45-469f-8d8a-7c42f5643125\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.425002 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.424974 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44e0eddb-4a45-469f-8d8a-7c42f5643125-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-d65pj\" (UID: \"44e0eddb-4a45-469f-8d8a-7c42f5643125\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.425123 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.424982 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca2af1a9-b94a-4baf-87e7-f03d0970d026-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-5fnnb\" (UID: \"ca2af1a9-b94a-4baf-87e7-f03d0970d026\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.435463 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.435428 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvn6s\" (UniqueName: \"kubernetes.io/projected/ca2af1a9-b94a-4baf-87e7-f03d0970d026-kube-api-access-wvn6s\") pod \"payload-processing-f9b8d9b9b-5fnnb\" (UID: \"ca2af1a9-b94a-4baf-87e7-f03d0970d026\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.435708 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.435689 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l7vg\" (UniqueName: \"kubernetes.io/projected/44e0eddb-4a45-469f-8d8a-7c42f5643125-kube-api-access-2l7vg\") pod \"payload-pre-processing-74584bb9f8-d65pj\" (UID: \"44e0eddb-4a45-469f-8d8a-7c42f5643125\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.523844 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.523769 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:47.571188 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.571156 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:47.679183 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.679106 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-5fnnb"] Jul 13 18:11:47.682861 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:11:47.682828 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2af1a9_b94a_4baf_87e7_f03d0970d026.slice/crio-581e63aa45612b473254944561f9dc6bb3ce207fb83d207a0b95e1e32f2276b4 WatchSource:0}: Error finding container 581e63aa45612b473254944561f9dc6bb3ce207fb83d207a0b95e1e32f2276b4: Status 404 returned error can't find the container with id 581e63aa45612b473254944561f9dc6bb3ce207fb83d207a0b95e1e32f2276b4 Jul 13 18:11:47.685172 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.685153 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 18:11:47.721008 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:47.720977 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-d65pj"] Jul 13 18:11:47.722020 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:11:47.721990 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e0eddb_4a45_469f_8d8a_7c42f5643125.slice/crio-a12ba5fde2f041397a23361a269564e19a564265a05fe77d13374520bbca7c0d WatchSource:0}: Error finding container a12ba5fde2f041397a23361a269564e19a564265a05fe77d13374520bbca7c0d: Status 404 returned error can't find the container with id a12ba5fde2f041397a23361a269564e19a564265a05fe77d13374520bbca7c0d Jul 13 18:11:48.598987 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:48.598947 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" event={"ID":"44e0eddb-4a45-469f-8d8a-7c42f5643125","Type":"ContainerStarted","Data":"a12ba5fde2f041397a23361a269564e19a564265a05fe77d13374520bbca7c0d"} Jul 13 18:11:48.600582 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:48.600557 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" event={"ID":"ca2af1a9-b94a-4baf-87e7-f03d0970d026","Type":"ContainerStarted","Data":"581e63aa45612b473254944561f9dc6bb3ce207fb83d207a0b95e1e32f2276b4"} Jul 13 18:11:50.616508 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:50.615638 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" event={"ID":"44e0eddb-4a45-469f-8d8a-7c42f5643125","Type":"ContainerStarted","Data":"3276d529935f767d878c013abbd445274444af4656e581a6903a2968f235a0f6"} Jul 13 18:11:50.616508 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:50.616451 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:11:50.618977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:50.618953 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" event={"ID":"ca2af1a9-b94a-4baf-87e7-f03d0970d026","Type":"ContainerStarted","Data":"cab80e548b4af37774280e1018d56e715612e3a0c306d105b77b8205d01d341b"} Jul 13 18:11:50.619646 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:50.619628 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:11:50.633099 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:50.633044 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" podStartSLOduration=1.810332914 podStartE2EDuration="3.633026629s" totalImagesPullingTime="1.822693715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:11:50.632296721 +0000 UTC m=+669.350924473" watchObservedRunningTime="2026-07-13 18:11:50.633026629 +0000 UTC m=+669.351654387" Jul 13 18:11:50.649557 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:50.649504 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" podStartSLOduration=1.787300193 podStartE2EDuration="3.649489043s" totalImagesPullingTime="1.86218885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:11:50.64817051 +0000 UTC m=+669.366798267" watchObservedRunningTime="2026-07-13 18:11:50.649489043 +0000 UTC m=+669.368116800" Jul 13 18:11:55.647834 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:55.647800 2582 generic.go:356] "Generic (PLEG): container finished" podID="7b10b8a4-b228-4b71-94c2-f74de0d6f63c" containerID="99570a8e876e3a3db92e79700a8c396e1a6e59039f324466c10434abc0aad869" exitCode=0 Jul 13 18:11:55.648323 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:55.647872 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" event={"ID":"7b10b8a4-b228-4b71-94c2-f74de0d6f63c","Type":"ContainerDied","Data":"99570a8e876e3a3db92e79700a8c396e1a6e59039f324466c10434abc0aad869"} Jul 13 18:11:55.648323 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:55.648246 2582 scope.go:117] "RemoveContainer" containerID="99570a8e876e3a3db92e79700a8c396e1a6e59039f324466c10434abc0aad869" Jul 13 18:11:55.649241 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:55.649206 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:11:55.649333 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:55.649314 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:11:55.649380 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:55.649364 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 13 18:11:56.655975 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:56.655940 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" event={"ID":"7b10b8a4-b228-4b71-94c2-f74de0d6f63c","Type":"ContainerStarted","Data":"db6d9407a7deaadc557d33dd33d3d6fcd84cc1eea10005b1f1353ed82307be78"} Jul 13 18:11:57.088251 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:57.088153 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:11:57.089394 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:57.089367 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwnhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 13 18:11:57.089530 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:57.089418 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" podUID="7b10b8a4-b228-4b71-94c2-f74de0d6f63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 13 18:11:57.184181 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:57.184152 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:11:58.088646 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:58.088612 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwnhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 13 18:11:58.089038 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:58.088668 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" podUID="7b10b8a4-b228-4b71-94c2-f74de0d6f63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 13 18:11:59.088783 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:59.088745 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwnhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 13 18:11:59.089239 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:11:59.088806 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" podUID="7b10b8a4-b228-4b71-94c2-f74de0d6f63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 13 18:12:00.089082 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:00.089048 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwnhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 13 18:12:00.089512 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:00.089101 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" podUID="7b10b8a4-b228-4b71-94c2-f74de0d6f63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 13 18:12:01.089104 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:01.089069 2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cwnhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 13 18:12:01.089515 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:01.089126 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" podUID="7b10b8a4-b228-4b71-94c2-f74de0d6f63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 13 18:12:02.092337 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:02.092309 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:12:02.093338 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:02.093321 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cwnhb" Jul 13 18:12:02.634373 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:02.634344 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-5fnnb" Jul 13 18:12:02.634551 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:02.634531 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-d65pj" Jul 13 18:12:32.767979 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.767892 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44x55"] Jul 13 18:12:32.771663 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.771641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.774700 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.774681 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 18:12:32.776014 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.775997 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 18:12:32.776130 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.776018 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k7clw\"" Jul 13 18:12:32.776349 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.776330 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 13 18:12:32.781022 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.781000 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44x55"] Jul 13 18:12:32.809247 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.809217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.809247 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.809247 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.809424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.809267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.809424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.809305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjtfx\" (UniqueName: \"kubernetes.io/projected/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-kube-api-access-xjtfx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.809424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.809409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.809535 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.809439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.909988 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.909953 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.909988 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.909989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910202 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910202 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910032 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjtfx\" (UniqueName: \"kubernetes.io/projected/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-kube-api-access-xjtfx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910202 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910093 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910202 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910449 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910538 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910479 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.910589 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.910533 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.912625 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.912599 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.913036 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.913014 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:32.918826 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:32.918795 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjtfx\" (UniqueName: \"kubernetes.io/projected/665b1958-dfbd-4ea2-a44e-7ff1f4ba1804-kube-api-access-xjtfx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44x55\" (UID: \"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:33.082593 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:33.082511 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:33.221011 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:33.220988 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44x55"] Jul 13 18:12:33.223888 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:12:33.223861 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665b1958_dfbd_4ea2_a44e_7ff1f4ba1804.slice/crio-2bd7c1b1767bc67403d77040d07bef9f6c697746c8e2a98b16ec427c0b182467 WatchSource:0}: Error finding container 2bd7c1b1767bc67403d77040d07bef9f6c697746c8e2a98b16ec427c0b182467: Status 404 returned error can't find the container with id 2bd7c1b1767bc67403d77040d07bef9f6c697746c8e2a98b16ec427c0b182467 Jul 13 18:12:33.846363 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:33.846315 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" event={"ID":"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804","Type":"ContainerStarted","Data":"2bd7c1b1767bc67403d77040d07bef9f6c697746c8e2a98b16ec427c0b182467"} Jul 13 18:12:34.852723 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:34.852685 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" event={"ID":"665b1958-dfbd-4ea2-a44e-7ff1f4ba1804","Type":"ContainerStarted","Data":"15433de47097a648f3548a1c947e54851931e4e401d3192933e10bfd37de2918"} Jul 13 18:12:34.881208 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:34.881153 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" podStartSLOduration=1.786143451 podStartE2EDuration="2.881137037s" totalImagesPullingTime="1.094993586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:12:34.878873027 +0000 UTC m=+713.597500783" watchObservedRunningTime="2026-07-13 18:12:34.881137037 +0000 UTC m=+713.599764794" Jul 13 18:12:43.083666 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:43.083626 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:43.084118 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:43.083707 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:43.096054 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:43.096032 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:43.907615 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:43.907578 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44x55" Jul 13 18:12:46.150423 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.150380 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm"] Jul 13 18:12:46.154267 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.154243 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.157152 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.157130 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 18:12:46.164756 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.164735 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm"] Jul 13 18:12:46.218753 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.218721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8d042ed-7566-45ee-9c00-7ad1b19ac893-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.218919 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.218763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.218919 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.218782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.218919 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.218801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn8lz\" (UniqueName: \"kubernetes.io/projected/e8d042ed-7566-45ee-9c00-7ad1b19ac893-kube-api-access-tn8lz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.218919 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.218855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.218919 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.218894 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320123 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320123 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320127 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320393 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320151 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn8lz\" (UniqueName: \"kubernetes.io/projected/e8d042ed-7566-45ee-9c00-7ad1b19ac893-kube-api-access-tn8lz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320393 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320393 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320393 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8d042ed-7566-45ee-9c00-7ad1b19ac893-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320663 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320724 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320671 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.320799 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.320776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.322653 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.322619 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8d042ed-7566-45ee-9c00-7ad1b19ac893-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.322893 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.322874 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8d042ed-7566-45ee-9c00-7ad1b19ac893-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.328266 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.328245 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn8lz\" (UniqueName: \"kubernetes.io/projected/e8d042ed-7566-45ee-9c00-7ad1b19ac893-kube-api-access-tn8lz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9stdm\" (UID: \"e8d042ed-7566-45ee-9c00-7ad1b19ac893\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.464241 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.464143 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:46.605206 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.605180 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm"] Jul 13 18:12:46.606628 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:12:46.606602 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d042ed_7566_45ee_9c00_7ad1b19ac893.slice/crio-cd7c53c6bddc6f9dfc5b4919c7f0672440d53e54467716284a250fb725ff35fa WatchSource:0}: Error finding container cd7c53c6bddc6f9dfc5b4919c7f0672440d53e54467716284a250fb725ff35fa: Status 404 returned error can't find the container with id cd7c53c6bddc6f9dfc5b4919c7f0672440d53e54467716284a250fb725ff35fa Jul 13 18:12:46.914194 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:46.914156 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" event={"ID":"e8d042ed-7566-45ee-9c00-7ad1b19ac893","Type":"ContainerStarted","Data":"cd7c53c6bddc6f9dfc5b4919c7f0672440d53e54467716284a250fb725ff35fa"} Jul 13 18:12:47.921592 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:47.921559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" event={"ID":"e8d042ed-7566-45ee-9c00-7ad1b19ac893","Type":"ContainerStarted","Data":"8f60a0cff7004811cc0ce87f6c7998c2d9af1a2271305354c4a1bf5f1a73d676"} Jul 13 18:12:47.940201 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:47.940147 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" podStartSLOduration=1.690618108 podStartE2EDuration="1.940131044s" totalImagesPullingTime="249.512936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:12:47.939783023 +0000 UTC m=+726.658410792" watchObservedRunningTime="2026-07-13 18:12:47.940131044 +0000 UTC m=+726.658758805" Jul 13 18:12:56.465007 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:56.464972 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:56.465408 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:56.465036 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:56.477472 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:56.477450 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:12:56.979353 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:12:56.979321 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9stdm" Jul 13 18:13:05.359836 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.359801 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp"] Jul 13 18:13:05.363653 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.363631 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.366243 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.366225 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 18:13:05.374862 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.374835 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp"] Jul 13 18:13:05.492377 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.492342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.492547 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.492388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.492547 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.492476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.492547 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.492519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd9rk\" (UniqueName: \"kubernetes.io/projected/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-kube-api-access-vd9rk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.492670 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.492548 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.492670 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.492618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593437 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593610 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593610 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593691 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593691 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593661 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9rk\" (UniqueName: \"kubernetes.io/projected/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-kube-api-access-vd9rk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593832 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593916 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593864 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593916 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593905 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.593990 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.593942 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.595831 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.595810 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.596306 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.596267 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.601623 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.601596 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9rk\" (UniqueName: \"kubernetes.io/projected/a71328c2-2b32-4d0a-ace6-82c1d1dbf842-kube-api-access-vd9rk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp\" (UID: \"a71328c2-2b32-4d0a-ace6-82c1d1dbf842\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.677654 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.677557 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:05.819238 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:05.819209 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp"] Jul 13 18:13:05.820341 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:13:05.820309 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda71328c2_2b32_4d0a_ace6_82c1d1dbf842.slice/crio-76b4382d9004a02cba22ac04978f46202d323222061a54bc23b1f4b2fd4ddf53 WatchSource:0}: Error finding container 76b4382d9004a02cba22ac04978f46202d323222061a54bc23b1f4b2fd4ddf53: Status 404 returned error can't find the container with id 76b4382d9004a02cba22ac04978f46202d323222061a54bc23b1f4b2fd4ddf53 Jul 13 18:13:06.014528 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:06.014449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" event={"ID":"a71328c2-2b32-4d0a-ace6-82c1d1dbf842","Type":"ContainerStarted","Data":"76b4382d9004a02cba22ac04978f46202d323222061a54bc23b1f4b2fd4ddf53"} Jul 13 18:13:07.023615 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:07.023572 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" event={"ID":"a71328c2-2b32-4d0a-ace6-82c1d1dbf842","Type":"ContainerStarted","Data":"87b4c0a6e1bee34ea0cd628939483cbbd598c02b8995b0d11ca9e49e6ff41eb7"} Jul 13 18:13:07.041475 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:07.041410 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" podStartSLOduration=1.837216722 podStartE2EDuration="2.041394373s" totalImagesPullingTime="204.177651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:13:07.040098238 +0000 UTC m=+745.758725996" watchObservedRunningTime="2026-07-13 18:13:07.041394373 +0000 UTC m=+745.760022130" Jul 13 18:13:15.677723 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:15.677683 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:15.678211 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:15.677742 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:15.690241 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:15.690213 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:13:16.081062 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:13:16.080980 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp" Jul 13 18:15:41.775024 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:15:41.774940 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:15:41.775741 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:15:41.775717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:19:56.907267 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:19:56.907224 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s"] Jul 13 18:19:56.909934 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:19:56.907466 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" podUID="cf413551-92b1-4dc5-9e4e-83d1cdf8488d" containerName="manager" containerID="cri-o://71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d" gracePeriod=10 Jul 13 18:20:00.064902 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.064876 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:20:00.118672 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.118638 2582 generic.go:356] "Generic (PLEG): container finished" podID="cf413551-92b1-4dc5-9e4e-83d1cdf8488d" containerID="71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d" exitCode=0 Jul 13 18:20:00.118876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.118684 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" Jul 13 18:20:00.118876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.118711 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" event={"ID":"cf413551-92b1-4dc5-9e4e-83d1cdf8488d","Type":"ContainerDied","Data":"71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d"} Jul 13 18:20:00.118876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.118763 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s" event={"ID":"cf413551-92b1-4dc5-9e4e-83d1cdf8488d","Type":"ContainerDied","Data":"cbc482129c115fd1fa22279da9c2de150ea5eb9ffba102a3e54d0aa2107e288f"} Jul 13 18:20:00.118876 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.118792 2582 scope.go:117] "RemoveContainer" containerID="71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d" Jul 13 18:20:00.129622 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.129595 2582 scope.go:117] "RemoveContainer" containerID="71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d" Jul 13 18:20:00.129913 ip-10-0-128-48 kubenswrapper[2582]: E0713 18:20:00.129894 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d\": container with ID starting with 71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d not found: ID does not exist" containerID="71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d" Jul 13 18:20:00.129979 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.129926 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d"} err="failed to get container status \"71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d\": rpc error: code = NotFound desc = could not find container \"71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d\": container with ID starting with 71ea2faca475e1e4df3bd079d6a11bd4fb424d7a45343247af15f4c31b09cb1d not found: ID does not exist" Jul 13 18:20:00.185299 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.185253 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g56xv\" (UniqueName: \"kubernetes.io/projected/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-kube-api-access-g56xv\") pod \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " Jul 13 18:20:00.185487 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.185341 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-extensions-socket-volume\") pod \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\" (UID: \"cf413551-92b1-4dc5-9e4e-83d1cdf8488d\") " Jul 13 18:20:00.185686 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.185666 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf413551-92b1-4dc5-9e4e-83d1cdf8488d" (UID: "cf413551-92b1-4dc5-9e4e-83d1cdf8488d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:20:00.187446 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.187422 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-kube-api-access-g56xv" (OuterVolumeSpecName: "kube-api-access-g56xv") pod "cf413551-92b1-4dc5-9e4e-83d1cdf8488d" (UID: "cf413551-92b1-4dc5-9e4e-83d1cdf8488d"). InnerVolumeSpecName "kube-api-access-g56xv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:20:00.286244 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.286203 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-extensions-socket-volume\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:20:00.286244 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.286239 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g56xv\" (UniqueName: \"kubernetes.io/projected/cf413551-92b1-4dc5-9e4e-83d1cdf8488d-kube-api-access-g56xv\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\"" Jul 13 18:20:00.442743 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.442708 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s"] Jul 13 18:20:00.447464 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:00.447437 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rz45s"] Jul 13 18:20:01.773618 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:01.773583 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf413551-92b1-4dc5-9e4e-83d1cdf8488d" path="/var/lib/kubelet/pods/cf413551-92b1-4dc5-9e4e-83d1cdf8488d/volumes" Jul 13 18:20:41.805131 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:41.805102 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:20:41.807151 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:41.807130 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:20:58.100773 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.100740 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8"] Jul 13 18:20:58.101156 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.101100 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf413551-92b1-4dc5-9e4e-83d1cdf8488d" containerName="manager" Jul 13 18:20:58.101156 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.101111 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf413551-92b1-4dc5-9e4e-83d1cdf8488d" containerName="manager" Jul 13 18:20:58.101225 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.101181 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf413551-92b1-4dc5-9e4e-83d1cdf8488d" containerName="manager" Jul 13 18:20:58.104354 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.104335 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.107605 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.107582 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h9s5g\"" Jul 13 18:20:58.121746 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.121725 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8"] Jul 13 18:20:58.189844 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.189804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dced0659-528c-4fc8-84bb-b54c6412b7cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-59cs8\" (UID: \"dced0659-528c-4fc8-84bb-b54c6412b7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.190026 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.189927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzsps\" (UniqueName: \"kubernetes.io/projected/dced0659-528c-4fc8-84bb-b54c6412b7cd-kube-api-access-nzsps\") pod \"kuadrant-operator-controller-manager-86878c769f-59cs8\" (UID: \"dced0659-528c-4fc8-84bb-b54c6412b7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.291090 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.291041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzsps\" (UniqueName: \"kubernetes.io/projected/dced0659-528c-4fc8-84bb-b54c6412b7cd-kube-api-access-nzsps\") pod \"kuadrant-operator-controller-manager-86878c769f-59cs8\" (UID: \"dced0659-528c-4fc8-84bb-b54c6412b7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.291244 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.291116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dced0659-528c-4fc8-84bb-b54c6412b7cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-59cs8\" (UID: \"dced0659-528c-4fc8-84bb-b54c6412b7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.291548 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.291529 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dced0659-528c-4fc8-84bb-b54c6412b7cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-59cs8\" (UID: \"dced0659-528c-4fc8-84bb-b54c6412b7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.305689 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.305667 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzsps\" (UniqueName: \"kubernetes.io/projected/dced0659-528c-4fc8-84bb-b54c6412b7cd-kube-api-access-nzsps\") pod \"kuadrant-operator-controller-manager-86878c769f-59cs8\" (UID: \"dced0659-528c-4fc8-84bb-b54c6412b7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.414375 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.414295 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:58.547992 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:58.547966 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8"] Jul 13 18:20:58.549412 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:20:58.549384 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddced0659_528c_4fc8_84bb_b54c6412b7cd.slice/crio-2a96128def2f877b228934e0efddd5d3dd2d71f65042be4fbca2ac6f40369d42 WatchSource:0}: Error finding container 2a96128def2f877b228934e0efddd5d3dd2d71f65042be4fbca2ac6f40369d42: Status 404 returned error can't find the container with id 2a96128def2f877b228934e0efddd5d3dd2d71f65042be4fbca2ac6f40369d42 Jul 13 18:20:59.420376 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:59.420335 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" event={"ID":"dced0659-528c-4fc8-84bb-b54c6412b7cd","Type":"ContainerStarted","Data":"0066ee27ecd03a866b5aed12ede7162537d7b0795583667e72e4007095fbc613"} Jul 13 18:20:59.420850 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:59.420396 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" event={"ID":"dced0659-528c-4fc8-84bb-b54c6412b7cd","Type":"ContainerStarted","Data":"2a96128def2f877b228934e0efddd5d3dd2d71f65042be4fbca2ac6f40369d42"} Jul 13 18:20:59.420850 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:59.420472 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:20:59.447335 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:20:59.447269 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" podStartSLOduration=1.447254931 podStartE2EDuration="1.447254931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:20:59.443368317 +0000 UTC m=+1218.161996076" watchObservedRunningTime="2026-07-13 18:20:59.447254931 +0000 UTC m=+1218.165882687" Jul 13 18:21:10.427881 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:21:10.427852 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-59cs8" Jul 13 18:25:41.838122 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:25:41.838092 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:25:41.841436 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:25:41.841418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:26:54.587202 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:54.587169 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tz4mh_81cfe289-66b3-4546-adc8-2d2a06f8d147/manager/0.log" Jul 13 18:26:54.723403 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:54.723376 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mzd4s_682b5814-bb37-47ec-b70c-db4d81b72e5e/manager/0.log" Jul 13 18:26:55.002602 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:55.002577 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wms9v_bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044/server/0.log" Jul 13 18:26:55.124633 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:55.124578 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mftg7_822c63d6-feb7-4bd4-bc4f-df92bd915699/manager/0.log" Jul 13 18:26:55.244300 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:55.244246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c99bf77dc-mng9x_5c888484-90f7-476d-a33a-0de8d343fa41/manager/0.log" Jul 13 18:26:55.255243 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:55.255170 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c99bf77dc-mng9x_5c888484-90f7-476d-a33a-0de8d343fa41/copy-manifests/0.log" Jul 13 18:26:56.887209 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:56.887179 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl_daa0e9db-662e-4173-b202-1b9766dc9670/util/0.log" Jul 13 18:26:56.895408 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:56.895383 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl_daa0e9db-662e-4173-b202-1b9766dc9670/pull/0.log" Jul 13 18:26:56.903260 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:56.903239 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl_daa0e9db-662e-4173-b202-1b9766dc9670/extract/0.log" Jul 13 18:26:57.021943 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.021911 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx_308ff3f5-40fd-4d3b-af59-99395b34953e/util/0.log" Jul 13 18:26:57.029686 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.029663 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx_308ff3f5-40fd-4d3b-af59-99395b34953e/pull/0.log" Jul 13 18:26:57.036957 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.036934 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx_308ff3f5-40fd-4d3b-af59-99395b34953e/extract/0.log" Jul 13 18:26:57.152348 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.152246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr_7cce81f6-a558-4b88-9812-6a8ddccf0918/pull/0.log" Jul 13 18:26:57.158953 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.158928 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr_7cce81f6-a558-4b88-9812-6a8ddccf0918/extract/0.log" Jul 13 18:26:57.165757 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.165739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr_7cce81f6-a558-4b88-9812-6a8ddccf0918/util/0.log" Jul 13 18:26:57.275187 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.275154 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv_9829562d-6776-411c-b199-fe2e21465dc4/util/0.log" Jul 13 18:26:57.282449 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.282422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv_9829562d-6776-411c-b199-fe2e21465dc4/pull/0.log" Jul 13 18:26:57.289339 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.289322 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv_9829562d-6776-411c-b199-fe2e21465dc4/extract/0.log" Jul 13 18:26:57.530449 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.530366 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7569r_84492e5b-e2d2-46fd-9b90-51baf13b26b3/manager/0.log" Jul 13 18:26:57.649512 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.649452 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-86hpm_578945b5-5e09-4328-b24e-5db36c455353/manager/0.log" Jul 13 18:26:57.897930 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:57.897899 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tvns9_8afa58fc-670e-4b44-af2a-32139a923333/registry-server/0.log" Jul 13 18:26:58.028491 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:58.028463 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-59cs8_dced0659-528c-4fc8-84bb-b54c6412b7cd/manager/0.log" Jul 13 18:26:58.274564 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:58.274475 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8bjmh_034d29d7-ee18-4c03-8ec8-0523c08018db/manager/0.log" Jul 13 18:26:58.632961 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:58.632931 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf486pj5_d7ae35b7-e826-4415-bb78-d3cf29e41eaf/istio-proxy/0.log" Jul 13 18:26:58.973597 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:58.973515 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d57c78c9f-7rmp7_8125be9e-a8a3-42ae-aca5-68829503a4eb/kube-auth-proxy/0.log" Jul 13 18:26:59.104041 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:59.104012 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/1.log" Jul 13 18:26:59.226145 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:59.226060 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d65pj_44e0eddb-4a45-469f-8d8a-7c42f5643125/payload-pre-processing/0.log" Jul 13 18:26:59.348507 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:26:59.348478 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-5fnnb_ca2af1a9-b94a-4baf-87e7-f03d0970d026/payload-processing/0.log" Jul 13 18:27:00.043347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:00.043322 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-44x55_665b1958-dfbd-4ea2-a44e-7ff1f4ba1804/main/0.log" Jul 13 18:27:00.282708 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:00.282675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9stdm_e8d042ed-7566-45ee-9c00-7ad1b19ac893/main/0.log" Jul 13 18:27:00.408977 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:00.408935 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-6wxjp_a71328c2-2b32-4d0a-ace6-82c1d1dbf842/main/0.log" Jul 13 18:27:07.324842 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:07.324804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tszs5_31f73a1a-a36f-4a68-86c4-6b1439356b48/global-pull-secret-syncer/0.log" Jul 13 18:27:07.432501 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:07.432473 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l25h6_160e65f7-afd7-4d9f-a93a-2e675d0b932f/konnectivity-agent/0.log" Jul 13 18:27:07.453444 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:07.453415 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-48.ec2.internal_fc266b970294ca7e6b02e58f7dfbfaf7/haproxy/0.log" Jul 13 18:27:11.576306 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.576245 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl_daa0e9db-662e-4173-b202-1b9766dc9670/extract/0.log" Jul 13 18:27:11.616292 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.616247 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl_daa0e9db-662e-4173-b202-1b9766dc9670/util/0.log" Jul 13 18:27:11.636263 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.636236 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759c9lrl_daa0e9db-662e-4173-b202-1b9766dc9670/pull/0.log" Jul 13 18:27:11.665319 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.665271 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx_308ff3f5-40fd-4d3b-af59-99395b34953e/extract/0.log" Jul 13 18:27:11.683214 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.683189 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx_308ff3f5-40fd-4d3b-af59-99395b34953e/util/0.log" Jul 13 18:27:11.702378 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.702356 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mvdx_308ff3f5-40fd-4d3b-af59-99395b34953e/pull/0.log" Jul 13 18:27:11.727964 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.727944 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr_7cce81f6-a558-4b88-9812-6a8ddccf0918/extract/0.log" Jul 13 18:27:11.749344 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.749318 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr_7cce81f6-a558-4b88-9812-6a8ddccf0918/util/0.log" Jul 13 18:27:11.771062 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.771034 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pjgqr_7cce81f6-a558-4b88-9812-6a8ddccf0918/pull/0.log" Jul 13 18:27:11.794848 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.794809 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv_9829562d-6776-411c-b199-fe2e21465dc4/extract/0.log" Jul 13 18:27:11.813335 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.813309 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv_9829562d-6776-411c-b199-fe2e21465dc4/util/0.log" Jul 13 18:27:11.840095 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:11.840075 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dlwcv_9829562d-6776-411c-b199-fe2e21465dc4/pull/0.log" Jul 13 18:27:12.124203 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:12.124117 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7569r_84492e5b-e2d2-46fd-9b90-51baf13b26b3/manager/0.log" Jul 13 18:27:12.144485 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:12.144455 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-86hpm_578945b5-5e09-4328-b24e-5db36c455353/manager/0.log" Jul 13 18:27:12.218079 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:12.218049 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tvns9_8afa58fc-670e-4b44-af2a-32139a923333/registry-server/0.log" Jul 13 18:27:12.263480 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:12.263454 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-59cs8_dced0659-528c-4fc8-84bb-b54c6412b7cd/manager/0.log" Jul 13 18:27:12.349196 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:12.349159 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8bjmh_034d29d7-ee18-4c03-8ec8-0523c08018db/manager/0.log" Jul 13 18:27:14.653745 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:14.653716 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qhl8w_4729eb80-af14-4133-9701-ae48d314797f/node-exporter/0.log" Jul 13 18:27:14.673629 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:14.673607 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qhl8w_4729eb80-af14-4133-9701-ae48d314797f/kube-rbac-proxy/0.log" Jul 13 18:27:14.696969 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:14.696943 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qhl8w_4729eb80-af14-4133-9701-ae48d314797f/init-textfile/0.log" Jul 13 18:27:17.291605 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.291571 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2"] Jul 13 18:27:17.295108 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.295087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.298096 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.298076 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xw2tv\"/\"kube-root-ca.crt\"" Jul 13 18:27:17.298208 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.298112 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xw2tv\"/\"openshift-service-ca.crt\"" Jul 13 18:27:17.299345 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.299331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xw2tv\"/\"default-dockercfg-nss5n\"" Jul 13 18:27:17.307290 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.307253 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2"] Jul 13 18:27:17.360865 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.360832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hm5\" (UniqueName: \"kubernetes.io/projected/bf8e8174-0099-467b-88de-0e7238975fa7-kube-api-access-n2hm5\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.360865 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.360865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-proc\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.361113 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.360897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-podres\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.361113 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.360964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-lib-modules\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.361113 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.361060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-sys\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462224 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462191 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-sys\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462418 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hm5\" (UniqueName: \"kubernetes.io/projected/bf8e8174-0099-467b-88de-0e7238975fa7-kube-api-access-n2hm5\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462418 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-proc\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462418 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-podres\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462418 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462339 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-sys\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462418 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-lib-modules\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462413 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-proc\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-podres\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.462608 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.462521 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf8e8174-0099-467b-88de-0e7238975fa7-lib-modules\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.472120 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.472092 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hm5\" (UniqueName: \"kubernetes.io/projected/bf8e8174-0099-467b-88de-0e7238975fa7-kube-api-access-n2hm5\") pod \"perf-node-gather-daemonset-4tlb2\" (UID: \"bf8e8174-0099-467b-88de-0e7238975fa7\") " pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.605339 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.605309 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:17.739817 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:17.739786 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2"] Jul 13 18:27:17.741513 ip-10-0-128-48 kubenswrapper[2582]: W0713 18:27:17.741488 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbf8e8174_0099_467b_88de_0e7238975fa7.slice/crio-0f14dbf9d2744f9a1f2795330f61182dcd05e94c3d97ca0ba72b8455a864caa1 WatchSource:0}: Error finding container 0f14dbf9d2744f9a1f2795330f61182dcd05e94c3d97ca0ba72b8455a864caa1: Status 404 returned error can't find the container with id 0f14dbf9d2744f9a1f2795330f61182dcd05e94c3d97ca0ba72b8455a864caa1 Jul 13 18:27:18.365016 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:18.364984 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" event={"ID":"bf8e8174-0099-467b-88de-0e7238975fa7","Type":"ContainerStarted","Data":"db43700d829d4e68f503d0fd3582e54098ab9464be38c0533a842e930fca4e61"} Jul 13 18:27:18.365435 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:18.365039 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" event={"ID":"bf8e8174-0099-467b-88de-0e7238975fa7","Type":"ContainerStarted","Data":"0f14dbf9d2744f9a1f2795330f61182dcd05e94c3d97ca0ba72b8455a864caa1"} Jul 13 18:27:18.365435 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:18.365117 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:18.382160 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:18.382111 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" podStartSLOduration=1.382097705 podStartE2EDuration="1.382097705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:27:18.380563461 +0000 UTC m=+1597.099191221" watchObservedRunningTime="2026-07-13 18:27:18.382097705 +0000 UTC m=+1597.100725462" Jul 13 18:27:19.491675 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:19.491634 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vl6lr_136e43e7-081d-441e-9104-cca7cf0c930a/dns/0.log" Jul 13 18:27:19.512336 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:19.512312 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vl6lr_136e43e7-081d-441e-9104-cca7cf0c930a/kube-rbac-proxy/0.log" Jul 13 18:27:19.585945 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:19.585913 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zc5p7_a054bc5d-3d61-4b56-b677-6071a37cfa1d/dns-node-resolver/0.log" Jul 13 18:27:20.195221 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:20.195190 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nq9lq_2a39a6b8-e1c2-4dea-8f0e-9c98f58bc01f/node-ca/0.log" Jul 13 18:27:21.083350 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.083324 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf486pj5_d7ae35b7-e826-4415-bb78-d3cf29e41eaf/istio-proxy/0.log" Jul 13 18:27:21.178049 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.178024 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d57c78c9f-7rmp7_8125be9e-a8a3-42ae-aca5-68829503a4eb/kube-auth-proxy/0.log" Jul 13 18:27:21.204185 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.204156 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/0.log" Jul 13 18:27:21.250884 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.250852 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/1.log" Jul 13 18:27:21.280719 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.280661 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d65pj_44e0eddb-4a45-469f-8d8a-7c42f5643125/payload-pre-processing/0.log" Jul 13 18:27:21.309556 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.309524 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-5fnnb_ca2af1a9-b94a-4baf-87e7-f03d0970d026/payload-processing/0.log" Jul 13 18:27:21.895972 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:21.895937 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kz9nw_4ea6eb3e-58eb-4d19-a272-a0c2f0d86b7f/serve-healthcheck-canary/0.log" Jul 13 18:27:22.395467 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:22.395436 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2gk9_9da7ea96-6733-4798-980e-d1eac58b7360/kube-rbac-proxy/0.log" Jul 13 18:27:22.413985 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:22.413960 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2gk9_9da7ea96-6733-4798-980e-d1eac58b7360/exporter/0.log" Jul 13 18:27:22.433219 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:22.433188 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2gk9_9da7ea96-6733-4798-980e-d1eac58b7360/extractor/0.log" Jul 13 18:27:24.381252 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.381226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xw2tv/perf-node-gather-daemonset-4tlb2" Jul 13 18:27:24.593683 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.593631 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tz4mh_81cfe289-66b3-4546-adc8-2d2a06f8d147/manager/0.log" Jul 13 18:27:24.672692 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.672615 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mzd4s_682b5814-bb37-47ec-b70c-db4d81b72e5e/manager/0.log" Jul 13 18:27:24.739028 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.738999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wms9v_bf2fd0fd-c758-4f01-a9f4-f9a7d2ad2044/server/0.log" Jul 13 18:27:24.805580 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.805544 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mftg7_822c63d6-feb7-4bd4-bc4f-df92bd915699/manager/0.log" Jul 13 18:27:24.826854 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.826832 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c99bf77dc-mng9x_5c888484-90f7-476d-a33a-0de8d343fa41/manager/0.log" Jul 13 18:27:24.845772 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:24.845755 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c99bf77dc-mng9x_5c888484-90f7-476d-a33a-0de8d343fa41/copy-manifests/0.log" Jul 13 18:27:26.274868 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:26.274835 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ppg8m_e53f1061-bc2a-4f97-ab49-974014367280/openshift-lws-operator/0.log" Jul 13 18:27:27.575424 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:27.575335 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf486pj5_d7ae35b7-e826-4415-bb78-d3cf29e41eaf/istio-proxy/0.log" Jul 13 18:27:27.641296 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:27.641250 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d57c78c9f-7rmp7_8125be9e-a8a3-42ae-aca5-68829503a4eb/kube-auth-proxy/0.log" Jul 13 18:27:27.662382 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:27.662326 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/0.log" Jul 13 18:27:27.707181 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:27.707142 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/1.log" Jul 13 18:27:27.730671 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:27.730635 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d65pj_44e0eddb-4a45-469f-8d8a-7c42f5643125/payload-pre-processing/0.log" Jul 13 18:27:27.749726 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:27.749697 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-5fnnb_ca2af1a9-b94a-4baf-87e7-f03d0970d026/payload-processing/0.log" Jul 13 18:27:28.858358 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:28.858332 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf486pj5_d7ae35b7-e826-4415-bb78-d3cf29e41eaf/istio-proxy/0.log" Jul 13 18:27:28.933377 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:28.933353 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d57c78c9f-7rmp7_8125be9e-a8a3-42ae-aca5-68829503a4eb/kube-auth-proxy/0.log" Jul 13 18:27:28.958192 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:28.958166 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/0.log" Jul 13 18:27:29.002724 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:29.002691 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cwnhb_7b10b8a4-b228-4b71-94c2-f74de0d6f63c/istio-proxy/1.log" Jul 13 18:27:29.026209 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:29.026180 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-d65pj_44e0eddb-4a45-469f-8d8a-7c42f5643125/payload-pre-processing/0.log" Jul 13 18:27:29.048884 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:29.048801 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-5fnnb_ca2af1a9-b94a-4baf-87e7-f03d0970d026/payload-processing/0.log" Jul 13 18:27:32.771829 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.771756 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/kube-multus-additional-cni-plugins/0.log" Jul 13 18:27:32.792120 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.792091 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/egress-router-binary-copy/0.log" Jul 13 18:27:32.810347 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.810319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/cni-plugins/0.log" Jul 13 18:27:32.827519 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.827489 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/bond-cni-plugin/0.log" Jul 13 18:27:32.844544 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.844511 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/routeoverride-cni/0.log" Jul 13 18:27:32.864635 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.864607 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/whereabouts-cni-bincopy/0.log" Jul 13 18:27:32.881677 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:32.881651 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vx5kv_d9f91909-4f5c-4198-aa34-c9da21d0da64/whereabouts-cni/0.log" Jul 13 18:27:33.079843 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:33.079749 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g5nsv_6c9d46b2-989f-48f1-9c78-03141820208f/kube-multus/0.log" Jul 13 18:27:33.162809 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:33.162775 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n29xm_2a12cdcb-1a6e-4e82-b1ae-ccf704382194/network-metrics-daemon/0.log" Jul 13 18:27:33.179206 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:33.179176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n29xm_2a12cdcb-1a6e-4e82-b1ae-ccf704382194/kube-rbac-proxy/0.log" Jul 13 18:27:34.707340 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:34.707309 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-controller/0.log" Jul 13 18:27:34.742420 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:34.742219 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/0.log" Jul 13 18:27:34.742731 ip-10-0-128-48 kubenswrapper[2582]: I0713 18:27:34.742709 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x6t7r_6a18c05a-4e8e-4527-8fab-4ca60906efe5/ovn-acl-logging/1.log"