Jul 17 18:13:50.228724 ip-10-0-136-174 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 18:13:50.228739 ip-10-0-136-174 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 18:13:50.228751 ip-10-0-136-174 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 18:13:50.229097 ip-10-0-136-174 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 18:14:00.403015 ip-10-0-136-174 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 17 18:14:00.403030 ip-10-0-136-174 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9c9c97ecad394831be44bf42aa71d083 -- Jul 17 18:15:55.842562 ip-10-0-136-174 systemd[1]: Starting Kubernetes Kubelet... Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.368427 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374755 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374769 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374772 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374775 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374780 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374783 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374786 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:15:56.407618 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374789 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374792 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374795 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374798 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374804 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374807 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374811 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374813 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374816 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374820 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374823 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374825 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374828 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374831 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374833 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374836 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374840 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374842 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374845 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374848 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:15:56.408842 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374850 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374853 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374855 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374858 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374860 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374863 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374866 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374869 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374871 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374875 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374880 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374883 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374886 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374889 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374891 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374894 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374897 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374899 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374902 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374904 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:15:56.410490 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374907 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374909 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374912 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374915 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374917 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374919 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374922 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374925 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374927 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374930 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374932 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374936 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374939 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374941 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374944 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374947 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374949 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374952 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374954 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374957 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:15:56.411312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374959 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374962 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374966 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374970 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374973 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374976 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374979 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374982 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374985 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374988 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374993 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374996 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.374999 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375001 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375004 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375007 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375010 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375013 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375015 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:15:56.412945 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375019 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375023 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375027 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375030 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375035 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375038 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375041 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375044 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375047 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375050 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375052 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375055 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.375057 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376585 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376595 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376598 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376602 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376605 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376608 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:15:56.413755 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376610 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376613 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376616 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376619 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376622 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376625 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376628 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376631 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376634 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376636 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376639 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376641 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376645 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376648 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376651 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376653 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376656 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376659 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376661 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:15:56.415414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376664 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376666 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376669 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376672 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376674 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376677 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376679 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376682 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376685 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376687 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376690 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376692 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376695 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376697 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376700 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376702 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376705 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376709 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376711 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376714 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:15:56.416214 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376717 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376719 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376722 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376724 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376727 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376730 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376732 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376735 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376737 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376740 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376742 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376745 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376747 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376750 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376752 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376755 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376758 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376760 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376762 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376765 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:15:56.418686 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376767 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376770 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376774 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376777 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376780 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376783 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376786 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376788 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376791 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376793 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376796 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376799 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376802 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376804 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376807 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376810 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376812 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376816 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376819 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:15:56.419510 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376822 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376825 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376828 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376831 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376833 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376836 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376839 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376842 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376846 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376851 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376854 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376856 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376859 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376861 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.376864 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377258 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377265 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377269 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377273 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377276 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:15:56.420327 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377279 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377282 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377285 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377659 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377663 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377667 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377670 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377673 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377676 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377678 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377681 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377684 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377687 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377689 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377692 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377694 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377697 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377700 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377702 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377705 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:15:56.421128 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377707 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377710 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377712 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377715 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377717 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377722 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377726 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377729 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377732 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377734 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377737 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377739 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377742 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377744 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377747 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377750 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377754 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377757 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377759 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:15:56.422768 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377762 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377765 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377767 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377771 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377774 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377776 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377779 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377781 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377783 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377786 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377789 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377791 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377793 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377796 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377798 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377801 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377803 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377806 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377810 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377813 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:15:56.423585 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377816 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377819 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377822 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377826 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377829 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377831 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377834 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377836 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377840 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377843 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377846 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377848 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377850 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377853 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377855 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377858 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377860 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377863 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377865 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:15:56.425226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377868 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377870 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377873 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377875 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377878 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377880 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377883 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377885 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377887 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377890 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377892 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377898 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377902 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377905 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377907 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.377909 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.377978 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.377991 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.377999 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378006 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378012 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 18:15:56.426011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378016 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378023 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378027 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378031 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378034 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378037 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378041 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378044 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378046 2569 flags.go:64] FLAG: --cgroup-root="" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378049 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378052 2569 flags.go:64] FLAG: --client-ca-file="" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378055 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378058 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378061 2569 flags.go:64] FLAG: --cluster-domain="" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378064 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378067 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378070 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378074 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378077 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378080 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378084 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378087 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378091 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378098 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 18:15:56.427622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378101 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378104 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378106 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378111 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378114 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378116 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378119 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378122 2569 flags.go:64] FLAG: --enable-server="true" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378125 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378129 2569 flags.go:64] FLAG: --event-burst="100" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378132 2569 flags.go:64] FLAG: --event-qps="50" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378135 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378183 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378229 2569 flags.go:64] FLAG: --eviction-hard="" Jul 17 18:15:56.428431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.378236 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 18:15:56.663411 ip-10-0-136-174 systemd[1]: Started Kubernetes Kubelet. Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597405 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597454 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597476 2569 flags.go:64] FLAG: --eviction-soft="" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597652 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597657 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597661 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597665 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597669 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597673 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597677 2569 flags.go:64] FLAG: --feature-gates="" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597696 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597700 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597704 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597708 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597712 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597717 2569 flags.go:64] FLAG: --help="false" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597721 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-136-174.ec2.internal" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597725 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597729 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597732 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597736 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597740 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597743 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 18:15:56.671278 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597747 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597750 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597753 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597757 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597760 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597763 2569 flags.go:64] FLAG: --kube-reserved="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597767 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597772 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597776 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597780 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597783 2569 flags.go:64] FLAG: --lock-file="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597786 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597790 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597794 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597801 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597804 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597808 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597811 2569 flags.go:64] FLAG: --logging-format="text" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597814 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597818 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597821 2569 flags.go:64] FLAG: --manifest-url="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597824 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597831 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597835 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597841 2569 flags.go:64] FLAG: --max-pods="110" Jul 17 18:15:56.672604 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597844 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597847 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597851 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597854 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597858 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597861 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597865 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597876 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597880 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597883 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597886 2569 flags.go:64] FLAG: --pod-cidr="" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597889 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597897 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597900 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597903 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597908 2569 flags.go:64] FLAG: --port="10250" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597912 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597915 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066db5d386fb253ec" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597918 2569 flags.go:64] FLAG: --qos-reserved="" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597922 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597925 2569 flags.go:64] FLAG: --register-node="true" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597928 2569 flags.go:64] FLAG: --register-with-taints="" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597954 2569 flags.go:64] FLAG: --registry-burst="10" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597959 2569 flags.go:64] FLAG: --registry-qps="5" Jul 17 18:15:56.673481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597962 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597965 2569 flags.go:64] FLAG: --reserved-memory="" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597970 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597973 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597977 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597980 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597983 2569 flags.go:64] FLAG: --runonce="false" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597986 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597990 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597994 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.597997 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598000 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598004 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598007 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598011 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598015 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598018 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598021 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598024 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598028 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598031 2569 flags.go:64] FLAG: --system-cgroups="" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598034 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598042 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598045 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598049 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 18:15:56.679292 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598055 2569 flags.go:64] FLAG: --tls-min-version="" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598058 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598062 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598065 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598068 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598071 2569 flags.go:64] FLAG: --v="2" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598076 2569 flags.go:64] FLAG: --version="false" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598080 2569 flags.go:64] FLAG: --vmodule="" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598088 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.598092 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598246 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598250 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598254 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598258 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598262 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598265 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598268 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598270 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598275 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598278 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598281 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598284 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:15:56.681557 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598287 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598304 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598307 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598310 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598313 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598316 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598318 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598322 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598327 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598333 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598338 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598342 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598346 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598349 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598352 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598355 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598358 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598362 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598365 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:15:56.684255 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598368 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598371 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598374 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598377 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598380 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598383 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598386 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598388 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598391 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598395 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598398 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598401 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598404 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598407 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598409 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598412 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598415 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598417 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598420 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598423 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:15:56.685925 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598426 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598429 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598431 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598434 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598437 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598440 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598442 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598445 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598448 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598451 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598454 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598457 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598459 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598464 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598467 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598471 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598474 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598477 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598479 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598482 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:15:56.701891 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598485 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598489 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598492 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598495 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598498 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598502 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598505 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598508 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598512 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598516 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598519 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598522 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598526 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598529 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598532 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598535 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598541 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598544 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598547 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598550 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:15:56.702731 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598553 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598556 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598558 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598561 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598564 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598567 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598569 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.598572 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.599285 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.606943 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.606965 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.607773 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.607783 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607854 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607860 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:15:56.704967 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607863 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607867 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607870 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607873 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607876 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607879 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607882 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607885 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607888 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607891 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607894 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607897 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607900 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607904 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607909 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607912 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607915 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607918 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607921 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607924 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:15:56.705878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607927 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607931 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607934 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607937 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607940 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607943 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607946 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607950 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607953 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607956 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607959 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607962 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607965 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607968 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607970 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607973 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607976 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607979 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607982 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607985 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:15:56.708087 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607988 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607990 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607993 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607996 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.607999 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608002 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608004 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608009 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608013 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608016 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608020 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608026 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608029 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608033 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608036 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608039 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608042 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608045 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608047 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:15:56.708978 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608051 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608054 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608057 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608060 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608063 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608066 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608068 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608071 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608074 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608077 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608081 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608085 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608088 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608091 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608094 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608098 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608101 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608104 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608107 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608110 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:15:56.712143 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608114 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608116 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608119 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608122 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608126 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608129 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608132 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608135 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608138 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608140 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608143 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608146 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608149 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608152 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608158 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608161 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608164 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:15:56.713016 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608167 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.608173 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608332 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608339 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608344 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608348 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608351 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608355 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608358 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608362 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608365 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608368 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608371 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608374 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:15:56.716213 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608377 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608380 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608383 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608386 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608388 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608393 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608396 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608399 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608401 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608404 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608407 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608410 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608412 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608415 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608418 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608420 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608424 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608429 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608432 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608434 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608437 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:15:56.717113 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608440 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608443 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608447 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608450 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608453 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608456 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608459 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608462 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608464 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608467 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608470 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608473 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608475 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608478 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608480 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608483 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608487 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608490 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608492 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:15:56.721209 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608495 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608498 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608500 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608503 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608506 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608508 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608511 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608514 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608516 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608521 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608524 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608527 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608529 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608532 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608535 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608538 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608541 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608543 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608546 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608549 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:15:56.722120 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608552 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608554 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608557 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608560 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608563 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608565 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608568 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608571 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608573 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608578 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608581 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608583 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608586 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608589 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608592 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608594 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608597 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608599 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608602 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608605 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:15:56.826965 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608608 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608612 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608616 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608618 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608621 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608624 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:56.608627 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.608632 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.608788 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.611428 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.612924 2569 server.go:1019] "Starting client certificate rotation" Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.613032 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.613071 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 18:15:56.828150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.615266 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 18:15:56.831050 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.616546 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 18:15:56.831050 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.627212 2569 log.go:25] "Validated CRI v1 runtime API" Jul 17 18:15:56.831050 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.629857 2569 log.go:25] "Validated CRI v1 image API" Jul 17 18:15:56.831050 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.631234 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 18:15:56.831050 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.635413 2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9bcc3c7e-46f8-4337-95a0-24e5c1c0345f:/dev/nvme0n1p3 b2ddb3b3-f544-4a35-9308-af144a554e60:/dev/nvme0n1p4] Jul 17 18:15:56.831050 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.635443 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.639890 2569 manager.go:216] Machine: {Timestamp:2026-07-17 18:15:56.639375746 +0000 UTC m=+0.683775985 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096411 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec231417ae225dedef097404cd1bc4f3 SystemUUID:ec231417-ae22-5ded-ef09-7404cd1bc4f3 BootID:9c9c97ec-ad39-4831-be44-bf42aa71d083 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:97:4c:ee:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:97:4c:ee:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:fe:55:3c:fd:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.639991 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.640076 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.643638 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.643672 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.644529 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.644542 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.644551 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.645213 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.646914 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650198 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650609 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650765 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650804 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650818 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650837 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 18:15:56.833340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650849 2569 kubelet.go:398] "Adding apiserver pod source" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.650860 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.651359 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.651378 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.653601 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.656421 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.656464 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657772 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657792 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657802 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657811 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657825 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657835 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657849 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657858 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657871 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657880 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657893 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657903 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657937 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.657945 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.662361 2569 server.go:1268] "Started kubelet" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.662848 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.662827 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.663255 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.664307 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.664330 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.664814 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.665949 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.666318 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.669511 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.675043 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.675063 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.675620 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.675833 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676078 2569 factory.go:55] Registering systemd factory Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676093 2569 factory.go:223] Registration of the systemd container factory successfully Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676171 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676181 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676320 2569 factory.go:153] Registering CRI-O factory Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676333 2569 factory.go:223] Registration of the crio container factory successfully Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676320 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676373 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676386 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676410 2569 factory.go:103] Registering Raw factory Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676424 2569 manager.go:1196] Started watching for new ooms in manager Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.676851 2569 manager.go:349] Starting recovery of all containers Jul 17 18:15:56.834707 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.677655 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.677711 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18c32673ea449a4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-07-17 18:15:56.662307406 +0000 UTC m=+0.706707646,LastTimestamp:2026-07-17 18:15:56.662307406 +0000 UTC m=+0.706707646,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.678903 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.688175 2569 manager.go:354] Recovery completed Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.694041 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.696342 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.696376 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.696390 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.697019 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.697032 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.697053 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.697072 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.697963 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.697992 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.698010 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.698452 2569 policy_none.go:49] "None policy: Start" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.698469 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.698482 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.699053 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18c32673ec4c3837 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-07-17 18:15:56.696361015 +0000 UTC m=+0.740761257,LastTimestamp:2026-07-17 18:15:56.696361015 +0000 UTC m=+0.740761257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.699570 2569 policy_none.go:47] "Start" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.711361 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-btkw7" Jul 17 18:15:56.838141 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.713020 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18c32673ec4c88a4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-174.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-07-17 18:15:56.696381604 +0000 UTC m=+0.740781846,LastTimestamp:2026-07-17 18:15:56.696381604 +0000 UTC m=+0.740781846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jul 17 18:15:56.839022 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.726863 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18c32673ec4cbc4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-174.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-07-17 18:15:56.69639483 +0000 UTC m=+0.740795070,LastTimestamp:2026-07-17 18:15:56.69639483 +0000 UTC m=+0.740795070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}" Jul 17 18:15:56.839022 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.727460 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-btkw7" Jul 17 18:15:56.839022 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.776157 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.853397 2569 manager.go:337] "Starting Device Plugin manager" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.853669 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.853687 2569 server.go:87] "Starting device plugin registration server" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.854004 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.854018 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.854194 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.854330 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.854347 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.855170 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.855236 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.884418 2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.955672 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.956778 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.956804 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.956817 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.956851 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-174.ec2.internal" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:56.963639 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-174.ec2.internal" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.963665 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-174.ec2.internal\": node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:56.993098 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:56.976083 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.128216 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.081848 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.246422 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.182801 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.283726 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.283700 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.323760 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.323711 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 18:15:57.325122 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.325098 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 18:15:57.325307 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.325136 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 18:15:57.325307 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.325160 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 18:15:57.325307 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.325203 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 18:15:57.327900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.327878 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:15:57.384904 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.384807 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.426314 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.426266 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"] Jul 17 18:15:57.426801 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.426365 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:57.428276 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.428243 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:57.428366 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.428294 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:57.428366 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.428310 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:57.429618 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.429604 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:57.429746 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.429730 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.429792 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.429765 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:57.430441 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.430418 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:57.430441 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.430447 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:57.430592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.430457 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:57.430592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.430419 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:57.430592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.430524 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:57.430592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.430536 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:57.431872 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.431852 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.431968 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.431891 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:15:57.432651 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.432637 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:15:57.432730 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.432668 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:15:57.432730 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.432686 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:15:57.459180 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.459152 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.464194 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.464176 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.485377 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.485354 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.522542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.522507 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6230e03fa0ffb4d76dbad775c022c2a4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"6230e03fa0ffb4d76dbad775c022c2a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.522542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.522545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/931753cc28e27af3eaf291bdb6fa3367-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"931753cc28e27af3eaf291bdb6fa3367\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.522778 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.522578 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/931753cc28e27af3eaf291bdb6fa3367-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"931753cc28e27af3eaf291bdb6fa3367\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.586379 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:57.586341 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found" Jul 17 18:15:57.613576 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.613536 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 18:15:57.613772 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.613748 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 18:15:57.623619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.623584 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/931753cc28e27af3eaf291bdb6fa3367-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"931753cc28e27af3eaf291bdb6fa3367\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.623619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.623624 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/931753cc28e27af3eaf291bdb6fa3367-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"931753cc28e27af3eaf291bdb6fa3367\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.623717 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.623644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6230e03fa0ffb4d76dbad775c022c2a4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"6230e03fa0ffb4d76dbad775c022c2a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.623717 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.623699 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/931753cc28e27af3eaf291bdb6fa3367-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"931753cc28e27af3eaf291bdb6fa3367\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.623717 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.623705 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/931753cc28e27af3eaf291bdb6fa3367-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"931753cc28e27af3eaf291bdb6fa3367\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.623824 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.623765 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6230e03fa0ffb4d76dbad775c022c2a4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"6230e03fa0ffb4d76dbad775c022c2a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.677702 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.677614 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:15:57.732698 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.732632 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 18:10:57 +0000 UTC" deadline="2028-03-15 22:46:49.141963094 +0000 UTC" Jul 17 18:15:57.732698 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.732687 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14572h30m51.409281005s" Jul 17 18:15:57.764255 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.764225 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.768862 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.768794 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.776400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.776382 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.787714 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.787690 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 18:15:57.789606 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.789590 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" Jul 17 18:15:57.803183 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.803159 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 18:15:57.890642 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:57.890612 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:15:58.062358 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.062332 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:15:58.468665 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:58.468631 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6230e03fa0ffb4d76dbad775c022c2a4.slice/crio-2bb2b610d565e4fb907ec030605921d897d8ce42b036bbed2ecd787769818a3f WatchSource:0}: Error finding container 2bb2b610d565e4fb907ec030605921d897d8ce42b036bbed2ecd787769818a3f: Status 404 returned error can't find the container with id 2bb2b610d565e4fb907ec030605921d897d8ce42b036bbed2ecd787769818a3f Jul 17 18:15:58.476563 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.476546 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:15:58.623330 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.623237 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:15:58.632819 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:58.632793 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931753cc28e27af3eaf291bdb6fa3367.slice/crio-4378eb49ade2ad2ea7a200422693f2371fbc0efa32ef2ad14c34902018452763 WatchSource:0}: Error finding container 4378eb49ade2ad2ea7a200422693f2371fbc0efa32ef2ad14c34902018452763: Status 404 returned error can't find the container with id 4378eb49ade2ad2ea7a200422693f2371fbc0efa32ef2ad14c34902018452763 Jul 17 18:15:58.653524 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.653496 2569 apiserver.go:52] "Watching apiserver" Jul 17 18:15:58.659021 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.658999 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 18:15:58.659429 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.659404 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-5tkdk","openshift-image-registry/node-ca-5bn7l","openshift-multus/multus-zc69m","openshift-network-diagnostics/network-check-target-tnlqv","openshift-network-operator/iptables-alerter-pvbvt","kube-system/konnectivity-agent-m52p7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98","openshift-dns/node-resolver-sh4fx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal","openshift-multus/multus-additional-cni-plugins-g5v8w","openshift-multus/network-metrics-daemon-kbhxf","openshift-ovn-kubernetes/ovnkube-node-6xkb4","kube-system/global-pull-secret-syncer-gfpz4","kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"] Jul 17 18:15:58.661309 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.661290 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.663346 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.663322 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:58.663441 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.663389 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:15:58.664506 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.664282 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 18:15:58.664656 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.664634 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 18:15:58.664841 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.664820 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.665067 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.665044 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.665138 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.665110 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.665309 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.665288 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 18:15:58.665801 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.665702 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rxtfq\"" Jul 17 18:15:58.667097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.667064 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:15:58.667209 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.667145 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:15:58.668512 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.668492 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.669738 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.669710 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.671020 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.671002 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.672435 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.672417 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.672828 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.672810 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 18:15:58.672989 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.672975 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wrgnx\"" Jul 17 18:15:58.673820 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.673800 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.674504 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.674488 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 18:15:58.674588 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.674554 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l4vg4\"" Jul 17 18:15:58.675042 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.675022 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 18:15:58.675105 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.675095 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.675316 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.675177 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.675316 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.675311 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 18:15:58.675568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.675552 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.676873 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.676573 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.676873 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.676665 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 18:15:58.676873 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.676673 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mf2q9\"" Jul 17 18:15:58.677082 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677070 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.677399 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677376 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.677484 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677397 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 18:15:58.677543 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677483 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 18:15:58.677543 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677497 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.677543 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677536 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.677808 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.677792 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.678187 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.678169 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8fkcn\"" Jul 17 18:15:58.678254 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.678189 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7xpz9\"" Jul 17 18:15:58.678332 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.678272 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kmzd6\"" Jul 17 18:15:58.678332 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.678277 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.678435 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.678295 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.678435 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.678386 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:15:58.678529 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.678516 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 18:15:58.679606 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.679575 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 18:15:58.680926 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.680900 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 18:15:58.681046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.680929 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.681046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.680939 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6vb9z\"" Jul 17 18:15:58.681046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.680957 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.681046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.680934 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 18:15:58.681046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.680996 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 18:15:58.682232 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.682216 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:15:58.682232 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.682227 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-42q8q\"" Jul 17 18:15:58.694004 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.693986 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 18:15:58.716694 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.716674 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vp6wc" Jul 17 18:15:58.731815 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.731793 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vp6wc" Jul 17 18:15:58.732948 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.732924 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-systemd\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.732955 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-node-log\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.732976 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovnkube-script-lib\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733000 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-os-release\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733023 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-k8s-cni-cncf-io\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-etc-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733062 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3025e01-c1d0-4da7-9da5-e8a26336a692-host\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.733178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733078 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-sys\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8nh\" (UniqueName: \"kubernetes.io/projected/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-kube-api-access-pr8nh\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733142 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-var-lib-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733159 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-kubelet\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7-agent-certs\") pod \"konnectivity-agent-m52p7\" (UID: \"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7\") " pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733205 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-tuned\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-registration-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733281 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2psv\" (UniqueName: \"kubernetes.io/projected/da191395-900e-4ce5-86ca-c2a7523f5367-kube-api-access-t2psv\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-run-netns\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qps4l\" (UniqueName: \"kubernetes.io/projected/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-kube-api-access-qps4l\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-cni-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733366 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-cni-bin\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733390 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7-konnectivity-ca\") pod \"konnectivity-agent-m52p7\" (UID: \"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7\") " pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.733424 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733406 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysconfig\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733425 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733452 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b57302f6-33c3-40df-9365-7d569c3a44fe-host-slash\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733469 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-run\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733485 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-host\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733501 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-systemd-units\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733594 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-system-cni-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ae768cf-f332-4a87-a9cf-921f9e79968d-cni-binary-copy\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-daemon-config\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-etc-selinux\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733720 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-kubelet\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733747 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-cni-netd\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovn-node-metrics-cert\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733804 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysctl-d\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733832 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-sys-fs\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.733900 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733870 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-log-socket\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3025e01-c1d0-4da7-9da5-e8a26336a692-serviceca\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733964 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-os-release\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.733991 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-hostroot\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734020 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvdjv\" (UniqueName: \"kubernetes.io/projected/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-kube-api-access-qvdjv\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-system-cni-dir\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-cnibin\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734102 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-conf-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734124 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s87wj\" (UniqueName: \"kubernetes.io/projected/0ae768cf-f332-4a87-a9cf-921f9e79968d-kube-api-access-s87wj\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734143 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734161 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-slash\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734176 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-ovn\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734192 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-var-lib-kubelet\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-tmp\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734229 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-env-overrides\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.734568 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tzvr\" (UniqueName: \"kubernetes.io/projected/b57302f6-33c3-40df-9365-7d569c3a44fe-kube-api-access-4tzvr\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-modprobe-d\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734303 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-systemd\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734319 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfmn6\" (UniqueName: \"kubernetes.io/projected/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-kube-api-access-cfmn6\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734350 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734373 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-socket-dir-parent\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734396 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-etc-kubernetes\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734417 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734433 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-hosts-file\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734459 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cnibin\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734492 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b57302f6-33c3-40df-9365-7d569c3a44fe-iptables-alerter-script\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734506 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-socket-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734527 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734570 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovnkube-config\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.735097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734585 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-kubernetes\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysctl-conf\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734649 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-tmp-dir\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734676 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-cni-bin\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-cni-multus\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734730 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-multus-certs\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734745 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmrl\" (UniqueName: \"kubernetes.io/projected/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-kube-api-access-8qmrl\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734761 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvdqx\" (UniqueName: \"kubernetes.io/projected/d3025e01-c1d0-4da7-9da5-e8a26336a692-kube-api-access-hvdqx\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734776 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-netns\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734792 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-lib-modules\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.735647 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.734808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-device-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.776765 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.776729 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 18:15:58.835767 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-hostroot\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.835767 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835771 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvdjv\" (UniqueName: \"kubernetes.io/projected/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-kube-api-access-qvdjv\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835798 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-system-cni-dir\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835824 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-cnibin\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835849 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-conf-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835874 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s87wj\" (UniqueName: \"kubernetes.io/projected/0ae768cf-f332-4a87-a9cf-921f9e79968d-kube-api-access-s87wj\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835883 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-system-cni-dir\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835899 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-hostroot\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835930 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-conf-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835925 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-slash\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835958 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-cnibin\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835964 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-slash\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-ovn\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.835996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.836015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-var-lib-kubelet\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-tmp\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836061 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-ovn\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-env-overrides\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836094 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tzvr\" (UniqueName: \"kubernetes.io/projected/b57302f6-33c3-40df-9365-7d569c3a44fe-kube-api-access-4tzvr\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-var-lib-kubelet\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-modprobe-d\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-systemd\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836303 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfmn6\" (UniqueName: \"kubernetes.io/projected/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-kube-api-access-cfmn6\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836335 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836340 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-systemd\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-socket-dir-parent\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836392 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-etc-kubernetes\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836408 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-modprobe-d\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836419 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836441 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836521 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-socket-dir-parent\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836644 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-env-overrides\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.836683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-etc-kubernetes\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836697 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-hosts-file\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836740 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cnibin\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836765 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-hosts-file\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836771 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836821 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cnibin\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.836785 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836840 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b57302f6-33c3-40df-9365-7d569c3a44fe-iptables-alerter-script\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836862 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-socket-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836904 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836909 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.836927 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:15:59.336911376 +0000 UTC m=+3.381311601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836941 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836959 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.836988 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovnkube-config\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-kubernetes\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837028 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysctl-conf\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.837632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-tmp-dir\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837110 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837104 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837152 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-cni-bin\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837170 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysctl-conf\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837180 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-cni-multus\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837006 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-socket-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-multus-certs\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837226 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-kubernetes\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837269 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837249 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-cni-bin\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmrl\" (UniqueName: \"kubernetes.io/projected/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-kube-api-access-8qmrl\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvdqx\" (UniqueName: \"kubernetes.io/projected/d3025e01-c1d0-4da7-9da5-e8a26336a692-kube-api-access-hvdqx\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837337 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-cni-multus\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-netns\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-lib-modules\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837397 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-device-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.838476 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837427 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837457 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-systemd\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837472 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-tmp-dir\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837483 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-node-log\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837491 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovnkube-config\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837485 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-multus-certs\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837483 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b57302f6-33c3-40df-9365-7d569c3a44fe-iptables-alerter-script\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837549 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-device-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837560 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-run-systemd\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837583 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-node-log\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovnkube-script-lib\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837611 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-lib-modules\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837624 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-os-release\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837623 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-netns\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837643 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-k8s-cni-cncf-io\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837682 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-run-k8s-cni-cncf-io\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-etc-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837735 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3025e01-c1d0-4da7-9da5-e8a26336a692-host\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.839412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-sys\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837736 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-os-release\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837792 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-etc-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837804 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3025e01-c1d0-4da7-9da5-e8a26336a692-host\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837800 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-sys\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837818 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8nh\" (UniqueName: \"kubernetes.io/projected/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-kube-api-access-pr8nh\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837860 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-var-lib-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837890 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-kubelet\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837904 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-var-lib-openvswitch\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837918 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7-agent-certs\") pod \"konnectivity-agent-m52p7\" (UID: \"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7\") " pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837925 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-kubelet\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837947 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-tuned\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.837975 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-registration-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838005 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2psv\" (UniqueName: \"kubernetes.io/projected/da191395-900e-4ce5-86ca-c2a7523f5367-kube-api-access-t2psv\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838033 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-run-netns\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838047 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-registration-dir\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qps4l\" (UniqueName: \"kubernetes.io/projected/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-kube-api-access-qps4l\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.840152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838089 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-cni-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838097 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-run-netns\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838092 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovnkube-script-lib\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-cni-bin\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838168 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7-konnectivity-ca\") pod \"konnectivity-agent-m52p7\" (UID: \"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7\") " pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838194 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysconfig\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838227 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-cni-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838254 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d259984a-d57a-40d6-98ad-5693f379467e-kubelet-config\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838309 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-host-var-lib-cni-bin\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838327 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b57302f6-33c3-40df-9365-7d569c3a44fe-host-slash\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838320 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysconfig\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838352 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-run\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838377 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-host\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838408 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d259984a-d57a-40d6-98ad-5693f379467e-dbus\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838412 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b57302f6-33c3-40df-9365-7d569c3a44fe-host-slash\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838424 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-run\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838434 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-systemd-units\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.840945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838455 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-host\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838475 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-systemd-units\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838497 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838526 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-system-cni-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ae768cf-f332-4a87-a9cf-921f9e79968d-cni-binary-copy\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838573 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-daemon-config\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838601 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-etc-selinux\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838627 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-kubelet\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-cni-netd\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838679 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovn-node-metrics-cert\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838705 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysctl-d\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-sys-fs\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-log-socket\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838777 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838802 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3025e01-c1d0-4da7-9da5-e8a26336a692-serviceca\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-os-release\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838859 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.841515 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838892 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7-konnectivity-ca\") pod \"konnectivity-agent-m52p7\" (UID: \"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7\") " pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838927 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae768cf-f332-4a87-a9cf-921f9e79968d-system-cni-dir\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.838941 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-os-release\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839000 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-sys-fs\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839015 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839048 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-log-socket\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839048 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-sysctl-d\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839091 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-kubelet\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839107 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da191395-900e-4ce5-86ca-c2a7523f5367-etc-selinux\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839108 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839230 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-host-cni-netd\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839630 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d3025e01-c1d0-4da7-9da5-e8a26336a692-serviceca\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ae768cf-f332-4a87-a9cf-921f9e79968d-multus-daemon-config\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.839762 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ae768cf-f332-4a87-a9cf-921f9e79968d-cni-binary-copy\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.840223 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-tmp\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.840848 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7-agent-certs\") pod \"konnectivity-agent-m52p7\" (UID: \"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7\") " pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.840934 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-etc-tuned\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.842007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.841330 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-ovn-node-metrics-cert\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.850121 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.850100 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:15:58.850121 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.850122 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:15:58.850304 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.850135 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:15:58.850304 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.850198 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:15:59.350179904 +0000 UTC m=+3.394580150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:15:58.852148 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.852127 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvdjv\" (UniqueName: \"kubernetes.io/projected/e135cff5-a3d7-4d6d-9f50-d07ee46dc149-kube-api-access-qvdjv\") pod \"node-resolver-sh4fx\" (UID: \"e135cff5-a3d7-4d6d-9f50-d07ee46dc149\") " pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:58.856853 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.856824 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmrl\" (UniqueName: \"kubernetes.io/projected/ccaf9b70-48ba-4b99-9dd6-6ec056630dc2-kube-api-access-8qmrl\") pod \"ovnkube-node-6xkb4\" (UID: \"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:58.857366 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.857341 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87wj\" (UniqueName: \"kubernetes.io/projected/0ae768cf-f332-4a87-a9cf-921f9e79968d-kube-api-access-s87wj\") pod \"multus-zc69m\" (UID: \"0ae768cf-f332-4a87-a9cf-921f9e79968d\") " pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.857454 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.857396 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tzvr\" (UniqueName: \"kubernetes.io/projected/b57302f6-33c3-40df-9365-7d569c3a44fe-kube-api-access-4tzvr\") pod \"iptables-alerter-pvbvt\" (UID: \"b57302f6-33c3-40df-9365-7d569c3a44fe\") " pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.857454 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.857405 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvdqx\" (UniqueName: \"kubernetes.io/projected/d3025e01-c1d0-4da7-9da5-e8a26336a692-kube-api-access-hvdqx\") pod \"node-ca-5bn7l\" (UID: \"d3025e01-c1d0-4da7-9da5-e8a26336a692\") " pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:58.857454 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.857416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2psv\" (UniqueName: \"kubernetes.io/projected/da191395-900e-4ce5-86ca-c2a7523f5367-kube-api-access-t2psv\") pod \"aws-ebs-csi-driver-node-sxn98\" (UID: \"da191395-900e-4ce5-86ca-c2a7523f5367\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:58.857454 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.857423 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8nh\" (UniqueName: \"kubernetes.io/projected/dcd60276-8c8e-4a3c-b977-3ffe8e11d15a-kube-api-access-pr8nh\") pod \"tuned-5tkdk\" (UID: \"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a\") " pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:58.857816 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.857796 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qps4l\" (UniqueName: \"kubernetes.io/projected/162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3-kube-api-access-qps4l\") pod \"multus-additional-cni-plugins-g5v8w\" (UID: \"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3\") " pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.858178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.858162 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfmn6\" (UniqueName: \"kubernetes.io/projected/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-kube-api-access-cfmn6\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:58.939642 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.939532 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.939642 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.939578 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d259984a-d57a-40d6-98ad-5693f379467e-kubelet-config\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.939642 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.939605 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d259984a-d57a-40d6-98ad-5693f379467e-dbus\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.939924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.939677 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d259984a-d57a-40d6-98ad-5693f379467e-dbus\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.939924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.939680 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d259984a-d57a-40d6-98ad-5693f379467e-kubelet-config\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:58.939924 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.939706 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:15:58.939924 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:58.939780 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:15:59.439758851 +0000 UTC m=+3.484159076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:15:58.976666 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.976602 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" Jul 17 18:15:58.982967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.982949 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zc69m" Jul 17 18:15:58.986694 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:58.986662 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162e5e5c_d3f7_4aa1_9a02_e0e97f398ef3.slice/crio-960747a90b32ceab666ef051704023f15cf4eea9178a11504af2227a52c191a1 WatchSource:0}: Error finding container 960747a90b32ceab666ef051704023f15cf4eea9178a11504af2227a52c191a1: Status 404 returned error can't find the container with id 960747a90b32ceab666ef051704023f15cf4eea9178a11504af2227a52c191a1 Jul 17 18:15:58.991523 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:58.991494 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae768cf_f332_4a87_a9cf_921f9e79968d.slice/crio-92efde079628732c11f7fb5427e9f466b5642460f4ae7c1e8c1a5b51e86082c7 WatchSource:0}: Error finding container 92efde079628732c11f7fb5427e9f466b5642460f4ae7c1e8c1a5b51e86082c7: Status 404 returned error can't find the container with id 92efde079628732c11f7fb5427e9f466b5642460f4ae7c1e8c1a5b51e86082c7 Jul 17 18:15:58.991523 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.991514 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pvbvt" Jul 17 18:15:58.996188 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:58.996167 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:15:59.002224 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:59.002013 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57302f6_33c3_40df_9365_7d569c3a44fe.slice/crio-43586ae62004c6323e15192aa89de8c1da84020d66696fe2a398f1852f121387 WatchSource:0}: Error finding container 43586ae62004c6323e15192aa89de8c1da84020d66696fe2a398f1852f121387: Status 404 returned error can't find the container with id 43586ae62004c6323e15192aa89de8c1da84020d66696fe2a398f1852f121387 Jul 17 18:15:59.004442 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.004423 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sh4fx" Jul 17 18:15:59.008311 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:59.008281 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42a7e9e_7ab7_4601_8ee4_22bb48a4c0e7.slice/crio-4317c91f4bc8ebbe361b291f9c70c891b706060cee94afb8cc1967fe9bf40132 WatchSource:0}: Error finding container 4317c91f4bc8ebbe361b291f9c70c891b706060cee94afb8cc1967fe9bf40132: Status 404 returned error can't find the container with id 4317c91f4bc8ebbe361b291f9c70c891b706060cee94afb8cc1967fe9bf40132 Jul 17 18:15:59.009977 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.009958 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:15:59.013975 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:59.013952 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode135cff5_a3d7_4d6d_9f50_d07ee46dc149.slice/crio-c5afd6b2b8f4a69372c1e75265de3d21c874ae735e1aec65ad5b8e7cd314cdfb WatchSource:0}: Error finding container c5afd6b2b8f4a69372c1e75265de3d21c874ae735e1aec65ad5b8e7cd314cdfb: Status 404 returned error can't find the container with id c5afd6b2b8f4a69372c1e75265de3d21c874ae735e1aec65ad5b8e7cd314cdfb Jul 17 18:15:59.017115 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.017089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bn7l" Jul 17 18:15:59.018577 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:59.018551 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaf9b70_48ba_4b99_9dd6_6ec056630dc2.slice/crio-b5a63d5b106ccaedff1d108b08304132652b9f0f3665c5f36169c8958db51e3c WatchSource:0}: Error finding container b5a63d5b106ccaedff1d108b08304132652b9f0f3665c5f36169c8958db51e3c: Status 404 returned error can't find the container with id b5a63d5b106ccaedff1d108b08304132652b9f0f3665c5f36169c8958db51e3c Jul 17 18:15:59.021990 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.021903 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" Jul 17 18:15:59.026176 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.026154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" Jul 17 18:15:59.032475 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:59.032445 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd60276_8c8e_4a3c_b977_3ffe8e11d15a.slice/crio-a3772aa7a0d8240df24cc0b7fb4669e3f61f3d819cdf9bf549609109a2934edf WatchSource:0}: Error finding container a3772aa7a0d8240df24cc0b7fb4669e3f61f3d819cdf9bf549609109a2934edf: Status 404 returned error can't find the container with id a3772aa7a0d8240df24cc0b7fb4669e3f61f3d819cdf9bf549609109a2934edf Jul 17 18:15:59.036126 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:15:59.036104 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda191395_900e_4ce5_86ca_c2a7523f5367.slice/crio-ce006877cbd89ffd1c7933c21adbad2d46d9dd5b4197dc497f2ceee186ae5d58 WatchSource:0}: Error finding container ce006877cbd89ffd1c7933c21adbad2d46d9dd5b4197dc497f2ceee186ae5d58: Status 404 returned error can't find the container with id ce006877cbd89ffd1c7933c21adbad2d46d9dd5b4197dc497f2ceee186ae5d58 Jul 17 18:15:59.349034 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.348993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:15:59.349241 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.349171 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:15:59.349241 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.349239 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:00.349218853 +0000 UTC m=+4.393619093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:15:59.349387 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.349201 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" event={"ID":"da191395-900e-4ce5-86ca-c2a7523f5367","Type":"ContainerStarted","Data":"ce006877cbd89ffd1c7933c21adbad2d46d9dd5b4197dc497f2ceee186ae5d58"} Jul 17 18:15:59.351930 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.351898 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bn7l" event={"ID":"d3025e01-c1d0-4da7-9da5-e8a26336a692","Type":"ContainerStarted","Data":"4fb8653638ceec2cd9a0aadd195abff2099905e19982c240c2d2eca3bedecc41"} Jul 17 18:15:59.353462 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.353427 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sh4fx" event={"ID":"e135cff5-a3d7-4d6d-9f50-d07ee46dc149","Type":"ContainerStarted","Data":"c5afd6b2b8f4a69372c1e75265de3d21c874ae735e1aec65ad5b8e7cd314cdfb"} Jul 17 18:15:59.356409 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.356324 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m52p7" event={"ID":"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7","Type":"ContainerStarted","Data":"4317c91f4bc8ebbe361b291f9c70c891b706060cee94afb8cc1967fe9bf40132"} Jul 17 18:15:59.358712 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.358635 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zc69m" event={"ID":"0ae768cf-f332-4a87-a9cf-921f9e79968d","Type":"ContainerStarted","Data":"92efde079628732c11f7fb5427e9f466b5642460f4ae7c1e8c1a5b51e86082c7"} Jul 17 18:15:59.360170 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.360138 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" event={"ID":"6230e03fa0ffb4d76dbad775c022c2a4","Type":"ContainerStarted","Data":"2bb2b610d565e4fb907ec030605921d897d8ce42b036bbed2ecd787769818a3f"} Jul 17 18:15:59.361946 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.361870 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" event={"ID":"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a","Type":"ContainerStarted","Data":"a3772aa7a0d8240df24cc0b7fb4669e3f61f3d819cdf9bf549609109a2934edf"} Jul 17 18:15:59.363711 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.363600 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"b5a63d5b106ccaedff1d108b08304132652b9f0f3665c5f36169c8958db51e3c"} Jul 17 18:15:59.365532 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.365445 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pvbvt" event={"ID":"b57302f6-33c3-40df-9365-7d569c3a44fe","Type":"ContainerStarted","Data":"43586ae62004c6323e15192aa89de8c1da84020d66696fe2a398f1852f121387"} Jul 17 18:15:59.367196 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.367167 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerStarted","Data":"960747a90b32ceab666ef051704023f15cf4eea9178a11504af2227a52c191a1"} Jul 17 18:15:59.369930 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.369882 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"931753cc28e27af3eaf291bdb6fa3367","Type":"ContainerStarted","Data":"4378eb49ade2ad2ea7a200422693f2371fbc0efa32ef2ad14c34902018452763"} Jul 17 18:15:59.449913 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.449870 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:15:59.450121 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.449937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:15:59.450121 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.450092 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:15:59.450249 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.450159 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:16:00.450138894 +0000 UTC m=+4.494539121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:15:59.450782 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.450630 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:15:59.450899 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.450797 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:15:59.450899 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.450814 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:15:59.451016 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:15:59.450902 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:00.45087633 +0000 UTC m=+4.495276569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:15:59.734600 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.734416 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:10:59 +0000 UTC" deadline="2028-03-10 18:39:12.307044567 +0000 UTC" Jul 17 18:15:59.734600 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:15:59.734485 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14448h23m12.572563556s" Jul 17 18:16:00.327009 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.326050 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:00.327009 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.326208 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:00.327009 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.326689 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:00.327009 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.326808 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:00.327009 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.326879 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:00.327009 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.326955 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:00.358025 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.357982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:00.358252 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.358151 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:00.358252 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.358223 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:02.358199616 +0000 UTC m=+6.402599841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:00.458767 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.458722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:00.458954 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.458788 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:00.458954 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.458937 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:00.459099 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.459001 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:16:02.458982339 +0000 UTC m=+6.503382567 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:00.459482 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.459457 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:16:00.459588 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.459491 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:16:00.459588 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.459506 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:00.459588 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:00.459557 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:02.459539353 +0000 UTC m=+6.503939580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:00.734708 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.734596 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:10:59 +0000 UTC" deadline="2028-04-19 13:20:48.762965554 +0000 UTC" Jul 17 18:16:00.734708 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:00.734635 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15403h4m48.028335181s" Jul 17 18:16:02.326999 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:02.325898 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:02.326999 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.326081 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:02.326999 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:02.326536 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:02.326999 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.326645 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:02.326999 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:02.326773 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:02.326999 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.326873 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:02.376725 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:02.376683 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:02.376921 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.376841 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:02.376921 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.376913 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:06.376890465 +0000 UTC m=+10.421290692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:02.477691 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:02.477637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:02.477874 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:02.477707 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:02.477968 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.477876 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:02.477968 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.477944 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:16:06.4779253 +0000 UTC m=+10.522325539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:02.478407 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.478384 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:16:02.478407 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.478411 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:16:02.478600 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.478425 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:02.478600 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:02.478474 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:06.478457758 +0000 UTC m=+10.522857988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:04.326115 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:04.326073 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:04.326617 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:04.326093 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:04.326617 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:04.326238 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:04.326617 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:04.326279 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:04.326617 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:04.326419 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:04.326617 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:04.326499 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:06.326183 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:06.325629 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:06.326183 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.325774 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:06.326183 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:06.326134 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:06.326814 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.326226 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:06.326814 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:06.326133 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:06.326814 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.326356 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:06.417477 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:06.417435 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:06.417676 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.417599 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:06.417676 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.417672 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:14.417650581 +0000 UTC m=+18.462050822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:06.518259 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:06.518221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:06.518469 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:06.518301 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:06.518535 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.518490 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:16:06.518535 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.518519 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:16:06.518637 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.518536 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:06.518637 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.518611 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:14.518587117 +0000 UTC m=+18.562987349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:06.518733 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.518690 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:06.518733 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:06.518730 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:16:14.518717581 +0000 UTC m=+18.563117812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:08.326666 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:08.325810 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:08.326666 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:08.325957 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:08.326666 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:08.326414 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:08.326666 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:08.326513 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:08.326666 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:08.326562 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:08.326666 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:08.326619 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:10.326125 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:10.326092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:10.326602 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:10.326092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:10.326602 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:10.326256 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:10.326602 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:10.326310 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:10.326602 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:10.326092 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:10.326602 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:10.326389 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:12.326357 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:12.326324 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:12.326805 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:12.326333 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:12.326805 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:12.326447 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:12.326805 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:12.326339 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:12.326805 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:12.326531 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:12.326805 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:12.326630 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:14.325570 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:14.325346 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:14.326097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:14.325415 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:14.326097 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.325696 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:14.326097 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:14.325409 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:14.326097 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.325785 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:14.326097 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.325839 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:14.477861 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:14.477825 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:14.478077 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.477990 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:14.478077 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.478055 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:30.478035165 +0000 UTC m=+34.522435411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:14.578950 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:14.578856 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:14.578950 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:14.578904 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:14.579232 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.579024 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:14.579232 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.579049 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:16:14.579232 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.579070 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:16:14.579232 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.579084 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:14.579232 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.579093 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:16:30.579073454 +0000 UTC m=+34.623473688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:14.579232 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:14.579135 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:30.579120008 +0000 UTC m=+34.623520231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:16.326185 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:16.326143 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:16.326185 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:16.326167 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:16.326719 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:16.326293 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:16.326719 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:16.326303 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:16.326719 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:16.326352 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:16.326719 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:16.326437 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:18.325953 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:18.325920 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:18.326409 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:18.325961 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:18.326409 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:18.326036 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:18.326409 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:18.326054 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:18.326409 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:18.326142 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:18.326409 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:18.326270 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:20.326467 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.326300 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:20.327080 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.326355 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:20.327080 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:20.326539 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:20.327080 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:20.326623 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:20.327080 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.326372 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:20.327080 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:20.326700 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:20.429201 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.429169 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"70bdac96eed4ef4e49a5a29f88185c0c5f6aeb58949acb61a5197293507277b7"} Jul 17 18:16:20.429316 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.429263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"90b626b945ad722a145ae66fe62e8e8da15912aca970c517216eafab57af5017"} Jul 17 18:16:20.429316 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.429303 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"92b6a7e4a6f15043e4cbadc2d9bff8d69e3efed72d8178b2efb20b40e74f0b81"} Jul 17 18:16:20.429388 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.429343 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"a6ca673b8b00f5bbf1a6e71d9adc9d36dffce095147cab284db9d7edac2b8711"} Jul 17 18:16:20.429388 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.429371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"a641aad709d8b1f993f38d18b3a4c91534d85bc60479205876a409218f62a559"} Jul 17 18:16:20.429471 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.429410 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"9fbfd3b4d30902c2829dcc5f97f8216303df75e222d37fa3a968e6344ba69817"} Jul 17 18:16:20.430592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.430571 2569 generic.go:356] "Generic (PLEG): container finished" podID="162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3" containerID="1944503f18aea4384b504802ddfc51a00a51df62733615c26e5afac9db1bffb4" exitCode=0 Jul 17 18:16:20.430675 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.430634 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerDied","Data":"1944503f18aea4384b504802ddfc51a00a51df62733615c26e5afac9db1bffb4"} Jul 17 18:16:20.432103 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.432057 2569 generic.go:356] "Generic (PLEG): container finished" podID="931753cc28e27af3eaf291bdb6fa3367" containerID="96ad3fb2b11ad044e37580b33dd4c884dd4be157c76345e0f4af3eebfe069828" exitCode=0 Jul 17 18:16:20.432153 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.432104 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"931753cc28e27af3eaf291bdb6fa3367","Type":"ContainerDied","Data":"96ad3fb2b11ad044e37580b33dd4c884dd4be157c76345e0f4af3eebfe069828"} Jul 17 18:16:20.433688 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.433656 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" event={"ID":"da191395-900e-4ce5-86ca-c2a7523f5367","Type":"ContainerStarted","Data":"5c4f1add03c6ebe48100023a47f80674798d7b222a589469599c34c9de6697b6"} Jul 17 18:16:20.435156 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.435132 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bn7l" event={"ID":"d3025e01-c1d0-4da7-9da5-e8a26336a692","Type":"ContainerStarted","Data":"dcdb1aa8a5f3ad305f2420012e00af8faaa1aa07d72954dbb7dcb4463ad610f4"} Jul 17 18:16:20.436697 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.436676 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sh4fx" event={"ID":"e135cff5-a3d7-4d6d-9f50-d07ee46dc149","Type":"ContainerStarted","Data":"33bf6bf3b622f400575baa4084c86075649d30e9522ba181527aa121576496df"} Jul 17 18:16:20.438071 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.438049 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m52p7" event={"ID":"d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7","Type":"ContainerStarted","Data":"70bd484cbb69606b0d4ee724409d08a0801b3b3810b56b4e4745f7f64c4d7f53"} Jul 17 18:16:20.439464 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.439444 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zc69m" event={"ID":"0ae768cf-f332-4a87-a9cf-921f9e79968d","Type":"ContainerStarted","Data":"eb8746913fa6c98fc7d011e004229769996db0694c93cc80326acf4d31908d51"} Jul 17 18:16:20.440734 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.440716 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" event={"ID":"6230e03fa0ffb4d76dbad775c022c2a4","Type":"ContainerStarted","Data":"76d933479f200e11d467809021062152fc9b415b8fa5d6fd57dde5abf3b0669e"} Jul 17 18:16:20.441998 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.441980 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" event={"ID":"dcd60276-8c8e-4a3c-b977-3ffe8e11d15a","Type":"ContainerStarted","Data":"2ef6f1249792d3ff7571b5ad7cb7a39c5547e753ba8835e35fa534c0467be4fb"} Jul 17 18:16:20.494145 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.493867 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5tkdk" podStartSLOduration=2.786764664 podStartE2EDuration="23.493844613s" totalImagesPullingTime="20.707079949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:20.49363755 +0000 UTC m=+24.538037796" watchObservedRunningTime="2026-07-17 18:16:20.493844613 +0000 UTC m=+24.538244860" Jul 17 18:16:20.494388 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.494274 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5bn7l" podStartSLOduration=2.7741796770000002 podStartE2EDuration="23.49426269s" totalImagesPullingTime="20.720083013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:20.473172122 +0000 UTC m=+24.517572367" watchObservedRunningTime="2026-07-17 18:16:20.49426269 +0000 UTC m=+24.538662929" Jul 17 18:16:20.528651 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.528607 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m52p7" podStartSLOduration=2.797574885 podStartE2EDuration="23.528591696s" totalImagesPullingTime="20.731016811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:20.52822038 +0000 UTC m=+24.572620625" watchObservedRunningTime="2026-07-17 18:16:20.528591696 +0000 UTC m=+24.572991967" Jul 17 18:16:20.545346 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.545303 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sh4fx" podStartSLOduration=2.808874576 podStartE2EDuration="23.54528781s" totalImagesPullingTime="20.736413234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:20.544998548 +0000 UTC m=+24.589398795" watchObservedRunningTime="2026-07-17 18:16:20.54528781 +0000 UTC m=+24.589688055" Jul 17 18:16:20.559674 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.559622 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" podStartSLOduration=22.559605047 podStartE2EDuration="22.559605047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:20.559225085 +0000 UTC m=+24.603625330" watchObservedRunningTime="2026-07-17 18:16:20.559605047 +0000 UTC m=+24.604005292" Jul 17 18:16:20.582587 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:20.582525 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zc69m" podStartSLOduration=2.771852872 podStartE2EDuration="23.582504623s" totalImagesPullingTime="20.810651751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:20.581703087 +0000 UTC m=+24.626103334" watchObservedRunningTime="2026-07-17 18:16:20.582504623 +0000 UTC m=+24.626904869" Jul 17 18:16:21.446892 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.446659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pvbvt" event={"ID":"b57302f6-33c3-40df-9365-7d569c3a44fe","Type":"ContainerStarted","Data":"d7b6e88e99a614a143073743d5f94ba86e0420e82bbbe7e807ae877fca55a146"} Jul 17 18:16:21.449999 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.449971 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"931753cc28e27af3eaf291bdb6fa3367","Type":"ContainerStarted","Data":"713c404065244420facc7a1a737461c866d239f586558f834931d9f2b215dfc0"} Jul 17 18:16:21.491779 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.491713 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pvbvt" podStartSLOduration=3.754925874 podStartE2EDuration="24.491690505s" totalImagesPullingTime="20.736764631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:21.46632023 +0000 UTC m=+25.510720477" watchObservedRunningTime="2026-07-17 18:16:21.491690505 +0000 UTC m=+25.536090753" Jul 17 18:16:21.492045 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.492016 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" podStartSLOduration=23.492008907 podStartE2EDuration="23.492008907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:21.491842784 +0000 UTC m=+25.536243033" watchObservedRunningTime="2026-07-17 18:16:21.492008907 +0000 UTC m=+25.536409152" Jul 17 18:16:21.568128 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.568101 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 18:16:21.869223 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.869129 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T18:16:21.568122135Z","UUID":"5ee731c0-82e5-45cd-a36c-4411e5d2f257","Handler":null,"Name":"","Endpoint":""} Jul 17 18:16:21.870964 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.870937 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 18:16:21.871103 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:21.870974 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 18:16:22.063511 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.063476 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:16:22.064143 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.064118 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:16:22.325982 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.325946 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:22.326314 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:22.326082 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:22.326314 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.326261 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:22.326442 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.326263 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:22.326442 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:22.326351 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:22.326542 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:22.326464 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:22.454912 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.454817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" event={"ID":"da191395-900e-4ce5-86ca-c2a7523f5367","Type":"ContainerStarted","Data":"5dcbbb8cc0e0350c79c5fbb020209e0a21121dc3904d0b57ecb221bce3118dab"} Jul 17 18:16:22.455333 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.455130 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:16:22.455786 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:22.455746 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m52p7" Jul 17 18:16:23.460985 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:23.460944 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"c1b890eba972e30b9def3d3979c379ea68082ccf3779725326c2c0ec1dee5b85"} Jul 17 18:16:23.463091 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:23.463065 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" event={"ID":"da191395-900e-4ce5-86ca-c2a7523f5367","Type":"ContainerStarted","Data":"281a29b37a88343c20f452b210fb108ec7b41009e2e711a25511d7b954822b1a"} Jul 17 18:16:23.482993 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:23.482946 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sxn98" podStartSLOduration=2.2763956739999998 podStartE2EDuration="25.482933193s" totalImagesPullingTime="23.206537519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:23.482332007 +0000 UTC m=+27.526732252" watchObservedRunningTime="2026-07-17 18:16:23.482933193 +0000 UTC m=+27.527333465" Jul 17 18:16:24.325477 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:24.325439 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:24.325665 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:24.325439 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:24.325665 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:24.325562 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:24.325779 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:24.325680 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:24.325779 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:24.325439 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:24.325885 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:24.325785 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:25.470883 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.470633 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" event={"ID":"ccaf9b70-48ba-4b99-9dd6-6ec056630dc2","Type":"ContainerStarted","Data":"8ff9494f8572ded0d3a01d493dacbf03aec5d7fcca20a6ea605d44ad3528b4ec"} Jul 17 18:16:25.471837 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.470924 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:16:25.471837 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.470988 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:16:25.472503 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.472480 2569 generic.go:356] "Generic (PLEG): container finished" podID="162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3" containerID="0c1310032377da9333b82e149d258229476ed28c1fb773862f3f3984641c8ed0" exitCode=0 Jul 17 18:16:25.472624 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.472527 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerDied","Data":"0c1310032377da9333b82e149d258229476ed28c1fb773862f3f3984641c8ed0"} Jul 17 18:16:25.486526 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.486492 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:16:25.499856 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:25.499815 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" podStartSLOduration=7.712123443 podStartE2EDuration="28.499800824s" totalImagesPullingTime="20.787677381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:25.499323873 +0000 UTC m=+29.543724112" watchObservedRunningTime="2026-07-17 18:16:25.499800824 +0000 UTC m=+29.544201068" Jul 17 18:16:26.325571 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.325537 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:26.325847 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.325552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:26.325847 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:26.325668 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:26.325847 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.325675 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:26.325847 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:26.325766 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:26.326051 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:26.325906 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:26.475412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.475378 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:16:26.492968 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.492942 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:16:26.953683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.953481 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfpz4"] Jul 17 18:16:26.953784 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.953740 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:26.953921 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:26.953894 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:26.957528 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.957203 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kbhxf"] Jul 17 18:16:26.957528 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.957335 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:26.957528 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:26.957451 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:26.958002 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.957979 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tnlqv"] Jul 17 18:16:26.958075 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:26.958063 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:26.958567 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:26.958156 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:27.481115 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:27.481076 2569 generic.go:356] "Generic (PLEG): container finished" podID="162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3" containerID="57499c041e8a60a557eed6338dca2cac4b3b9f290d80d461966aaf81a8596d3d" exitCode=0 Jul 17 18:16:27.481507 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:27.481158 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerDied","Data":"57499c041e8a60a557eed6338dca2cac4b3b9f290d80d461966aaf81a8596d3d"} Jul 17 18:16:28.325867 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:28.325841 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:28.325984 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:28.325959 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:28.326041 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:28.326001 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:28.326109 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:28.326091 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:28.486049 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:28.486014 2569 generic.go:356] "Generic (PLEG): container finished" podID="162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3" containerID="eac6f7f4e9ddfab286b84e23bff878a0b785ba962618ea89e5a5e6d60529638f" exitCode=0 Jul 17 18:16:28.486429 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:28.486093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerDied","Data":"eac6f7f4e9ddfab286b84e23bff878a0b785ba962618ea89e5a5e6d60529638f"} Jul 17 18:16:29.326383 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:29.326345 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:29.326587 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:29.326474 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:30.325750 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:30.325711 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:30.326124 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:30.325710 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:30.326124 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.325846 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:30.326124 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.325905 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:30.487511 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:30.487475 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:30.487688 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.487616 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:30.487688 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.487686 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:02.48766665 +0000 UTC m=+66.532066875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:16:30.588304 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:30.588210 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:30.588304 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:30.588295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:30.588533 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.588380 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:16:30.588533 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.588408 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:16:30.588533 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.588425 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sf5rg for pod openshift-network-diagnostics/network-check-target-tnlqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:30.588533 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.588427 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:30.588533 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.588482 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg podName:24fcb30d-b1a3-483d-8528-c3973f44cba8 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:02.588467435 +0000 UTC m=+66.632867663 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf5rg" (UniqueName: "kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg") pod "network-check-target-tnlqv" (UID: "24fcb30d-b1a3-483d-8528-c3973f44cba8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:16:30.588533 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:30.588501 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret podName:d259984a-d57a-40d6-98ad-5693f379467e nodeName:}" failed. No retries permitted until 2026-07-17 18:17:02.588491809 +0000 UTC m=+66.632892035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret") pod "global-pull-secret-syncer-gfpz4" (UID: "d259984a-d57a-40d6-98ad-5693f379467e") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:16:31.325675 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:31.325639 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:31.325859 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:31.325764 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tnlqv" podUID="24fcb30d-b1a3-483d-8528-c3973f44cba8" Jul 17 18:16:32.326127 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.325939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:32.326546 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.325939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:32.326546 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:32.326233 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbhxf" podUID="9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7" Jul 17 18:16:32.326546 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:32.326330 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfpz4" podUID="d259984a-d57a-40d6-98ad-5693f379467e" Jul 17 18:16:32.770214 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.770181 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeReady" Jul 17 18:16:32.770404 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.770358 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 18:16:32.815826 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.815789 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vlpvt"] Jul 17 18:16:32.818665 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.818643 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:32.820896 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.820873 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 18:16:32.821144 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.821127 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 18:16:32.821259 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.821158 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-psc8s\"" Jul 17 18:16:32.823145 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.822445 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5vvd7"] Jul 17 18:16:32.824426 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.824408 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:32.827072 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.827038 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 18:16:32.829078 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.827731 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bszxr\"" Jul 17 18:16:32.829078 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.827973 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 18:16:32.829078 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.828223 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 18:16:32.831067 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.830999 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vlpvt"] Jul 17 18:16:32.836359 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.836338 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5vvd7"] Jul 17 18:16:32.903524 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.903484 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f96ac85-0af3-4d7e-88c6-311f493ab742-tmp-dir\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:32.903706 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.903557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f96ac85-0af3-4d7e-88c6-311f493ab742-config-volume\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:32.903706 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.903608 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-242m6\" (UniqueName: \"kubernetes.io/projected/3f96ac85-0af3-4d7e-88c6-311f493ab742-kube-api-access-242m6\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:32.903706 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.903645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71a328f6-a7af-44a0-9494-eb4c5c9d8ef6-cert\") pod \"ingress-canary-5vvd7\" (UID: \"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6\") " pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:32.903706 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.903676 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2h5r\" (UniqueName: \"kubernetes.io/projected/71a328f6-a7af-44a0-9494-eb4c5c9d8ef6-kube-api-access-q2h5r\") pod \"ingress-canary-5vvd7\" (UID: \"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6\") " pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:32.903706 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:32.903706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.004798 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.004750 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.004987 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.004813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f96ac85-0af3-4d7e-88c6-311f493ab742-tmp-dir\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.004987 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.004855 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f96ac85-0af3-4d7e-88c6-311f493ab742-config-volume\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.004987 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.004902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-242m6\" (UniqueName: \"kubernetes.io/projected/3f96ac85-0af3-4d7e-88c6-311f493ab742-kube-api-access-242m6\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.004987 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.004925 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:16:33.004987 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.004945 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71a328f6-a7af-44a0-9494-eb4c5c9d8ef6-cert\") pod \"ingress-canary-5vvd7\" (UID: \"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6\") " pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:33.004987 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.004972 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2h5r\" (UniqueName: \"kubernetes.io/projected/71a328f6-a7af-44a0-9494-eb4c5c9d8ef6-kube-api-access-q2h5r\") pod \"ingress-canary-5vvd7\" (UID: \"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6\") " pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:33.005365 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.005002 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:33.504979617 +0000 UTC m=+37.549379853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:16:33.005652 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.005628 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f96ac85-0af3-4d7e-88c6-311f493ab742-tmp-dir\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.005817 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.005799 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3f96ac85-0af3-4d7e-88c6-311f493ab742-config-volume\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.009809 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.009787 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71a328f6-a7af-44a0-9494-eb4c5c9d8ef6-cert\") pod \"ingress-canary-5vvd7\" (UID: \"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6\") " pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:33.015362 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.015334 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2h5r\" (UniqueName: \"kubernetes.io/projected/71a328f6-a7af-44a0-9494-eb4c5c9d8ef6-kube-api-access-q2h5r\") pod \"ingress-canary-5vvd7\" (UID: \"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6\") " pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:33.015824 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.015799 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-242m6\" (UniqueName: \"kubernetes.io/projected/3f96ac85-0af3-4d7e-88c6-311f493ab742-kube-api-access-242m6\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.138698 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.138662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5vvd7" Jul 17 18:16:33.326359 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.325991 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:16:33.329983 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.329953 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 18:16:33.330113 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.330060 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vbqnh\"" Jul 17 18:16:33.330271 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.330233 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 18:16:33.379722 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.379673 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5vvd7"] Jul 17 18:16:33.383212 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:16:33.383182 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a328f6_a7af_44a0_9494_eb4c5c9d8ef6.slice/crio-c97caa9eb7753f6beb71b2da6d572d19e14703b147032409f7c498a1fdd62800 WatchSource:0}: Error finding container c97caa9eb7753f6beb71b2da6d572d19e14703b147032409f7c498a1fdd62800: Status 404 returned error can't find the container with id c97caa9eb7753f6beb71b2da6d572d19e14703b147032409f7c498a1fdd62800 Jul 17 18:16:33.475898 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.475863 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp"] Jul 17 18:16:33.477849 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.477828 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.480062 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.480036 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xq8wp\"" Jul 17 18:16:33.480183 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.480155 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 18:16:33.481073 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.481054 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 18:16:33.481149 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.481056 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 18:16:33.481272 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.481258 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 18:16:33.489224 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.489201 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp"] Jul 17 18:16:33.499832 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.499807 2569 generic.go:356] "Generic (PLEG): container finished" podID="162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3" containerID="60bdea3a7702fc75db430831969d2f83c0886cc63b5e6647f4e26f85f1d9eec0" exitCode=0 Jul 17 18:16:33.499947 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.499885 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerDied","Data":"60bdea3a7702fc75db430831969d2f83c0886cc63b5e6647f4e26f85f1d9eec0"} Jul 17 18:16:33.500854 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.500832 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5vvd7" event={"ID":"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6","Type":"ContainerStarted","Data":"c97caa9eb7753f6beb71b2da6d572d19e14703b147032409f7c498a1fdd62800"} Jul 17 18:16:33.509717 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.509691 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:33.509829 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.509753 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db200087-0d46-4376-8c08-77b87561c29d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.509829 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.509782 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xp5\" (UniqueName: \"kubernetes.io/projected/db200087-0d46-4376-8c08-77b87561c29d-kube-api-access-84xp5\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.509829 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.509789 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:16:33.509829 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.509818 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.509978 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.509845 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:34.509825534 +0000 UTC m=+38.554225777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:16:33.581150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.581120 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d94db4774-hj7jp"] Jul 17 18:16:33.582758 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.582744 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.585796 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.585777 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 18:16:33.585915 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.585898 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 18:16:33.586573 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.586551 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 18:16:33.586676 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.586655 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 18:16:33.587523 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.587206 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wgtzf\"" Jul 17 18:16:33.587523 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.587298 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 18:16:33.587523 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.587373 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 18:16:33.605373 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.605336 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d94db4774-hj7jp"] Jul 17 18:16:33.610550 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610370 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84xp5\" (UniqueName: \"kubernetes.io/projected/db200087-0d46-4376-8c08-77b87561c29d-kube-api-access-84xp5\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.610665 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610574 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-default-certificate\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.610665 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610594 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh6v9\" (UniqueName: \"kubernetes.io/projected/472565f6-6b10-4c1a-9fab-4bc337422849-kube-api-access-vh6v9\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.610665 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.610788 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610722 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.610788 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.610759 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:33.610788 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-stats-auth\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.610908 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.610882 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:16:34.110862907 +0000 UTC m=+38.155263141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:33.610968 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610912 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db200087-0d46-4376-8c08-77b87561c29d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.610968 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.610950 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.611740 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.611717 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db200087-0d46-4376-8c08-77b87561c29d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.627002 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.626978 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xp5\" (UniqueName: \"kubernetes.io/projected/db200087-0d46-4376-8c08-77b87561c29d-kube-api-access-84xp5\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:33.685676 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.685598 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq"] Jul 17 18:16:33.687452 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.687438 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:33.690224 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.690197 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 18:16:33.690520 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.690494 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 18:16:33.690741 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.690723 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:16:33.690833 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.690725 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j7sz2\"" Jul 17 18:16:33.690999 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.690980 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75fb88c44-4s6rv"] Jul 17 18:16:33.692750 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.692734 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.695163 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.695144 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 18:16:33.696209 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.696195 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 18:16:33.696297 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.696229 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cnw75\"" Jul 17 18:16:33.697710 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.697692 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 18:16:33.702466 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.702444 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq"] Jul 17 18:16:33.703180 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.703164 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 18:16:33.711381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-certificates\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.711505 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-trusted-ca\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.711505 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711428 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-stats-auth\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.711505 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711491 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-bound-sa-token\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.711619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711540 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.711619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-image-registry-private-configuration\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.711619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711585 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.711619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-installation-pull-secrets\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.711789 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711625 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-default-certificate\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.711789 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.711652 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:34.211635403 +0000 UTC m=+38.256035630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:16:33.711789 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711678 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh6v9\" (UniqueName: \"kubernetes.io/projected/472565f6-6b10-4c1a-9fab-4bc337422849-kube-api-access-vh6v9\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.711789 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kts9x\" (UniqueName: \"kubernetes.io/projected/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-kube-api-access-kts9x\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:33.711789 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711760 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:33.711789 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a87092-3fc2-4ebd-a007-d1a02eb08011-ca-trust-extracted\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.712004 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711802 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t567z\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-kube-api-access-t567z\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.712004 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.711839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.712004 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.711922 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:16:33.712004 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.711963 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:34.211949992 +0000 UTC m=+38.256350216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:16:33.714195 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.714173 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-stats-auth\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.714195 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.714192 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-default-certificate\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.716569 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.716541 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75fb88c44-4s6rv"] Jul 17 18:16:33.731821 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.731794 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh6v9\" (UniqueName: \"kubernetes.io/projected/472565f6-6b10-4c1a-9fab-4bc337422849-kube-api-access-vh6v9\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:33.812739 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.812695 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a87092-3fc2-4ebd-a007-d1a02eb08011-ca-trust-extracted\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.812739 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.812732 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t567z\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-kube-api-access-t567z\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.812924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.812768 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-certificates\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.812924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.812784 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-trusted-ca\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.812924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.812815 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-bound-sa-token\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.813117 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813093 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-image-registry-private-configuration\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.813154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813132 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.813190 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813160 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-installation-pull-secrets\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.813273 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813231 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kts9x\" (UniqueName: \"kubernetes.io/projected/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-kube-api-access-kts9x\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:33.813341 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.813279 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:16:33.813341 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.813295 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:16:33.813341 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:33.813436 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.813349 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:34.313331422 +0000 UTC m=+38.357731669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:16:33.813436 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813128 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a87092-3fc2-4ebd-a007-d1a02eb08011-ca-trust-extracted\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.813436 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.813406 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:16:33.813592 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:33.813444 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:16:34.313433376 +0000 UTC m=+38.357833613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:16:33.813592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813505 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-certificates\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.813780 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.813762 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-trusted-ca\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.815354 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.815333 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-image-registry-private-configuration\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.815464 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.815450 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-installation-pull-secrets\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.822538 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.822514 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t567z\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-kube-api-access-t567z\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:33.822538 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.822539 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kts9x\" (UniqueName: \"kubernetes.io/projected/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-kube-api-access-kts9x\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:33.822660 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:33.822608 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-bound-sa-token\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:34.116542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.116499 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:34.116736 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.116642 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:34.116736 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.116718 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:16:35.116696098 +0000 UTC m=+39.161096320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:34.217381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.217348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:34.217587 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.217486 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:34.217587 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.217523 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:35.217501387 +0000 UTC m=+39.261901614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:16:34.217743 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.217592 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:16:34.217743 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.217642 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:35.217626687 +0000 UTC m=+39.262026925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:16:34.318226 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.318180 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:34.318418 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.318286 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:34.318418 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.318360 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:16:34.318418 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.318384 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:16:34.318418 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.318423 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:16:34.318418 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.318451 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:35.318435099 +0000 UTC m=+39.362835321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:16:34.318686 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.318476 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:16:35.318463062 +0000 UTC m=+39.362863288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:16:34.325917 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.325889 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:16:34.326066 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.325928 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:16:34.328331 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.328291 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 18:16:34.328865 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.328298 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 18:16:34.328865 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.328303 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g2h6g\"" Jul 17 18:16:34.506018 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.505930 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k"] Jul 17 18:16:34.508336 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.508302 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.510953 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.510932 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 18:16:34.511114 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.510965 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ns72g\"" Jul 17 18:16:34.511257 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.510983 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 18:16:34.511337 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.511259 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerDied","Data":"596f74847f43997a04b59ccf0ecbeee5103167045a3c20c7f9c81f65795fcc4d"} Jul 17 18:16:34.511337 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.511276 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:16:34.511337 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.511218 2569 generic.go:356] "Generic (PLEG): container finished" podID="162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3" containerID="596f74847f43997a04b59ccf0ecbeee5103167045a3c20c7f9c81f65795fcc4d" exitCode=0 Jul 17 18:16:34.511480 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.511417 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 18:16:34.518433 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.518412 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k"] Jul 17 18:16:34.519688 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.519667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:34.519806 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.519790 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:16:34.519869 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:34.519854 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:36.519835416 +0000 UTC m=+40.564235640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:16:34.620745 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.620708 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad86a254-7536-48bd-a04d-1ab8ca0aae06-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.620914 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.620868 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad86a254-7536-48bd-a04d-1ab8ca0aae06-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.620979 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.620910 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt4mj\" (UniqueName: \"kubernetes.io/projected/ad86a254-7536-48bd-a04d-1ab8ca0aae06-kube-api-access-tt4mj\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.721632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.721594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad86a254-7536-48bd-a04d-1ab8ca0aae06-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.721632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.721632 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt4mj\" (UniqueName: \"kubernetes.io/projected/ad86a254-7536-48bd-a04d-1ab8ca0aae06-kube-api-access-tt4mj\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.721843 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.721729 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad86a254-7536-48bd-a04d-1ab8ca0aae06-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.722147 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.722126 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad86a254-7536-48bd-a04d-1ab8ca0aae06-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.724431 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.724406 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad86a254-7536-48bd-a04d-1ab8ca0aae06-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.731255 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.731218 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt4mj\" (UniqueName: \"kubernetes.io/projected/ad86a254-7536-48bd-a04d-1ab8ca0aae06-kube-api-access-tt4mj\") pod \"kube-storage-version-migrator-operator-7658d9b749-lts7k\" (UID: \"ad86a254-7536-48bd-a04d-1ab8ca0aae06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.821627 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.821593 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" Jul 17 18:16:34.948669 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:34.948638 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k"] Jul 17 18:16:34.953465 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:16:34.953434 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad86a254_7536_48bd_a04d_1ab8ca0aae06.slice/crio-dab9f49fdc4385c6a95fb064294e04b9b3fe5a6e380f9d1291ce95c2db9467b8 WatchSource:0}: Error finding container dab9f49fdc4385c6a95fb064294e04b9b3fe5a6e380f9d1291ce95c2db9467b8: Status 404 returned error can't find the container with id dab9f49fdc4385c6a95fb064294e04b9b3fe5a6e380f9d1291ce95c2db9467b8 Jul 17 18:16:35.125572 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.125464 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:35.125744 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.125607 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:35.125744 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.125682 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:16:37.125659979 +0000 UTC m=+41.170060204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:35.226623 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.226588 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:35.226825 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.226648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:35.226825 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.226718 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:16:35.226825 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.226796 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:37.226775172 +0000 UTC m=+41.271175410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:16:35.226979 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.226825 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:37.226806313 +0000 UTC m=+41.271206553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:16:35.327347 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.327286 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:35.327523 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.327360 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:35.327523 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.327476 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:16:35.327523 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.327499 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:16:35.327523 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.327507 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:16:35.327683 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.327560 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:37.327541491 +0000 UTC m=+41.371941725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:16:35.327683 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:35.327583 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:16:37.327572414 +0000 UTC m=+41.371972643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:16:35.515899 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.515798 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" event={"ID":"ad86a254-7536-48bd-a04d-1ab8ca0aae06","Type":"ContainerStarted","Data":"dab9f49fdc4385c6a95fb064294e04b9b3fe5a6e380f9d1291ce95c2db9467b8"} Jul 17 18:16:35.519909 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.519876 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" event={"ID":"162e5e5c-d3f7-4aa1-9a02-e0e97f398ef3","Type":"ContainerStarted","Data":"15f137120c940c89b9925f70e32294cf0f81d3e19baa53d57aa8d7f29caf3266"} Jul 17 18:16:35.542429 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:35.542277 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g5v8w" podStartSLOduration=6.177579137 podStartE2EDuration="38.542256678s" totalImagesPullingTime="32.364677541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:35.541390364 +0000 UTC m=+39.585790611" watchObservedRunningTime="2026-07-17 18:16:35.542256678 +0000 UTC m=+39.586656915" Jul 17 18:16:36.525036 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:36.524791 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5vvd7" event={"ID":"71a328f6-a7af-44a0-9494-eb4c5c9d8ef6","Type":"ContainerStarted","Data":"14bc3be403d4271a61f9334c6d7b600957eb71573dcdca6899e8dec4f93369f0"} Jul 17 18:16:36.538301 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:36.538269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:36.538462 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:36.538391 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:16:36.538462 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:36.538447 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:40.538433841 +0000 UTC m=+44.582834064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:16:36.541053 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:36.541004 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5vvd7" podStartSLOduration=1.958287326 podStartE2EDuration="4.540987041s" totalImagesPullingTime="2.582699715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:36.539322998 +0000 UTC m=+40.583723241" watchObservedRunningTime="2026-07-17 18:16:36.540987041 +0000 UTC m=+40.585387289" Jul 17 18:16:37.144090 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:37.144049 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:37.144285 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.144213 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:37.144382 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.144310 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.14428956 +0000 UTC m=+45.188689802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:37.244746 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:37.244705 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:37.244951 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:37.244772 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:37.244951 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.244878 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:16:37.245055 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.244971 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.24494901 +0000 UTC m=+45.289349238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:16:37.245055 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.244997 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.244986489 +0000 UTC m=+45.289386711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:16:37.346329 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:37.346292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:37.346499 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:37.346352 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:37.346499 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.346459 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:16:37.346499 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.346471 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:16:37.346499 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.346481 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:16:37.346683 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.346543 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.346523393 +0000 UTC m=+45.390923615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:16:37.346683 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:37.346559 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.346553557 +0000 UTC m=+45.390953780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:16:38.530612 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:38.530576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" event={"ID":"ad86a254-7536-48bd-a04d-1ab8ca0aae06","Type":"ContainerStarted","Data":"7e404fe103efb626fbe7955b7006fda91fcf293f397637ed1950ea925cacb49a"} Jul 17 18:16:38.547376 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:38.547325 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" podStartSLOduration=1.520107033 podStartE2EDuration="4.547307269s" totalImagesPullingTime="3.027200236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:16:38.546918742 +0000 UTC m=+42.591319014" watchObservedRunningTime="2026-07-17 18:16:38.547307269 +0000 UTC m=+42.591707514" Jul 17 18:16:39.812599 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.812567 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bmjr7"] Jul 17 18:16:39.828444 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.828412 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmjr7"] Jul 17 18:16:39.828603 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.828539 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.831014 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.830995 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hs4xv\"" Jul 17 18:16:39.831146 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.830993 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 18:16:39.831146 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.831029 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 18:16:39.831792 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.831773 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 18:16:39.831870 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.831816 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 18:16:39.867720 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.867688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.867871 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.867750 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.867871 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.867817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6691bd54-709b-4361-92ad-e7c89547b445-crio-socket\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.867871 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.867842 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2l6b\" (UniqueName: \"kubernetes.io/projected/6691bd54-709b-4361-92ad-e7c89547b445-kube-api-access-b2l6b\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.868004 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.867936 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6691bd54-709b-4361-92ad-e7c89547b445-data-volume\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968449 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.968408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6691bd54-709b-4361-92ad-e7c89547b445-crio-socket\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968449 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.968450 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2l6b\" (UniqueName: \"kubernetes.io/projected/6691bd54-709b-4361-92ad-e7c89547b445-kube-api-access-b2l6b\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968701 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.968552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6691bd54-709b-4361-92ad-e7c89547b445-data-volume\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968701 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.968600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968701 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.968644 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6691bd54-709b-4361-92ad-e7c89547b445-crio-socket\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968701 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.968656 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.968890 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:39.968747 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:16:39.968890 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:39.968763 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:16:39.968890 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:39.968822 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:40.468801284 +0000 UTC m=+44.513201516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : configmap "kube-rbac-proxy" not found Jul 17 18:16:39.968890 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:39.968839 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:40.468829481 +0000 UTC m=+44.513229711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:16:39.969184 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.969085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6691bd54-709b-4361-92ad-e7c89547b445-data-volume\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:39.979006 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:39.978976 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2l6b\" (UniqueName: \"kubernetes.io/projected/6691bd54-709b-4361-92ad-e7c89547b445-kube-api-access-b2l6b\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:40.472712 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:40.472672 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:40.472919 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:40.472755 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:40.472919 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:40.472806 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:16:40.472919 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:40.472876 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.4728603 +0000 UTC m=+45.517260528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : configmap "kube-rbac-proxy" not found Jul 17 18:16:40.473038 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:40.472919 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:16:40.473038 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:40.472977 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:41.472961699 +0000 UTC m=+45.517361922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:16:40.574221 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:40.574190 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:40.574441 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:40.574391 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:16:40.574490 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:40.574455 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:48.574440673 +0000 UTC m=+52.618840899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:16:41.178904 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.178862 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:41.179315 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.179009 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:41.179315 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.179073 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:16:49.179058883 +0000 UTC m=+53.223459109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:41.280144 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.280105 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:41.280144 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.280153 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:41.280444 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.280279 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:16:41.280444 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.280368 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:49.280337093 +0000 UTC m=+53.324737318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:16:41.280444 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.280405 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:49.280395804 +0000 UTC m=+53.324796028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:16:41.381087 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.381055 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:41.381255 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.381120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:41.381255 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.381216 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:16:41.381255 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.381231 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:16:41.381379 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.381293 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:16:41.381379 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.381305 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:49.381286006 +0000 UTC m=+53.425686239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:16:41.381379 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.381346 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:16:49.38133344 +0000 UTC m=+53.425733664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:16:41.482555 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.482482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:41.482555 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.482540 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:41.482725 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.482612 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:16:41.482725 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.482683 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:43.482665582 +0000 UTC m=+47.527065815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : configmap "kube-rbac-proxy" not found Jul 17 18:16:41.482725 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.482696 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:16:41.482818 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:41.482737 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:43.482725806 +0000 UTC m=+47.527126028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:16:41.689650 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:41.689626 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sh4fx_e135cff5-a3d7-4d6d-9f50-d07ee46dc149/dns-node-resolver/0.log" Jul 17 18:16:42.487956 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:42.487933 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bn7l_d3025e01-c1d0-4da7-9da5-e8a26336a692/node-ca/0.log" Jul 17 18:16:43.088866 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:43.088837 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5vvd7_71a328f6-a7af-44a0-9494-eb4c5c9d8ef6/serve-healthcheck-canary/0.log" Jul 17 18:16:43.498116 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:43.498027 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:43.498116 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:43.498103 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:43.498615 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:43.498148 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:16:43.498615 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:43.498214 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:47.498195498 +0000 UTC m=+51.542595723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : configmap "kube-rbac-proxy" not found Jul 17 18:16:43.498615 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:43.498260 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:16:43.498615 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:43.498321 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:47.498304399 +0000 UTC m=+51.542704625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:16:45.171670 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.171591 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qzpsr"] Jul 17 18:16:45.184033 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.184000 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.184821 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.184792 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qzpsr"] Jul 17 18:16:45.186655 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.186634 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 17 18:16:45.187504 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.187473 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 17 18:16:45.187504 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.187489 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5qssv\"" Jul 17 18:16:45.187504 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.187501 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 17 18:16:45.187698 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.187582 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 17 18:16:45.313892 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.313853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-signing-key\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.313892 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.313897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-signing-cabundle\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.314150 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.313998 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhft\" (UniqueName: \"kubernetes.io/projected/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-kube-api-access-xdhft\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.414456 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.414415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-signing-key\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.414456 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.414463 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-signing-cabundle\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.414666 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.414627 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhft\" (UniqueName: \"kubernetes.io/projected/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-kube-api-access-xdhft\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.415086 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.415066 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-signing-cabundle\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.416948 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.416928 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-signing-key\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.423506 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.423451 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhft\" (UniqueName: \"kubernetes.io/projected/d85a02e9-b311-4ace-b0f2-e9adf6f84af8-kube-api-access-xdhft\") pod \"service-ca-58598695f7-qzpsr\" (UID: \"d85a02e9-b311-4ace-b0f2-e9adf6f84af8\") " pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.493817 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.493784 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" Jul 17 18:16:45.633925 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:45.633892 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qzpsr"] Jul 17 18:16:45.636878 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:16:45.636854 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85a02e9_b311_4ace_b0f2_e9adf6f84af8.slice/crio-1836a50014ec721d26f6dae6d411371c0242ea9cda41854cc9418e0f193dbc67 WatchSource:0}: Error finding container 1836a50014ec721d26f6dae6d411371c0242ea9cda41854cc9418e0f193dbc67: Status 404 returned error can't find the container with id 1836a50014ec721d26f6dae6d411371c0242ea9cda41854cc9418e0f193dbc67 Jul 17 18:16:46.551695 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:46.551659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" event={"ID":"d85a02e9-b311-4ace-b0f2-e9adf6f84af8","Type":"ContainerStarted","Data":"1836a50014ec721d26f6dae6d411371c0242ea9cda41854cc9418e0f193dbc67"} Jul 17 18:16:47.535175 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:47.535135 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:47.535362 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:47.535266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:47.535362 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:47.535317 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:16:47.535362 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:47.535330 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:16:47.535457 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:47.535382 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:55.535366661 +0000 UTC m=+59.579766884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:16:47.535457 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:47.535400 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:16:55.53539232 +0000 UTC m=+59.579792542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : configmap "kube-rbac-proxy" not found Jul 17 18:16:48.645089 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:48.645046 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:16:48.645498 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:48.645165 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:16:48.645498 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:48.645217 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:04.645203317 +0000 UTC m=+68.689603540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:16:49.249947 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:49.249910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:16:49.250180 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.250067 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:49.250180 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.250133 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:17:05.250118904 +0000 UTC m=+69.294519129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:16:49.350351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:49.350324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:49.350512 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:49.350470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:16:49.350512 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.350491 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:05.350475109 +0000 UTC m=+69.394875332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:16:49.350590 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.350542 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:16:49.350590 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.350583 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:05.350573533 +0000 UTC m=+69.394973755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:16:49.451467 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:49.451429 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:16:49.451626 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:49.451482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:16:49.451626 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.451557 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:16:49.451626 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.451573 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:16:49.451626 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.451580 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:16:49.451626 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.451619 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:05.451606583 +0000 UTC m=+69.496006806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:16:49.451782 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:49.451631 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:17:05.451625364 +0000 UTC m=+69.496025587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:16:55.608524 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:55.608482 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:55.608910 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:55.608560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:55.608910 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:55.608672 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:16:55.608910 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:55.608736 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:11.608723874 +0000 UTC m=+75.653124097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:16:55.609013 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:55.608994 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6691bd54-709b-4361-92ad-e7c89547b445-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:16:56.197632 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:56.197585 2569 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:03c882d6e2fdc5e17a12a2c9eb040d52e16fed48b5d81db08705fc0387d2fc47: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb31be76557a1f2b200de85ffdd284d8ffa6c1bd5d4bbcc9cd563a5da7130e61" Jul 17 18:16:56.197801 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:56.197715 2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container service-ca-controller start failed in pod service-ca-58598695f7-qzpsr_openshift-service-ca(d85a02e9-b311-4ace-b0f2-e9adf6f84af8): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:03c882d6e2fdc5e17a12a2c9eb040d52e16fed48b5d81db08705fc0387d2fc47: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 17 18:16:56.197801 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:56.197752 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-controller\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:03c882d6e2fdc5e17a12a2c9eb040d52e16fed48b5d81db08705fc0387d2fc47: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" podUID="d85a02e9-b311-4ace-b0f2-e9adf6f84af8" Jul 17 18:16:56.576773 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:16:56.576742 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fb31be76557a1f2b200de85ffdd284d8ffa6c1bd5d4bbcc9cd563a5da7130e61\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:03c882d6e2fdc5e17a12a2c9eb040d52e16fed48b5d81db08705fc0387d2fc47: fetching blob: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" podUID="d85a02e9-b311-4ace-b0f2-e9adf6f84af8" Jul 17 18:16:58.503924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:16:58.503895 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6xkb4" Jul 17 18:17:02.571682 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.571600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:17:02.574202 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.574180 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 18:17:02.582704 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:02.582678 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 17 18:17:02.582769 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:02.582759 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs podName:9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7 nodeName:}" failed. No retries permitted until 2026-07-17 18:18:06.582742691 +0000 UTC m=+130.627142916 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs") pod "network-metrics-daemon-kbhxf" (UID: "9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7") : secret "metrics-daemon-secret" not found Jul 17 18:17:02.672757 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.672716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:17:02.672953 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.672820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:17:02.675691 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.675662 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 18:17:02.675691 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.675704 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 18:17:02.686006 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.685978 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 18:17:02.686119 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.686006 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d259984a-d57a-40d6-98ad-5693f379467e-original-pull-secret\") pod \"global-pull-secret-syncer-gfpz4\" (UID: \"d259984a-d57a-40d6-98ad-5693f379467e\") " pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:17:02.696005 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.695980 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf5rg\" (UniqueName: \"kubernetes.io/projected/24fcb30d-b1a3-483d-8528-c3973f44cba8-kube-api-access-sf5rg\") pod \"network-check-target-tnlqv\" (UID: \"24fcb30d-b1a3-483d-8528-c3973f44cba8\") " pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:17:02.741572 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.741545 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vbqnh\"" Jul 17 18:17:02.749746 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.749721 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:17:02.844871 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.844843 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfpz4" Jul 17 18:17:02.876069 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.876034 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tnlqv"] Jul 17 18:17:02.879312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:02.879287 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24fcb30d_b1a3_483d_8528_c3973f44cba8.slice/crio-5bb1ce9e5985a901b91f5811682afaaab7f821ba3ded7c81fc2ae26320e90c4d WatchSource:0}: Error finding container 5bb1ce9e5985a901b91f5811682afaaab7f821ba3ded7c81fc2ae26320e90c4d: Status 404 returned error can't find the container with id 5bb1ce9e5985a901b91f5811682afaaab7f821ba3ded7c81fc2ae26320e90c4d Jul 17 18:17:02.970546 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:02.970508 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfpz4"] Jul 17 18:17:02.973471 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:02.973433 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd259984a_d57a_40d6_98ad_5693f379467e.slice/crio-77975886c24281839b14e63d99fd223b05cac5c7e2f9c803202adc823ef664b2 WatchSource:0}: Error finding container 77975886c24281839b14e63d99fd223b05cac5c7e2f9c803202adc823ef664b2: Status 404 returned error can't find the container with id 77975886c24281839b14e63d99fd223b05cac5c7e2f9c803202adc823ef664b2 Jul 17 18:17:03.594591 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:03.594548 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfpz4" event={"ID":"d259984a-d57a-40d6-98ad-5693f379467e","Type":"ContainerStarted","Data":"77975886c24281839b14e63d99fd223b05cac5c7e2f9c803202adc823ef664b2"} Jul 17 18:17:03.596203 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:03.596165 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tnlqv" event={"ID":"24fcb30d-b1a3-483d-8528-c3973f44cba8","Type":"ContainerStarted","Data":"5bb1ce9e5985a901b91f5811682afaaab7f821ba3ded7c81fc2ae26320e90c4d"} Jul 17 18:17:04.688814 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:04.688775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:17:04.689449 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:04.688962 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:17:04.689449 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:04.689040 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls podName:3f96ac85-0af3-4d7e-88c6-311f493ab742 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:36.689017407 +0000 UTC m=+100.733417633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls") pod "dns-default-vlpvt" (UID: "3f96ac85-0af3-4d7e-88c6-311f493ab742") : secret "dns-default-metrics-tls" not found Jul 17 18:17:05.295031 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:05.294976 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:17:05.295206 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.295140 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:17:05.295273 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.295215 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls podName:db200087-0d46-4376-8c08-77b87561c29d nodeName:}" failed. No retries permitted until 2026-07-17 18:17:37.295196109 +0000 UTC m=+101.339596336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-twrhp" (UID: "db200087-0d46-4376-8c08-77b87561c29d") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:17:05.395811 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:05.395762 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:05.396001 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:05.395837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:05.396001 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.395936 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:17:05.396112 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.396016 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:37.395996812 +0000 UTC m=+101.440397053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : configmap references non-existent config key: service-ca.crt Jul 17 18:17:05.396112 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.396037 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs podName:472565f6-6b10-4c1a-9fab-4bc337422849 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:37.396030015 +0000 UTC m=+101.440430237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs") pod "router-default-6d94db4774-hj7jp" (UID: "472565f6-6b10-4c1a-9fab-4bc337422849") : secret "router-metrics-certs-default" not found Jul 17 18:17:05.496688 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:05.496637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:17:05.496866 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.496819 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:17:05.496866 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:05.496834 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") pod \"image-registry-75fb88c44-4s6rv\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:17:05.496962 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.496896 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls podName:260d7b9c-87e1-4a00-b5dc-96039ca5a24c nodeName:}" failed. No retries permitted until 2026-07-17 18:17:37.496871735 +0000 UTC m=+101.541271980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wzkdq" (UID: "260d7b9c-87e1-4a00-b5dc-96039ca5a24c") : secret "samples-operator-tls" not found Jul 17 18:17:05.497028 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.496960 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:17:05.497028 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.496974 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75fb88c44-4s6rv: secret "image-registry-tls" not found Jul 17 18:17:05.497129 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:05.497057 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls podName:82a87092-3fc2-4ebd-a007-d1a02eb08011 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:37.497038238 +0000 UTC m=+101.541438500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls") pod "image-registry-75fb88c44-4s6rv" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011") : secret "image-registry-tls" not found Jul 17 18:17:06.690611 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.690555 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9"] Jul 17 18:17:06.706356 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.706043 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws"] Jul 17 18:17:06.707028 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.706996 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.709855 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.709830 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 17 18:17:06.710802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.710174 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 18:17:06.710802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.710195 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 18:17:06.710802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.710456 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 17 18:17:06.710802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.710506 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 17 18:17:06.710802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.710652 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 18:17:06.710802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.710743 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 17 18:17:06.720158 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.720137 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9"] Jul 17 18:17:06.720286 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.720170 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws"] Jul 17 18:17:06.720286 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.720274 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.722702 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.722680 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 18:17:06.807529 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807497 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxfx\" (UniqueName: \"kubernetes.io/projected/029aa7a7-ac98-4940-b117-9900744073ed-kube-api-access-lpxfx\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.807728 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807561 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-hub\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.807728 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/029aa7a7-ac98-4940-b117-9900744073ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.807728 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh97h\" (UniqueName: \"kubernetes.io/projected/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-kube-api-access-dh97h\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.807896 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807741 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-tmp\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.807896 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807792 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.807896 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807820 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.807896 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-ca\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.808095 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.807908 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-klusterlet-config\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.908574 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908534 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh97h\" (UniqueName: \"kubernetes.io/projected/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-kube-api-access-dh97h\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.908773 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908589 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-tmp\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.908773 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908640 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.908773 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908674 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.908773 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-ca\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.908773 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-klusterlet-config\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.909037 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908799 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxfx\" (UniqueName: \"kubernetes.io/projected/029aa7a7-ac98-4940-b117-9900744073ed-kube-api-access-lpxfx\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.909037 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.908843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-hub\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.909177 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.909147 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-tmp\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.909309 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.909209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/029aa7a7-ac98-4940-b117-9900744073ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.909868 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.909843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/029aa7a7-ac98-4940-b117-9900744073ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.911841 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.911795 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-ca\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.911945 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.911924 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.911990 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.911963 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-klusterlet-config\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.911990 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.911981 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.912730 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.912711 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/029aa7a7-ac98-4940-b117-9900744073ed-hub\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:06.920650 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.920625 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh97h\" (UniqueName: \"kubernetes.io/projected/a64cf5ad-652b-42e5-b7e2-8c18ee21fec1-kube-api-access-dh97h\") pod \"klusterlet-addon-workmgr-6585cbd954-zn9ws\" (UID: \"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:06.929826 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:06.929806 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxfx\" (UniqueName: \"kubernetes.io/projected/029aa7a7-ac98-4940-b117-9900744073ed-kube-api-access-lpxfx\") pod \"cluster-proxy-proxy-agent-69544874b6-5vnv9\" (UID: \"029aa7a7-ac98-4940-b117-9900744073ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:07.026346 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:07.026259 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:07.035542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:07.035508 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:07.982658 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:07.982627 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws"] Jul 17 18:17:07.986414 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:07.986384 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64cf5ad_652b_42e5_b7e2_8c18ee21fec1.slice/crio-017d204563932984be12406cdecbe0ec505993038cc0bff420e92a4a8678f456 WatchSource:0}: Error finding container 017d204563932984be12406cdecbe0ec505993038cc0bff420e92a4a8678f456: Status 404 returned error can't find the container with id 017d204563932984be12406cdecbe0ec505993038cc0bff420e92a4a8678f456 Jul 17 18:17:08.006095 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.006051 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9"] Jul 17 18:17:08.008607 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:08.008580 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod029aa7a7_ac98_4940_b117_9900744073ed.slice/crio-81ca41b23133d04b2dc809be448bfe78c4fa6276f7b4d2f3810fe8d4db987e16 WatchSource:0}: Error finding container 81ca41b23133d04b2dc809be448bfe78c4fa6276f7b4d2f3810fe8d4db987e16: Status 404 returned error can't find the container with id 81ca41b23133d04b2dc809be448bfe78c4fa6276f7b4d2f3810fe8d4db987e16 Jul 17 18:17:08.612714 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.612627 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" event={"ID":"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1","Type":"ContainerStarted","Data":"017d204563932984be12406cdecbe0ec505993038cc0bff420e92a4a8678f456"} Jul 17 18:17:08.614560 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.614507 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" event={"ID":"029aa7a7-ac98-4940-b117-9900744073ed","Type":"ContainerStarted","Data":"81ca41b23133d04b2dc809be448bfe78c4fa6276f7b4d2f3810fe8d4db987e16"} Jul 17 18:17:08.616295 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.616269 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfpz4" event={"ID":"d259984a-d57a-40d6-98ad-5693f379467e","Type":"ContainerStarted","Data":"8a6b639a3f774e91b997f59ed624cccb37bfc81d0528325f69b06a35eb4def20"} Jul 17 18:17:08.618423 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.618398 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tnlqv" event={"ID":"24fcb30d-b1a3-483d-8528-c3973f44cba8","Type":"ContainerStarted","Data":"7e8786beb50ab79beea637f4f88b4c8abe993b605a0aa14675eb7f0e6657fc28"} Jul 17 18:17:08.618614 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.618536 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:17:08.631792 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.631455 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gfpz4" podStartSLOduration=65.749364854 podStartE2EDuration="1m10.631433203s" totalImagesPullingTime="4.882068349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:08.630140218 +0000 UTC m=+72.674540487" watchObservedRunningTime="2026-07-17 18:17:08.631433203 +0000 UTC m=+72.675833444" Jul 17 18:17:08.646497 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:08.646435 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tnlqv" podStartSLOduration=66.680836842 podStartE2EDuration="1m11.64641471s" totalImagesPullingTime="4.965577868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:08.644663905 +0000 UTC m=+72.689064151" watchObservedRunningTime="2026-07-17 18:17:08.64641471 +0000 UTC m=+72.690814957" Jul 17 18:17:11.659391 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:11.659355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:17:11.659808 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:11.659481 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:17:11.659808 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:11.659545 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls podName:6691bd54-709b-4361-92ad-e7c89547b445 nodeName:}" failed. No retries permitted until 2026-07-17 18:17:43.659524151 +0000 UTC m=+107.703924375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmjr7" (UID: "6691bd54-709b-4361-92ad-e7c89547b445") : secret "insights-runtime-extractor-tls" not found Jul 17 18:17:12.638727 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:12.638687 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" event={"ID":"a64cf5ad-652b-42e5-b7e2-8c18ee21fec1","Type":"ContainerStarted","Data":"1c03137808e4e52889938054c182b9dece25847308658ce949f023e364a1c769"} Jul 17 18:17:12.638944 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:12.638873 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:12.640736 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:12.640711 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" Jul 17 18:17:12.640859 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:12.640802 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" event={"ID":"d85a02e9-b311-4ace-b0f2-e9adf6f84af8","Type":"ContainerStarted","Data":"a1944501f0ee264164048f922fd47ae7d162f427f2e657f48a00f2f8d8ccacd3"} Jul 17 18:17:12.655510 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:12.655446 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6585cbd954-zn9ws" podStartSLOduration=2.931739266 podStartE2EDuration="6.655426779s" totalImagesPullingTime="3.723687513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:12.655298554 +0000 UTC m=+76.699698800" watchObservedRunningTime="2026-07-17 18:17:12.655426779 +0000 UTC m=+76.699827026" Jul 17 18:17:12.687391 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:12.687334 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-qzpsr" podStartSLOduration=1.625413736 podStartE2EDuration="27.687314685s" totalImagesPullingTime="26.061900949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 18:17:12.686448755 +0000 UTC m=+76.730849002" watchObservedRunningTime="2026-07-17 18:17:12.687314685 +0000 UTC m=+76.731714931" Jul 17 18:17:15.653757 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:15.653718 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" event={"ID":"029aa7a7-ac98-4940-b117-9900744073ed","Type":"ContainerStarted","Data":"799daa9155a783bcf11fdb35dd2602084fc5b295069f265342b134a62076e46a"} Jul 17 18:17:15.653757 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:15.653760 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" event={"ID":"029aa7a7-ac98-4940-b117-9900744073ed","Type":"ContainerStarted","Data":"532006b1df30fb8ad825a82ae2765f707c2a592c54a5adf21e1b7157b2423c15"} Jul 17 18:17:15.654181 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:15.653774 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" event={"ID":"029aa7a7-ac98-4940-b117-9900744073ed","Type":"ContainerStarted","Data":"229adf53637788b7f82382eecb1910edec454ea869faa40dbfbfe6920cdc750f"} Jul 17 18:17:15.674947 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:15.674899 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" podStartSLOduration=2.969480847 podStartE2EDuration="9.674882493s" totalImagesPullingTime="6.705401646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:15.674325037 +0000 UTC m=+79.718725283" watchObservedRunningTime="2026-07-17 18:17:15.674882493 +0000 UTC m=+79.719282738" Jul 17 18:17:16.969612 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:16.969577 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75fb88c44-4s6rv"] Jul 17 18:17:16.970003 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:17:16.969835 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" podUID="82a87092-3fc2-4ebd-a007-d1a02eb08011" Jul 17 18:17:17.029215 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.029168 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" podUID="029aa7a7-ac98-4940-b117-9900744073ed" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 17 18:17:17.661488 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.661458 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:17:17.666944 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.666924 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:17:17.715449 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715413 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-image-registry-private-configuration\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715449 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715453 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a87092-3fc2-4ebd-a007-d1a02eb08011-ca-trust-extracted\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715732 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715493 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t567z\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-kube-api-access-t567z\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715732 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715519 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-certificates\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715732 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715562 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-bound-sa-token\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715732 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715589 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-trusted-ca\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715868 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715740 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-installation-pull-secrets\") pod \"82a87092-3fc2-4ebd-a007-d1a02eb08011\" (UID: \"82a87092-3fc2-4ebd-a007-d1a02eb08011\") " Jul 17 18:17:17.715868 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.715798 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a87092-3fc2-4ebd-a007-d1a02eb08011-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:17.716071 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.716055 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82a87092-3fc2-4ebd-a007-d1a02eb08011-ca-trust-extracted\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:17.716399 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.716372 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:17:17.716565 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.716539 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:17:17.717940 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.717911 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:17:17.718158 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.718127 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:17:17.718303 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.718209 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-kube-api-access-t567z" (OuterVolumeSpecName: "kube-api-access-t567z") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "kube-api-access-t567z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:17.718511 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.718492 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82a87092-3fc2-4ebd-a007-d1a02eb08011" (UID: "82a87092-3fc2-4ebd-a007-d1a02eb08011"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:17.817417 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.817278 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-installation-pull-secrets\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:17.817417 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.817308 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82a87092-3fc2-4ebd-a007-d1a02eb08011-image-registry-private-configuration\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:17.817417 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.817319 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t567z\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-kube-api-access-t567z\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:17.817417 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.817328 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-certificates\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:17.817417 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.817338 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-bound-sa-token\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:17.817417 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:17.817346 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82a87092-3fc2-4ebd-a007-d1a02eb08011-trusted-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:18.664481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:18.664452 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fb88c44-4s6rv" Jul 17 18:17:18.694817 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:18.694788 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75fb88c44-4s6rv"] Jul 17 18:17:18.698693 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:18.698666 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75fb88c44-4s6rv"] Jul 17 18:17:18.724082 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:18.724051 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82a87092-3fc2-4ebd-a007-d1a02eb08011-registry-tls\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:17:19.329922 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:19.329877 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a87092-3fc2-4ebd-a007-d1a02eb08011" path="/var/lib/kubelet/pods/82a87092-3fc2-4ebd-a007-d1a02eb08011/volumes" Jul 17 18:17:27.027331 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:27.027286 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" podUID="029aa7a7-ac98-4940-b117-9900744073ed" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 17 18:17:36.775414 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:36.775318 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:17:36.777756 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:36.777731 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3f96ac85-0af3-4d7e-88c6-311f493ab742-metrics-tls\") pod \"dns-default-vlpvt\" (UID: \"3f96ac85-0af3-4d7e-88c6-311f493ab742\") " pod="openshift-dns/dns-default-vlpvt" Jul 17 18:17:37.028115 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.028036 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" podUID="029aa7a7-ac98-4940-b117-9900744073ed" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 17 18:17:37.028115 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.028104 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" Jul 17 18:17:37.028627 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.028593 2569 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"799daa9155a783bcf11fdb35dd2602084fc5b295069f265342b134a62076e46a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 17 18:17:37.028673 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.028648 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" podUID="029aa7a7-ac98-4940-b117-9900744073ed" containerName="service-proxy" containerID="cri-o://799daa9155a783bcf11fdb35dd2602084fc5b295069f265342b134a62076e46a" gracePeriod=30 Jul 17 18:17:37.034408 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.034390 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-psc8s\"" Jul 17 18:17:37.042308 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.042283 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vlpvt" Jul 17 18:17:37.169518 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.169490 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vlpvt"] Jul 17 18:17:37.172493 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:37.172464 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f96ac85_0af3_4d7e_88c6_311f493ab742.slice/crio-1eee5e6f22a2de23e76db8779a40ac49092049dfcfe5e6c65c54f9db8db59286 WatchSource:0}: Error finding container 1eee5e6f22a2de23e76db8779a40ac49092049dfcfe5e6c65c54f9db8db59286: Status 404 returned error can't find the container with id 1eee5e6f22a2de23e76db8779a40ac49092049dfcfe5e6c65c54f9db8db59286 Jul 17 18:17:37.380295 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.380231 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:17:37.382588 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.382560 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db200087-0d46-4376-8c08-77b87561c29d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-twrhp\" (UID: \"db200087-0d46-4376-8c08-77b87561c29d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:17:37.426707 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.426680 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xq8wp\"" Jul 17 18:17:37.434925 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.434902 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" Jul 17 18:17:37.480758 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.480724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:37.480934 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.480774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:37.481550 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.481525 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/472565f6-6b10-4c1a-9fab-4bc337422849-service-ca-bundle\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:37.483811 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.483777 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/472565f6-6b10-4c1a-9fab-4bc337422849-metrics-certs\") pod \"router-default-6d94db4774-hj7jp\" (UID: \"472565f6-6b10-4c1a-9fab-4bc337422849\") " pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:37.498510 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.498150 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wgtzf\"" Jul 17 18:17:37.506517 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.506400 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:37.581370 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.581342 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:17:37.585208 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.584851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/260d7b9c-87e1-4a00-b5dc-96039ca5a24c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wzkdq\" (UID: \"260d7b9c-87e1-4a00-b5dc-96039ca5a24c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:17:37.585791 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.585765 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp"] Jul 17 18:17:37.588737 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:37.588707 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb200087_0d46_4376_8c08_77b87561c29d.slice/crio-72e9ff35c58fe7d4d98902dc6bdf33ad6821948fe4569681193b7088840900a6 WatchSource:0}: Error finding container 72e9ff35c58fe7d4d98902dc6bdf33ad6821948fe4569681193b7088840900a6: Status 404 returned error can't find the container with id 72e9ff35c58fe7d4d98902dc6bdf33ad6821948fe4569681193b7088840900a6 Jul 17 18:17:37.599593 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.599567 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j7sz2\"" Jul 17 18:17:37.607571 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.607538 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" Jul 17 18:17:37.663906 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.663823 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d94db4774-hj7jp"] Jul 17 18:17:37.667447 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:37.667422 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472565f6_6b10_4c1a_9fab_4bc337422849.slice/crio-1c47c808f2501dc5cdd9b8115b06d638b44b3396e739fcf76898079f0ae397b2 WatchSource:0}: Error finding container 1c47c808f2501dc5cdd9b8115b06d638b44b3396e739fcf76898079f0ae397b2: Status 404 returned error can't find the container with id 1c47c808f2501dc5cdd9b8115b06d638b44b3396e739fcf76898079f0ae397b2 Jul 17 18:17:37.733456 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.733420 2569 generic.go:356] "Generic (PLEG): container finished" podID="029aa7a7-ac98-4940-b117-9900744073ed" containerID="799daa9155a783bcf11fdb35dd2602084fc5b295069f265342b134a62076e46a" exitCode=2 Jul 17 18:17:37.733576 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.733496 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" event={"ID":"029aa7a7-ac98-4940-b117-9900744073ed","Type":"ContainerDied","Data":"799daa9155a783bcf11fdb35dd2602084fc5b295069f265342b134a62076e46a"} Jul 17 18:17:37.733576 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.733550 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69544874b6-5vnv9" event={"ID":"029aa7a7-ac98-4940-b117-9900744073ed","Type":"ContainerStarted","Data":"21601b74d2617b185e1adc64dde539c8dcbc25ebe8fdc339b69a7f91c85bc7c7"} Jul 17 18:17:37.736191 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.736122 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" event={"ID":"db200087-0d46-4376-8c08-77b87561c29d","Type":"ContainerStarted","Data":"72e9ff35c58fe7d4d98902dc6bdf33ad6821948fe4569681193b7088840900a6"} Jul 17 18:17:37.737815 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.737717 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vlpvt" event={"ID":"3f96ac85-0af3-4d7e-88c6-311f493ab742","Type":"ContainerStarted","Data":"1eee5e6f22a2de23e76db8779a40ac49092049dfcfe5e6c65c54f9db8db59286"} Jul 17 18:17:37.739935 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.739911 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d94db4774-hj7jp" event={"ID":"472565f6-6b10-4c1a-9fab-4bc337422849","Type":"ContainerStarted","Data":"1c47c808f2501dc5cdd9b8115b06d638b44b3396e739fcf76898079f0ae397b2"} Jul 17 18:17:37.762627 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:37.762590 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq"] Jul 17 18:17:38.746376 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:38.746329 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d94db4774-hj7jp" event={"ID":"472565f6-6b10-4c1a-9fab-4bc337422849","Type":"ContainerStarted","Data":"d73e72fea006b106a411559bffe572fbfd21943161b07a4c390bf17d8b9842cc"} Jul 17 18:17:38.748284 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:38.748233 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" event={"ID":"260d7b9c-87e1-4a00-b5dc-96039ca5a24c","Type":"ContainerStarted","Data":"9c7198a6d5baa6942aad1f66ab49cdd2c2cd0bcf3137096d7583246e46338ca2"} Jul 17 18:17:38.766157 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:38.766110 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d94db4774-hj7jp" podStartSLOduration=65.766093987 podStartE2EDuration="1m5.766093987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:38.765136329 +0000 UTC m=+102.809536574" watchObservedRunningTime="2026-07-17 18:17:38.766093987 +0000 UTC m=+102.810494210" Jul 17 18:17:39.506950 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.506910 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:39.509989 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.509970 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:39.625645 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.625616 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tnlqv" Jul 17 18:17:39.754139 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.754055 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vlpvt" event={"ID":"3f96ac85-0af3-4d7e-88c6-311f493ab742","Type":"ContainerStarted","Data":"458f013dec6dc47621f1e3470da2234a2d6b08ba09121254a17b1d2f29d53390"} Jul 17 18:17:39.754139 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.754121 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vlpvt" event={"ID":"3f96ac85-0af3-4d7e-88c6-311f493ab742","Type":"ContainerStarted","Data":"a79be993198ec9b3be24b68f20c662aec8a4528efb4a3f9af8051b61640931d1"} Jul 17 18:17:39.754656 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.754304 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:39.755522 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.755501 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d94db4774-hj7jp" Jul 17 18:17:39.773493 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:39.771494 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vlpvt" podStartSLOduration=66.240688885 podStartE2EDuration="1m7.771474944s" totalImagesPullingTime="1.530786059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:39.770066974 +0000 UTC m=+103.814467222" watchObservedRunningTime="2026-07-17 18:17:39.771474944 +0000 UTC m=+103.815875190" Jul 17 18:17:40.758843 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:40.758809 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" event={"ID":"db200087-0d46-4376-8c08-77b87561c29d","Type":"ContainerStarted","Data":"b5f0359d20a70918bfb1d765760f6748608d7d3864402cdf930cf25b85a5b290"} Jul 17 18:17:40.759224 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:40.759202 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vlpvt" Jul 17 18:17:40.776495 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:40.776449 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-twrhp" podStartSLOduration=65.019555994 podStartE2EDuration="1m7.776433246s" totalImagesPullingTime="2.756877252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:40.775634714 +0000 UTC m=+104.820034960" watchObservedRunningTime="2026-07-17 18:17:40.776433246 +0000 UTC m=+104.820833490" Jul 17 18:17:41.764338 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:41.764294 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" event={"ID":"260d7b9c-87e1-4a00-b5dc-96039ca5a24c","Type":"ContainerStarted","Data":"94772cbe363992087c4d82a39d05cfc1b807aa497fa8025126853d6ed5113dbf"} Jul 17 18:17:41.764829 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:41.764360 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" event={"ID":"260d7b9c-87e1-4a00-b5dc-96039ca5a24c","Type":"ContainerStarted","Data":"fe47a90fa87478233d72e2dba0c5af04db039dee0bf3bc21c2e2e45cd0885802"} Jul 17 18:17:41.780191 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:41.780143 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wzkdq" podStartSLOduration=65.912060942 podStartE2EDuration="1m8.78012739s" totalImagesPullingTime="2.868066448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:41.780089662 +0000 UTC m=+105.824489909" watchObservedRunningTime="2026-07-17 18:17:41.78012739 +0000 UTC m=+105.824527637" Jul 17 18:17:43.738079 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:43.738032 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:17:43.740410 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:43.740371 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6691bd54-709b-4361-92ad-e7c89547b445-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmjr7\" (UID: \"6691bd54-709b-4361-92ad-e7c89547b445\") " pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:17:44.040727 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:44.040644 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hs4xv\"" Jul 17 18:17:44.049584 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:44.049553 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmjr7" Jul 17 18:17:44.214267 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:44.214213 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmjr7"] Jul 17 18:17:44.219152 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:17:44.219124 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6691bd54_709b_4361_92ad_e7c89547b445.slice/crio-b29284ec976a656e64db5400a23b6bb493af5d27e630e60e5801d3c836386e32 WatchSource:0}: Error finding container b29284ec976a656e64db5400a23b6bb493af5d27e630e60e5801d3c836386e32: Status 404 returned error can't find the container with id b29284ec976a656e64db5400a23b6bb493af5d27e630e60e5801d3c836386e32 Jul 17 18:17:44.775779 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:44.775731 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmjr7" event={"ID":"6691bd54-709b-4361-92ad-e7c89547b445","Type":"ContainerStarted","Data":"b29284ec976a656e64db5400a23b6bb493af5d27e630e60e5801d3c836386e32"} Jul 17 18:17:49.794157 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:49.794098 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmjr7" event={"ID":"6691bd54-709b-4361-92ad-e7c89547b445","Type":"ContainerStarted","Data":"8e4025a3e4a20bebbc06214b9fa82197cc24238e8a06eca7a7dc9749c064302f"} Jul 17 18:17:50.767330 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:50.767298 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vlpvt" Jul 17 18:17:53.811351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:53.811310 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmjr7" event={"ID":"6691bd54-709b-4361-92ad-e7c89547b445","Type":"ContainerStarted","Data":"cf859129b4bb037797b43016329b81a0391b671670b205e83049e535d222ffbb"} Jul 17 18:17:53.813052 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:53.813028 2569 generic.go:356] "Generic (PLEG): container finished" podID="ad86a254-7536-48bd-a04d-1ab8ca0aae06" containerID="7e404fe103efb626fbe7955b7006fda91fcf293f397637ed1950ea925cacb49a" exitCode=0 Jul 17 18:17:53.813184 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:53.813070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" event={"ID":"ad86a254-7536-48bd-a04d-1ab8ca0aae06","Type":"ContainerDied","Data":"7e404fe103efb626fbe7955b7006fda91fcf293f397637ed1950ea925cacb49a"} Jul 17 18:17:53.813415 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:53.813399 2569 scope.go:117] "RemoveContainer" containerID="7e404fe103efb626fbe7955b7006fda91fcf293f397637ed1950ea925cacb49a" Jul 17 18:17:54.819308 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:54.819272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-lts7k" event={"ID":"ad86a254-7536-48bd-a04d-1ab8ca0aae06","Type":"ContainerStarted","Data":"89b1a2319db50e32637e839b697545c65ba90387769fd157bce2aaad2c5cb2bb"} Jul 17 18:17:56.827721 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:56.827680 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmjr7" event={"ID":"6691bd54-709b-4361-92ad-e7c89547b445","Type":"ContainerStarted","Data":"f3de62aee77d7720785808ecbf23c1fca333e958a82efdee50bcfe4ee377a81c"} Jul 17 18:17:56.848677 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:17:56.848612 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bmjr7" podStartSLOduration=65.640711142 podStartE2EDuration="1m17.848597216s" totalImagesPullingTime="12.207886074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:16:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:56.847756157 +0000 UTC m=+120.892156392" watchObservedRunningTime="2026-07-17 18:17:56.848597216 +0000 UTC m=+120.892997461" Jul 17 18:18:00.319320 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.319280 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nzbmb"] Jul 17 18:18:00.322762 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.322721 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.325552 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.325458 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 18:18:00.325552 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.325529 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 18:18:00.326437 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.326287 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 18:18:00.326542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.326514 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l97pb\"" Jul 17 18:18:00.337852 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.333964 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 18:18:00.337852 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.337709 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d94db4774-hj7jp_472565f6-6b10-4c1a-9fab-4bc337422849/router/0.log" Jul 17 18:18:00.356828 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.356801 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5vvd7_71a328f6-a7af-44a0-9494-eb4c5c9d8ef6/serve-healthcheck-canary/0.log" Jul 17 18:18:00.379831 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.379793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-root\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.379831 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.379835 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380043 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.379862 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-metrics-client-ca\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380043 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.379982 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-wtmp\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380102 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.380050 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-sys\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380102 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.380093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-textfile\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380166 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.380123 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380199 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.380164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cxht\" (UniqueName: \"kubernetes.io/projected/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-kube-api-access-9cxht\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.380234 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.380199 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-tls\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481511 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481477 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481511 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481514 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-metrics-client-ca\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-wtmp\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481570 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-sys\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481605 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-textfile\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481633 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481654 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cxht\" (UniqueName: \"kubernetes.io/projected/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-kube-api-access-9cxht\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-tls\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481724 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-sys\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.481753 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481741 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-root\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.482074 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-root\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.482074 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.481982 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-textfile\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.482074 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.482039 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-wtmp\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.482179 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.482158 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-metrics-client-ca\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.482217 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.482170 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-accelerators-collector-config\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.483914 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.483894 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.484106 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.484087 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-node-exporter-tls\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.490378 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.490358 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cxht\" (UniqueName: \"kubernetes.io/projected/c7e92c0a-6b34-4426-b680-a56c5ae9f5df-kube-api-access-9cxht\") pod \"node-exporter-nzbmb\" (UID: \"c7e92c0a-6b34-4426-b680-a56c5ae9f5df\") " pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.642046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.641958 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nzbmb" Jul 17 18:18:00.651939 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:18:00.651907 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e92c0a_6b34_4426_b680_a56c5ae9f5df.slice/crio-15a20e24f83d3cc1843ec361d0dde4bc3d7992deb312ee0f408b85432aeac242 WatchSource:0}: Error finding container 15a20e24f83d3cc1843ec361d0dde4bc3d7992deb312ee0f408b85432aeac242: Status 404 returned error can't find the container with id 15a20e24f83d3cc1843ec361d0dde4bc3d7992deb312ee0f408b85432aeac242 Jul 17 18:18:00.842116 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:00.842081 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzbmb" event={"ID":"c7e92c0a-6b34-4426-b680-a56c5ae9f5df","Type":"ContainerStarted","Data":"15a20e24f83d3cc1843ec361d0dde4bc3d7992deb312ee0f408b85432aeac242"} Jul 17 18:18:02.851112 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:02.851074 2569 generic.go:356] "Generic (PLEG): container finished" podID="c7e92c0a-6b34-4426-b680-a56c5ae9f5df" containerID="11db51a13710e52192ddf4ce98a8af0578225119ff9ecf18f23beb554c29cf07" exitCode=0 Jul 17 18:18:02.851547 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:02.851155 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzbmb" event={"ID":"c7e92c0a-6b34-4426-b680-a56c5ae9f5df","Type":"ContainerDied","Data":"11db51a13710e52192ddf4ce98a8af0578225119ff9ecf18f23beb554c29cf07"} Jul 17 18:18:03.856773 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:03.856733 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzbmb" event={"ID":"c7e92c0a-6b34-4426-b680-a56c5ae9f5df","Type":"ContainerStarted","Data":"e8383da9ccbbee4e297690fd7582ef056f02c2aa3a2ebfd498d25aec1f3386da"} Jul 17 18:18:03.857148 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:03.856798 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nzbmb" event={"ID":"c7e92c0a-6b34-4426-b680-a56c5ae9f5df","Type":"ContainerStarted","Data":"2844fd13098e1ea76b3054792e2da7d59bb3e2b8c80128b826e69cfbb7e328be"} Jul 17 18:18:03.878505 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:03.878438 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nzbmb" podStartSLOduration=2.5185981870000003 podStartE2EDuration="3.878420752s" totalImagesPullingTime="1.292395008s" totalInitContainerRuntime="67.427557ms" isStatefulPod=true podCreationTimestamp="2026-07-17 18:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:03.877000901 +0000 UTC m=+127.921401146" watchObservedRunningTime="2026-07-17 18:18:03.878420752 +0000 UTC m=+127.922820997" Jul 17 18:18:06.630368 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:06.630330 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:18:06.632674 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:06.632646 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7-metrics-certs\") pod \"network-metrics-daemon-kbhxf\" (UID: \"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7\") " pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:18:06.741704 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:06.741674 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g2h6g\"" Jul 17 18:18:06.749577 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:06.749558 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbhxf" Jul 17 18:18:06.882144 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:06.882051 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kbhxf"] Jul 17 18:18:06.885484 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:18:06.885451 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2dc37a_66d3_49ed_a5cb_bf6dfd2255d7.slice/crio-cd1d62a2c1dd294a9a10b559794e5c34fd2d4ed5f562ce232b0b653b3988c91f WatchSource:0}: Error finding container cd1d62a2c1dd294a9a10b559794e5c34fd2d4ed5f562ce232b0b653b3988c91f: Status 404 returned error can't find the container with id cd1d62a2c1dd294a9a10b559794e5c34fd2d4ed5f562ce232b0b653b3988c91f Jul 17 18:18:07.871760 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:07.871705 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kbhxf" event={"ID":"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7","Type":"ContainerStarted","Data":"c40a412ea4608a77e25b5f0c57bacab518eb0d8b75a022536cab316bf0e40f20"} Jul 17 18:18:07.872120 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:07.871772 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kbhxf" event={"ID":"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7","Type":"ContainerStarted","Data":"cd1d62a2c1dd294a9a10b559794e5c34fd2d4ed5f562ce232b0b653b3988c91f"} Jul 17 18:18:08.876960 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:08.876921 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kbhxf" event={"ID":"9f2dc37a-66d3-49ed-a5cb-bf6dfd2255d7","Type":"ContainerStarted","Data":"2f79f0a68e65b05a920f3a4724132c0681c8ee2ba55c5a15659df80ff2eac17c"} Jul 17 18:18:08.892972 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:18:08.892914 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kbhxf" podStartSLOduration=131.030506244 podStartE2EDuration="2m11.892892907s" totalImagesPullingTime="862.386663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:08.891368778 +0000 UTC m=+132.935769014" watchObservedRunningTime="2026-07-17 18:18:08.892892907 +0000 UTC m=+132.937293148" Jul 17 18:20:56.692471 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:20:56.692443 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 18:21:44.941713 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.941678 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f"] Jul 17 18:21:44.944924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.944906 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:44.948330 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.948307 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 18:21:44.949093 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.949060 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-744kp\"" Jul 17 18:21:44.949093 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.949075 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 18:21:44.949318 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.949305 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 18:21:44.957206 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.957187 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 18:21:44.975073 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:44.975038 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f"] Jul 17 18:21:45.012125 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.012083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44a716fa-afb5-48a5-b905-cb6b3bc97715-manifests\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.012125 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.012126 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44a716fa-afb5-48a5-b905-cb6b3bc97715-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.012420 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.012148 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44a716fa-afb5-48a5-b905-cb6b3bc97715-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.012420 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.012166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44a716fa-afb5-48a5-b905-cb6b3bc97715-tmp\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.012420 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.012324 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvbz\" (UniqueName: \"kubernetes.io/projected/44a716fa-afb5-48a5-b905-cb6b3bc97715-kube-api-access-pbvbz\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.113131 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.113088 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvbz\" (UniqueName: \"kubernetes.io/projected/44a716fa-afb5-48a5-b905-cb6b3bc97715-kube-api-access-pbvbz\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.113369 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.113159 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44a716fa-afb5-48a5-b905-cb6b3bc97715-manifests\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.113369 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.113279 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44a716fa-afb5-48a5-b905-cb6b3bc97715-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.113369 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.113307 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44a716fa-afb5-48a5-b905-cb6b3bc97715-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.113369 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.113333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44a716fa-afb5-48a5-b905-cb6b3bc97715-tmp\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.113645 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.113619 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/44a716fa-afb5-48a5-b905-cb6b3bc97715-manifests\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.115633 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.115610 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44a716fa-afb5-48a5-b905-cb6b3bc97715-tmp\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.115749 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.115730 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/44a716fa-afb5-48a5-b905-cb6b3bc97715-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.115913 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.115896 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/44a716fa-afb5-48a5-b905-cb6b3bc97715-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.125020 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.124996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvbz\" (UniqueName: \"kubernetes.io/projected/44a716fa-afb5-48a5-b905-cb6b3bc97715-kube-api-access-pbvbz\") pod \"opendatahub-operator-controller-manager-65c97dcbdf-5ls5f\" (UID: \"44a716fa-afb5-48a5-b905-cb6b3bc97715\") " pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.254975 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.254888 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:45.390099 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.390060 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f"] Jul 17 18:21:45.393495 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:21:45.393465 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a716fa_afb5_48a5_b905_cb6b3bc97715.slice/crio-2616f66f81310d9b954f70578deb6fade66cc60a72d11d237543d0b1e641967f WatchSource:0}: Error finding container 2616f66f81310d9b954f70578deb6fade66cc60a72d11d237543d0b1e641967f: Status 404 returned error can't find the container with id 2616f66f81310d9b954f70578deb6fade66cc60a72d11d237543d0b1e641967f Jul 17 18:21:45.395226 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.395211 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:21:45.636481 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:45.636444 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" event={"ID":"44a716fa-afb5-48a5-b905-cb6b3bc97715","Type":"ContainerStarted","Data":"2616f66f81310d9b954f70578deb6fade66cc60a72d11d237543d0b1e641967f"} Jul 17 18:21:48.650174 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:48.650132 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" event={"ID":"44a716fa-afb5-48a5-b905-cb6b3bc97715","Type":"ContainerStarted","Data":"47fb76629e488fa1b8752f531a29f21aba1e0d3946e40a6e592b739b6dc4fb93"} Jul 17 18:21:50.659894 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:50.659847 2569 generic.go:356] "Generic (PLEG): container finished" podID="44a716fa-afb5-48a5-b905-cb6b3bc97715" containerID="47fb76629e488fa1b8752f531a29f21aba1e0d3946e40a6e592b739b6dc4fb93" exitCode=0 Jul 17 18:21:50.660429 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:50.659909 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" event={"ID":"44a716fa-afb5-48a5-b905-cb6b3bc97715","Type":"ContainerDied","Data":"47fb76629e488fa1b8752f531a29f21aba1e0d3946e40a6e592b739b6dc4fb93"} Jul 17 18:21:51.665091 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:51.665054 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" event={"ID":"44a716fa-afb5-48a5-b905-cb6b3bc97715","Type":"ContainerStarted","Data":"c9efc1f5f881c98f3cba7351f80b703700485396ca27c7abbc3bbedc3cf43f15"} Jul 17 18:21:51.665544 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:51.665309 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:21:51.687488 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:21:51.687442 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" podStartSLOduration=3.008529598 podStartE2EDuration="7.687426809s" totalImagesPullingTime="3.59581235s" totalInitContainerRuntime="1.083084861s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:21:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:21:51.686101602 +0000 UTC m=+355.730501846" watchObservedRunningTime="2026-07-17 18:21:51.687426809 +0000 UTC m=+355.731827054" Jul 17 18:22:02.672620 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:02.672586 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65c97dcbdf-5ls5f" Jul 17 18:22:05.150799 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.150760 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb"] Jul 17 18:22:05.161929 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.161908 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.165056 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.165035 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-562wt\"" Jul 17 18:22:05.165056 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.165047 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 17 18:22:05.165442 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.165425 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 18:22:05.181931 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.181905 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb"] Jul 17 18:22:05.275694 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.275658 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998d38d7-c0f1-40e2-9296-390188d093ed-tmp\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.275887 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.275727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/998d38d7-c0f1-40e2-9296-390188d093ed-tls-certs\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.275887 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.275752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7kx\" (UniqueName: \"kubernetes.io/projected/998d38d7-c0f1-40e2-9296-390188d093ed-kube-api-access-2p7kx\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.376818 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.376773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998d38d7-c0f1-40e2-9296-390188d093ed-tmp\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.377023 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.376839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/998d38d7-c0f1-40e2-9296-390188d093ed-tls-certs\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.377023 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.376865 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7kx\" (UniqueName: \"kubernetes.io/projected/998d38d7-c0f1-40e2-9296-390188d093ed-kube-api-access-2p7kx\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.379163 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.379139 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998d38d7-c0f1-40e2-9296-390188d093ed-tmp\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.379322 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.379304 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/998d38d7-c0f1-40e2-9296-390188d093ed-tls-certs\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.396029 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.396002 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7kx\" (UniqueName: \"kubernetes.io/projected/998d38d7-c0f1-40e2-9296-390188d093ed-kube-api-access-2p7kx\") pod \"kube-auth-proxy-55dd66f79f-qr4jb\" (UID: \"998d38d7-c0f1-40e2-9296-390188d093ed\") " pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.472445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.472354 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" Jul 17 18:22:05.487131 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.487105 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zlnm"] Jul 17 18:22:05.489512 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.489493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:05.492215 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.492190 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 17 18:22:05.492340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.492210 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tdlbd\"" Jul 17 18:22:05.502975 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.502902 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zlnm"] Jul 17 18:22:05.578380 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.578167 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da711e8-e662-4752-8c58-3b589def1aab-cert\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:05.578380 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.578221 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztvj\" (UniqueName: \"kubernetes.io/projected/7da711e8-e662-4752-8c58-3b589def1aab-kube-api-access-dztvj\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:05.611457 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.611431 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb"] Jul 17 18:22:05.614112 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:22:05.614071 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998d38d7_c0f1_40e2_9296_390188d093ed.slice/crio-01ec11ea9c4b63875dc15c671b9baf2ffbecb51a252037fa4001c234c1ab1f04 WatchSource:0}: Error finding container 01ec11ea9c4b63875dc15c671b9baf2ffbecb51a252037fa4001c234c1ab1f04: Status 404 returned error can't find the container with id 01ec11ea9c4b63875dc15c671b9baf2ffbecb51a252037fa4001c234c1ab1f04 Jul 17 18:22:05.679752 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.679721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da711e8-e662-4752-8c58-3b589def1aab-cert\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:05.679752 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.679758 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztvj\" (UniqueName: \"kubernetes.io/projected/7da711e8-e662-4752-8c58-3b589def1aab-kube-api-access-dztvj\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:05.679960 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:22:05.679890 2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 17 18:22:05.679999 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:22:05.679965 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da711e8-e662-4752-8c58-3b589def1aab-cert podName:7da711e8-e662-4752-8c58-3b589def1aab nodeName:}" failed. No retries permitted until 2026-07-17 18:22:06.17994385 +0000 UTC m=+370.224344079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7da711e8-e662-4752-8c58-3b589def1aab-cert") pod "odh-model-controller-7998c67dc4-9zlnm" (UID: "7da711e8-e662-4752-8c58-3b589def1aab") : secret "odh-model-controller-webhook-cert" not found Jul 17 18:22:05.693171 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.693145 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztvj\" (UniqueName: \"kubernetes.io/projected/7da711e8-e662-4752-8c58-3b589def1aab-kube-api-access-dztvj\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:05.713993 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:05.713959 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" event={"ID":"998d38d7-c0f1-40e2-9296-390188d093ed","Type":"ContainerStarted","Data":"01ec11ea9c4b63875dc15c671b9baf2ffbecb51a252037fa4001c234c1ab1f04"} Jul 17 18:22:06.182938 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.182899 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da711e8-e662-4752-8c58-3b589def1aab-cert\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:06.185399 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.185368 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7da711e8-e662-4752-8c58-3b589def1aab-cert\") pod \"odh-model-controller-7998c67dc4-9zlnm\" (UID: \"7da711e8-e662-4752-8c58-3b589def1aab\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:06.321406 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.321363 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mfxcs"] Jul 17 18:22:06.324164 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.324144 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.326495 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.326470 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 17 18:22:06.344440 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.344408 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mfxcs"] Jul 17 18:22:06.385467 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.385423 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.385631 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.385482 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpqq\" (UniqueName: \"kubernetes.io/projected/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-kube-api-access-jhpqq\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.405450 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.405407 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:06.487206 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.486713 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.487206 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.486776 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpqq\" (UniqueName: \"kubernetes.io/projected/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-kube-api-access-jhpqq\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.487206 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:22:06.487120 2569 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 17 18:22:06.487206 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:22:06.487195 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-tls-certs podName:fffafcc0-a8e2-4d57-92e4-6f32a3cc731d nodeName:}" failed. No retries permitted until 2026-07-17 18:22:06.987174073 +0000 UTC m=+371.031574300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-tls-certs") pod "model-serving-api-54d89bd5fc-mfxcs" (UID: "fffafcc0-a8e2-4d57-92e4-6f32a3cc731d") : secret "model-serving-api-tls" not found Jul 17 18:22:06.497694 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.497657 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpqq\" (UniqueName: \"kubernetes.io/projected/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-kube-api-access-jhpqq\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.582540 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.582195 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zlnm"] Jul 17 18:22:06.585528 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:22:06.585493 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da711e8_e662_4752_8c58_3b589def1aab.slice/crio-b3dab0e440c3600dfdec386d4f796132ef07f159f3de6e23ee0f3a73c4baad3e WatchSource:0}: Error finding container b3dab0e440c3600dfdec386d4f796132ef07f159f3de6e23ee0f3a73c4baad3e: Status 404 returned error can't find the container with id b3dab0e440c3600dfdec386d4f796132ef07f159f3de6e23ee0f3a73c4baad3e Jul 17 18:22:06.719209 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.719119 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" event={"ID":"7da711e8-e662-4752-8c58-3b589def1aab","Type":"ContainerStarted","Data":"b3dab0e440c3600dfdec386d4f796132ef07f159f3de6e23ee0f3a73c4baad3e"} Jul 17 18:22:06.741031 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.740995 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzvll"] Jul 17 18:22:06.744168 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.744150 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.747341 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.747311 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 18:22:06.747341 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.747332 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kxw6g\"" Jul 17 18:22:06.747505 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.747386 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 18:22:06.747505 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.747396 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 18:22:06.748551 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.748533 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 18:22:06.767534 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.763558 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzvll"] Jul 17 18:22:06.889409 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.889574 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889421 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.889574 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.889574 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpt6\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-kube-api-access-jnpt6\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.889709 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.889709 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889694 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.889815 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.889725 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.990888 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.990789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.990888 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.990844 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.990888 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.990883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.991154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.990925 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.991154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.990967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpt6\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-kube-api-access-jnpt6\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.991154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.991008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.991154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.991041 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.991154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.991082 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.992271 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.992215 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.993899 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.993857 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-local-certs\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.994040 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.993956 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.994040 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.994030 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.994165 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.994083 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-cacerts\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.994351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.994326 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fffafcc0-a8e2-4d57-92e4-6f32a3cc731d-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfxcs\" (UID: \"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:06.999217 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.999193 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-token\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:06.999560 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:06.999539 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpt6\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-kube-api-access-jnpt6\") pod \"istiod-openshift-gateway-7574459656-bzvll\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:07.053542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:07.053506 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:07.192796 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:07.192753 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzvll"] Jul 17 18:22:07.195193 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:22:07.195167 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4ab6fb_97f1_47b5_b41f_ad10d6a327ea.slice/crio-b3f58f0261cde2bb55e7a4bb311722e98fe0904a93bdf2052b6e1bc4ef0d9dd4 WatchSource:0}: Error finding container b3f58f0261cde2bb55e7a4bb311722e98fe0904a93bdf2052b6e1bc4ef0d9dd4: Status 404 returned error can't find the container with id b3f58f0261cde2bb55e7a4bb311722e98fe0904a93bdf2052b6e1bc4ef0d9dd4 Jul 17 18:22:07.236815 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:07.236726 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:07.418167 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:07.418125 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mfxcs"] Jul 17 18:22:07.422546 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:22:07.422510 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffafcc0_a8e2_4d57_92e4_6f32a3cc731d.slice/crio-5b16ffada67e8da83e0a95e5dd9287ca43b04f770619f0cc62b8584deef37009 WatchSource:0}: Error finding container 5b16ffada67e8da83e0a95e5dd9287ca43b04f770619f0cc62b8584deef37009: Status 404 returned error can't find the container with id 5b16ffada67e8da83e0a95e5dd9287ca43b04f770619f0cc62b8584deef37009 Jul 17 18:22:07.725282 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:07.725223 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" event={"ID":"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea","Type":"ContainerStarted","Data":"b3f58f0261cde2bb55e7a4bb311722e98fe0904a93bdf2052b6e1bc4ef0d9dd4"} Jul 17 18:22:07.726751 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:07.726712 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" event={"ID":"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d","Type":"ContainerStarted","Data":"5b16ffada67e8da83e0a95e5dd9287ca43b04f770619f0cc62b8584deef37009"} Jul 17 18:22:11.507484 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.507450 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 17 18:22:11.507774 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.507515 2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 17 18:22:11.749479 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.749436 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" event={"ID":"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea","Type":"ContainerStarted","Data":"276d0324efcb77204d5df23e0a8370d5eef6714a73c140c38f195e6c8fbc9524"} Jul 17 18:22:11.749721 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.749531 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:11.751040 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.751008 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" event={"ID":"fffafcc0-a8e2-4d57-92e4-6f32a3cc731d","Type":"ContainerStarted","Data":"90b0660a289965cfcad47261f30b29018cc191d608cb89da6dd8988df315efc2"} Jul 17 18:22:11.751173 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.751075 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:11.752876 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.752845 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" event={"ID":"7da711e8-e662-4752-8c58-3b589def1aab","Type":"ContainerStarted","Data":"8a33f85a8bf86107c04a8da58937964443a8774dc1d323cf8a3bf3b5b67d6622"} Jul 17 18:22:11.753028 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.752904 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:11.754351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.754325 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" event={"ID":"998d38d7-c0f1-40e2-9296-390188d093ed","Type":"ContainerStarted","Data":"53f532ef409494a1de0a50c3be0ecb967de469d30c63557902b74ebc2574d7fc"} Jul 17 18:22:11.770069 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.770015 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" podStartSLOduration=1.46001687 podStartE2EDuration="5.769997836s" totalImagesPullingTime="4.309980966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:11.768416436 +0000 UTC m=+375.812816684" watchObservedRunningTime="2026-07-17 18:22:11.769997836 +0000 UTC m=+375.814398080" Jul 17 18:22:11.785336 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.785234 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55dd66f79f-qr4jb" podStartSLOduration=0.900737502 podStartE2EDuration="6.785219564s" totalImagesPullingTime="5.884482062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:11.784015639 +0000 UTC m=+375.828415885" watchObservedRunningTime="2026-07-17 18:22:11.785219564 +0000 UTC m=+375.829619809" Jul 17 18:22:11.800891 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.800825 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" podStartSLOduration=1.724324718 podStartE2EDuration="5.800801732s" totalImagesPullingTime="4.076477014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:11.799232292 +0000 UTC m=+375.843632538" watchObservedRunningTime="2026-07-17 18:22:11.800801732 +0000 UTC m=+375.845201958" Jul 17 18:22:11.820281 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:11.820198 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" podStartSLOduration=1.8356712 podStartE2EDuration="6.820181766s" totalImagesPullingTime="4.984510566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:11.818830526 +0000 UTC m=+375.863230773" watchObservedRunningTime="2026-07-17 18:22:11.820181766 +0000 UTC m=+375.864582011" Jul 17 18:22:12.761016 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:12.760985 2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bzvll container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:22:12.761427 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:12.761042 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" podUID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:22:15.760624 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:15.760590 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:16.231525 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.231491 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6nc98"] Jul 17 18:22:16.234412 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.234392 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.237565 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.237531 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 17 18:22:16.238231 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.238211 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vqm52\"" Jul 17 18:22:16.239526 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.239498 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5"] Jul 17 18:22:16.243475 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.243452 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.246470 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.246449 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5ld45\"" Jul 17 18:22:16.247559 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.247081 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 17 18:22:16.249422 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.249404 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6nc98"] Jul 17 18:22:16.253905 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.253885 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5"] Jul 17 18:22:16.378667 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.378630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vq5\" (UniqueName: \"kubernetes.io/projected/215a8dc3-9920-4a08-b5dc-130884601da7-kube-api-access-74vq5\") pod \"llmisvc-controller-manager-777c6bd7d5-rglc5\" (UID: \"215a8dc3-9920-4a08-b5dc-130884601da7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.378667 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.378671 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/215a8dc3-9920-4a08-b5dc-130884601da7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rglc5\" (UID: \"215a8dc3-9920-4a08-b5dc-130884601da7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.378931 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.378799 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tl4\" (UniqueName: \"kubernetes.io/projected/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-kube-api-access-w6tl4\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.378931 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.378853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.480044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.480007 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tl4\" (UniqueName: \"kubernetes.io/projected/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-kube-api-access-w6tl4\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.480230 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.480063 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.480230 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.480101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vq5\" (UniqueName: \"kubernetes.io/projected/215a8dc3-9920-4a08-b5dc-130884601da7-kube-api-access-74vq5\") pod \"llmisvc-controller-manager-777c6bd7d5-rglc5\" (UID: \"215a8dc3-9920-4a08-b5dc-130884601da7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.480230 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.480145 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/215a8dc3-9920-4a08-b5dc-130884601da7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rglc5\" (UID: \"215a8dc3-9920-4a08-b5dc-130884601da7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.480425 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:22:16.480350 2569 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 17 18:22:16.480499 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:22:16.480475 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-cert podName:f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb nodeName:}" failed. No retries permitted until 2026-07-17 18:22:16.980453191 +0000 UTC m=+381.024853432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-cert") pod "kserve-controller-manager-d6f4b65b8-6nc98" (UID: "f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb") : secret "kserve-webhook-server-cert" not found Jul 17 18:22:16.482754 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.482689 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/215a8dc3-9920-4a08-b5dc-130884601da7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rglc5\" (UID: \"215a8dc3-9920-4a08-b5dc-130884601da7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.494567 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.494543 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vq5\" (UniqueName: \"kubernetes.io/projected/215a8dc3-9920-4a08-b5dc-130884601da7-kube-api-access-74vq5\") pod \"llmisvc-controller-manager-777c6bd7d5-rglc5\" (UID: \"215a8dc3-9920-4a08-b5dc-130884601da7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.501839 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.501813 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tl4\" (UniqueName: \"kubernetes.io/projected/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-kube-api-access-w6tl4\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.556123 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.556079 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:16.690750 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.690724 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5"] Jul 17 18:22:16.693361 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:22:16.693328 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod215a8dc3_9920_4a08_b5dc_130884601da7.slice/crio-edd0fcc701fe3c2b69572a352cb9b0e689cdecad5c7799121ad9e15c5efbfeba WatchSource:0}: Error finding container edd0fcc701fe3c2b69572a352cb9b0e689cdecad5c7799121ad9e15c5efbfeba: Status 404 returned error can't find the container with id edd0fcc701fe3c2b69572a352cb9b0e689cdecad5c7799121ad9e15c5efbfeba Jul 17 18:22:16.777654 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.777576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" event={"ID":"215a8dc3-9920-4a08-b5dc-130884601da7","Type":"ContainerStarted","Data":"edd0fcc701fe3c2b69572a352cb9b0e689cdecad5c7799121ad9e15c5efbfeba"} Jul 17 18:22:16.984163 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.984121 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:16.986531 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:16.986500 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-6nc98\" (UID: \"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:17.146411 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:17.146363 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:17.289265 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:17.289224 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6nc98"] Jul 17 18:22:17.291110 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:22:17.291081 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf576a8ea_8d9c_46ea_ac74_9ed4e6aa75bb.slice/crio-43a922139bb5554463be776c5da99b999a1a36a73aec50cff2f18307fd781e54 WatchSource:0}: Error finding container 43a922139bb5554463be776c5da99b999a1a36a73aec50cff2f18307fd781e54: Status 404 returned error can't find the container with id 43a922139bb5554463be776c5da99b999a1a36a73aec50cff2f18307fd781e54 Jul 17 18:22:17.783611 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:17.783571 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" event={"ID":"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb","Type":"ContainerStarted","Data":"43a922139bb5554463be776c5da99b999a1a36a73aec50cff2f18307fd781e54"} Jul 17 18:22:19.413924 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:19.413884 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzvll"] Jul 17 18:22:19.414409 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:19.414098 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" podUID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" containerName="discovery" containerID="cri-o://276d0324efcb77204d5df23e0a8370d5eef6714a73c140c38f195e6c8fbc9524" gracePeriod=30 Jul 17 18:22:19.797699 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:19.797655 2569 generic.go:356] "Generic (PLEG): container finished" podID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" containerID="276d0324efcb77204d5df23e0a8370d5eef6714a73c140c38f195e6c8fbc9524" exitCode=0 Jul 17 18:22:19.797863 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:19.797713 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" event={"ID":"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea","Type":"ContainerDied","Data":"276d0324efcb77204d5df23e0a8370d5eef6714a73c140c38f195e6c8fbc9524"} Jul 17 18:22:20.368254 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.368214 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:20.511976 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.511949 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-cacerts\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.511987 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-dns-cert\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.512012 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnpt6\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-kube-api-access-jnpt6\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.512144 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-kubeconfig\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.512200 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-ca-configmap\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.512263 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-local-certs\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.512289 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-token\") pod \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\" (UID: \"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea\") " Jul 17 18:22:20.512710 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.512606 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:22:20.514489 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.514450 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-cacerts" (OuterVolumeSpecName: "cacerts") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:22:20.514695 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.514533 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:22:20.514695 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.514587 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:22:20.514858 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.514838 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:22:20.514914 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.514896 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-local-certs" (OuterVolumeSpecName: "local-certs") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:22:20.514914 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.514905 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-kube-api-access-jnpt6" (OuterVolumeSpecName: "kube-api-access-jnpt6") pod "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" (UID: "ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea"). InnerVolumeSpecName "kube-api-access-jnpt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613886 2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-dns-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613915 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnpt6\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-kube-api-access-jnpt6\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613931 2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-kubeconfig\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613945 2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-csr-ca-configmap\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613958 2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-local-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613970 2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-istio-token\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.613978 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.613982 2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea-cacerts\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:22:20.804366 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.804340 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" Jul 17 18:22:20.804366 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.804362 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bzvll" event={"ID":"ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea","Type":"ContainerDied","Data":"b3f58f0261cde2bb55e7a4bb311722e98fe0904a93bdf2052b6e1bc4ef0d9dd4"} Jul 17 18:22:20.804638 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.804417 2569 scope.go:117] "RemoveContainer" containerID="276d0324efcb77204d5df23e0a8370d5eef6714a73c140c38f195e6c8fbc9524" Jul 17 18:22:20.806053 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.806020 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" event={"ID":"215a8dc3-9920-4a08-b5dc-130884601da7","Type":"ContainerStarted","Data":"6168947682d3f29ecc7e1894ae89acc39b82a74309a315553477cbdb6ce7ae99"} Jul 17 18:22:20.806171 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.806078 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:20.807795 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.807765 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" event={"ID":"f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb","Type":"ContainerStarted","Data":"6f700d05cf7dcba80c557463af3cc281217f1fd57a77d8a98b0b5abfa76fb9f3"} Jul 17 18:22:20.807995 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.807978 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:22:20.824282 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.824209 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" podStartSLOduration=1.134495779 podStartE2EDuration="4.82419092s" totalImagesPullingTime="3.689695141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:20.824075808 +0000 UTC m=+384.868476053" watchObservedRunningTime="2026-07-17 18:22:20.82419092 +0000 UTC m=+384.868591165" Jul 17 18:22:20.839612 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.839583 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzvll"] Jul 17 18:22:20.843710 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.843688 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bzvll"] Jul 17 18:22:20.870322 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:20.870210 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" podStartSLOduration=1.776245163 podStartE2EDuration="4.870192721s" totalImagesPullingTime="3.093947558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:20.869898419 +0000 UTC m=+384.914298666" watchObservedRunningTime="2026-07-17 18:22:20.870192721 +0000 UTC m=+384.914592966" Jul 17 18:22:21.331220 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:21.331187 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" path="/var/lib/kubelet/pods/ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea/volumes" Jul 17 18:22:22.763770 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:22.763739 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-mfxcs" Jul 17 18:22:22.775745 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:22.775718 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zlnm" Jul 17 18:22:51.819893 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:51.819857 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rglc5" Jul 17 18:22:51.822950 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:22:51.822925 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6nc98" Jul 17 18:23:06.209752 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.209713 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bdwsg"] Jul 17 18:23:06.210255 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.210163 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" containerName="discovery" Jul 17 18:23:06.210255 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.210181 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" containerName="discovery" Jul 17 18:23:06.210398 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.210281 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4ab6fb-97f1-47b5-b41f-ad10d6a327ea" containerName="discovery" Jul 17 18:23:06.214870 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.214846 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:06.218933 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.218904 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 18:23:06.219059 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.218983 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 18:23:06.219802 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.219778 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m4vj5\"" Jul 17 18:23:06.234533 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.234507 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bdwsg"] Jul 17 18:23:06.264396 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.264363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh84l\" (UniqueName: \"kubernetes.io/projected/41c01c08-6935-496c-b425-37db0ecbef70-kube-api-access-zh84l\") pod \"kuadrant-operator-catalog-bdwsg\" (UID: \"41c01c08-6935-496c-b425-37db0ecbef70\") " pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:06.365061 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.365024 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh84l\" (UniqueName: \"kubernetes.io/projected/41c01c08-6935-496c-b425-37db0ecbef70-kube-api-access-zh84l\") pod \"kuadrant-operator-catalog-bdwsg\" (UID: \"41c01c08-6935-496c-b425-37db0ecbef70\") " pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:06.392454 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.392423 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh84l\" (UniqueName: \"kubernetes.io/projected/41c01c08-6935-496c-b425-37db0ecbef70-kube-api-access-zh84l\") pod \"kuadrant-operator-catalog-bdwsg\" (UID: \"41c01c08-6935-496c-b425-37db0ecbef70\") " pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:06.524449 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.524359 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:06.537984 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.537946 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bdwsg"] Jul 17 18:23:06.658837 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.658815 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bdwsg"] Jul 17 18:23:06.661348 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:06.661315 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c01c08_6935_496c_b425_37db0ecbef70.slice/crio-92273c65b6b16853b457a0b45ef07b931a6a30151c1c8a17b94af17c872a8881 WatchSource:0}: Error finding container 92273c65b6b16853b457a0b45ef07b931a6a30151c1c8a17b94af17c872a8881: Status 404 returned error can't find the container with id 92273c65b6b16853b457a0b45ef07b931a6a30151c1c8a17b94af17c872a8881 Jul 17 18:23:06.746215 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.746179 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qtgp5"] Jul 17 18:23:06.749332 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.749314 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:06.764536 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.764510 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qtgp5"] Jul 17 18:23:06.868749 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.868712 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4rg\" (UniqueName: \"kubernetes.io/projected/ee6f74b3-af0d-490e-9fe5-df55a4940aff-kube-api-access-8p4rg\") pod \"kuadrant-operator-catalog-qtgp5\" (UID: \"ee6f74b3-af0d-490e-9fe5-df55a4940aff\") " pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:06.969586 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.969558 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4rg\" (UniqueName: \"kubernetes.io/projected/ee6f74b3-af0d-490e-9fe5-df55a4940aff-kube-api-access-8p4rg\") pod \"kuadrant-operator-catalog-qtgp5\" (UID: \"ee6f74b3-af0d-490e-9fe5-df55a4940aff\") " pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:06.980985 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:06.980961 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4rg\" (UniqueName: \"kubernetes.io/projected/ee6f74b3-af0d-490e-9fe5-df55a4940aff-kube-api-access-8p4rg\") pod \"kuadrant-operator-catalog-qtgp5\" (UID: \"ee6f74b3-af0d-490e-9fe5-df55a4940aff\") " pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:07.003080 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:07.003039 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" event={"ID":"41c01c08-6935-496c-b425-37db0ecbef70","Type":"ContainerStarted","Data":"92273c65b6b16853b457a0b45ef07b931a6a30151c1c8a17b94af17c872a8881"} Jul 17 18:23:07.058522 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:07.058488 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:07.209269 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:07.206559 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qtgp5"] Jul 17 18:23:07.212535 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:07.212501 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6f74b3_af0d_490e_9fe5_df55a4940aff.slice/crio-cd5b45a27650b3cc4157666fbbf711b389f288e003bb946c64ff731621543aa9 WatchSource:0}: Error finding container cd5b45a27650b3cc4157666fbbf711b389f288e003bb946c64ff731621543aa9: Status 404 returned error can't find the container with id cd5b45a27650b3cc4157666fbbf711b389f288e003bb946c64ff731621543aa9 Jul 17 18:23:08.009052 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:08.009018 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" event={"ID":"ee6f74b3-af0d-490e-9fe5-df55a4940aff","Type":"ContainerStarted","Data":"cd5b45a27650b3cc4157666fbbf711b389f288e003bb946c64ff731621543aa9"} Jul 17 18:23:09.014691 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.014648 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" event={"ID":"41c01c08-6935-496c-b425-37db0ecbef70","Type":"ContainerStarted","Data":"825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8"} Jul 17 18:23:09.015195 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.014724 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" podUID="41c01c08-6935-496c-b425-37db0ecbef70" containerName="registry-server" containerID="cri-o://825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8" gracePeriod=2 Jul 17 18:23:09.016331 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.016303 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" event={"ID":"ee6f74b3-af0d-490e-9fe5-df55a4940aff","Type":"ContainerStarted","Data":"36f83462191b075f3ee939233354c82eca1349f5b6c64fa9306a06d15a93bddb"} Jul 17 18:23:09.031332 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.031289 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" podStartSLOduration=1.178988575 podStartE2EDuration="3.031271371s" totalImagesPullingTime="1.852282796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:09.03067245 +0000 UTC m=+433.075072696" watchObservedRunningTime="2026-07-17 18:23:09.031271371 +0000 UTC m=+433.075671613" Jul 17 18:23:09.048492 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.048442 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" podStartSLOduration=1.746679484 podStartE2EDuration="3.048426006s" totalImagesPullingTime="1.301746522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:09.047181933 +0000 UTC m=+433.091582178" watchObservedRunningTime="2026-07-17 18:23:09.048426006 +0000 UTC m=+433.092826251" Jul 17 18:23:09.247560 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.247536 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:09.295004 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.294927 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh84l\" (UniqueName: \"kubernetes.io/projected/41c01c08-6935-496c-b425-37db0ecbef70-kube-api-access-zh84l\") pod \"41c01c08-6935-496c-b425-37db0ecbef70\" (UID: \"41c01c08-6935-496c-b425-37db0ecbef70\") " Jul 17 18:23:09.297091 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.297068 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c01c08-6935-496c-b425-37db0ecbef70-kube-api-access-zh84l" (OuterVolumeSpecName: "kube-api-access-zh84l") pod "41c01c08-6935-496c-b425-37db0ecbef70" (UID: "41c01c08-6935-496c-b425-37db0ecbef70"). InnerVolumeSpecName "kube-api-access-zh84l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:23:09.396122 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:09.396090 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh84l\" (UniqueName: \"kubernetes.io/projected/41c01c08-6935-496c-b425-37db0ecbef70-kube-api-access-zh84l\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:23:10.022385 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.022350 2569 generic.go:356] "Generic (PLEG): container finished" podID="41c01c08-6935-496c-b425-37db0ecbef70" containerID="825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8" exitCode=0 Jul 17 18:23:10.022795 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.022398 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" Jul 17 18:23:10.022795 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.022437 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" event={"ID":"41c01c08-6935-496c-b425-37db0ecbef70","Type":"ContainerDied","Data":"825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8"} Jul 17 18:23:10.022795 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.022488 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bdwsg" event={"ID":"41c01c08-6935-496c-b425-37db0ecbef70","Type":"ContainerDied","Data":"92273c65b6b16853b457a0b45ef07b931a6a30151c1c8a17b94af17c872a8881"} Jul 17 18:23:10.022795 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.022507 2569 scope.go:117] "RemoveContainer" containerID="825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8" Jul 17 18:23:10.030931 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.030913 2569 scope.go:117] "RemoveContainer" containerID="825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8" Jul 17 18:23:10.031187 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:23:10.031166 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8\": container with ID starting with 825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8 not found: ID does not exist" containerID="825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8" Jul 17 18:23:10.031288 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.031194 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8"} err="failed to get container status \"825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8\": rpc error: code = NotFound desc = could not find container \"825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8\": container with ID starting with 825c6d70e0d284cd683fa1b7cbef621f0bb7c0d4b87c1f364c82ba649f29c3a8 not found: ID does not exist" Jul 17 18:23:10.041044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.041018 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bdwsg"] Jul 17 18:23:10.045663 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:10.045641 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bdwsg"] Jul 17 18:23:11.330510 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:11.330477 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c01c08-6935-496c-b425-37db0ecbef70" path="/var/lib/kubelet/pods/41c01c08-6935-496c-b425-37db0ecbef70/volumes" Jul 17 18:23:17.059327 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:17.059287 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:17.059327 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:17.059336 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:17.081638 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:17.081613 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:18.080542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:18.080472 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qtgp5" Jul 17 18:23:38.514161 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.514125 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j"] Jul 17 18:23:38.514597 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.514462 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c01c08-6935-496c-b425-37db0ecbef70" containerName="registry-server" Jul 17 18:23:38.514597 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.514474 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c01c08-6935-496c-b425-37db0ecbef70" containerName="registry-server" Jul 17 18:23:38.514597 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.514540 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c01c08-6935-496c-b425-37db0ecbef70" containerName="registry-server" Jul 17 18:23:38.520518 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.520497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:38.522893 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.522871 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lj5xc\"" Jul 17 18:23:38.529690 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.529660 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j"] Jul 17 18:23:38.531225 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.531193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwbx2\" (UniqueName: \"kubernetes.io/projected/2ca0f477-0d65-41c1-abc5-c572b7dde96d-kube-api-access-gwbx2\") pod \"authorino-operator-75cc8d5cb7-x4z2j\" (UID: \"2ca0f477-0d65-41c1-abc5-c572b7dde96d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:38.632123 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.632087 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbx2\" (UniqueName: \"kubernetes.io/projected/2ca0f477-0d65-41c1-abc5-c572b7dde96d-kube-api-access-gwbx2\") pod \"authorino-operator-75cc8d5cb7-x4z2j\" (UID: \"2ca0f477-0d65-41c1-abc5-c572b7dde96d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:38.658896 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.658874 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwbx2\" (UniqueName: \"kubernetes.io/projected/2ca0f477-0d65-41c1-abc5-c572b7dde96d-kube-api-access-gwbx2\") pod \"authorino-operator-75cc8d5cb7-x4z2j\" (UID: \"2ca0f477-0d65-41c1-abc5-c572b7dde96d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:38.831524 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.831496 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:38.975423 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:38.975389 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j"] Jul 17 18:23:38.978954 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:38.978918 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca0f477_0d65_41c1_abc5_c572b7dde96d.slice/crio-e524a4170c31dde31d4e5834221b84133de871d7bb115d043dcb472e2a71c307 WatchSource:0}: Error finding container e524a4170c31dde31d4e5834221b84133de871d7bb115d043dcb472e2a71c307: Status 404 returned error can't find the container with id e524a4170c31dde31d4e5834221b84133de871d7bb115d043dcb472e2a71c307 Jul 17 18:23:39.144727 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:39.144636 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" event={"ID":"2ca0f477-0d65-41c1-abc5-c572b7dde96d","Type":"ContainerStarted","Data":"e524a4170c31dde31d4e5834221b84133de871d7bb115d043dcb472e2a71c307"} Jul 17 18:23:42.160898 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.160857 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" event={"ID":"2ca0f477-0d65-41c1-abc5-c572b7dde96d","Type":"ContainerStarted","Data":"67ad3f79b8d9469c63a85e871a114da7e326136c3f8024b640ef98b5d6958ff1"} Jul 17 18:23:42.161400 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.160995 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:42.184463 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.184412 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" podStartSLOduration=1.8905037519999999 podStartE2EDuration="4.184385488s" totalImagesPullingTime="2.293881736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:42.184206864 +0000 UTC m=+466.228607109" watchObservedRunningTime="2026-07-17 18:23:42.184385488 +0000 UTC m=+466.228785737" Jul 17 18:23:42.258683 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.258642 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp"] Jul 17 18:23:42.264319 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.262688 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.265577 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.265550 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5658k\"" Jul 17 18:23:42.275529 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.275502 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp"] Jul 17 18:23:42.359102 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.359065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f036b-fa7a-41de-986a-efde07572272-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.359310 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.359170 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2592d\" (UniqueName: \"kubernetes.io/projected/084f036b-fa7a-41de-986a-efde07572272-kube-api-access-2592d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.459612 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.459522 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2592d\" (UniqueName: \"kubernetes.io/projected/084f036b-fa7a-41de-986a-efde07572272-kube-api-access-2592d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.459612 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.459585 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f036b-fa7a-41de-986a-efde07572272-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.459984 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.459961 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f036b-fa7a-41de-986a-efde07572272-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.470617 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.470583 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2592d\" (UniqueName: \"kubernetes.io/projected/084f036b-fa7a-41de-986a-efde07572272-kube-api-access-2592d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.574418 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.574379 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:42.715186 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:42.715147 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp"] Jul 17 18:23:42.717921 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:42.717895 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084f036b_fa7a_41de_986a_efde07572272.slice/crio-4c1b147c9700e184f946f2755e922c743da0f23c2a5a01ac9f4892645afd0388 WatchSource:0}: Error finding container 4c1b147c9700e184f946f2755e922c743da0f23c2a5a01ac9f4892645afd0388: Status 404 returned error can't find the container with id 4c1b147c9700e184f946f2755e922c743da0f23c2a5a01ac9f4892645afd0388 Jul 17 18:23:43.166897 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:43.166862 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" event={"ID":"084f036b-fa7a-41de-986a-efde07572272","Type":"ContainerStarted","Data":"4c1b147c9700e184f946f2755e922c743da0f23c2a5a01ac9f4892645afd0388"} Jul 17 18:23:44.260181 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.260139 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm"] Jul 17 18:23:44.262544 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.262521 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:44.266116 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.266096 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 17 18:23:44.266502 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.266486 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jj2hm\"" Jul 17 18:23:44.272378 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.272357 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6dr4\" (UniqueName: \"kubernetes.io/projected/0490fd85-d44d-4dd2-a877-e53c2d846934-kube-api-access-v6dr4\") pod \"dns-operator-controller-manager-864dd78c4c-ff4bm\" (UID: \"0490fd85-d44d-4dd2-a877-e53c2d846934\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:44.281615 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.281592 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm"] Jul 17 18:23:44.372835 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.372791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6dr4\" (UniqueName: \"kubernetes.io/projected/0490fd85-d44d-4dd2-a877-e53c2d846934-kube-api-access-v6dr4\") pod \"dns-operator-controller-manager-864dd78c4c-ff4bm\" (UID: \"0490fd85-d44d-4dd2-a877-e53c2d846934\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:44.381132 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.381101 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6dr4\" (UniqueName: \"kubernetes.io/projected/0490fd85-d44d-4dd2-a877-e53c2d846934-kube-api-access-v6dr4\") pod \"dns-operator-controller-manager-864dd78c4c-ff4bm\" (UID: \"0490fd85-d44d-4dd2-a877-e53c2d846934\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:44.573464 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.573431 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:44.732548 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:44.732512 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm"] Jul 17 18:23:44.736226 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:44.736190 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0490fd85_d44d_4dd2_a877_e53c2d846934.slice/crio-b8a97e6c215a405b59b34bf350c870440cbdbc142918eb936540fd28e599b039 WatchSource:0}: Error finding container b8a97e6c215a405b59b34bf350c870440cbdbc142918eb936540fd28e599b039: Status 404 returned error can't find the container with id b8a97e6c215a405b59b34bf350c870440cbdbc142918eb936540fd28e599b039 Jul 17 18:23:45.178436 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:45.178395 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" event={"ID":"0490fd85-d44d-4dd2-a877-e53c2d846934","Type":"ContainerStarted","Data":"b8a97e6c215a405b59b34bf350c870440cbdbc142918eb936540fd28e599b039"} Jul 17 18:23:47.055906 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.055872 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx"] Jul 17 18:23:47.059363 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.059332 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:23:47.062535 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.062510 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-72xh8\"" Jul 17 18:23:47.075686 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.075660 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx"] Jul 17 18:23:47.100152 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.100118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2j55\" (UniqueName: \"kubernetes.io/projected/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934-kube-api-access-r2j55\") pod \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" (UID: \"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:23:47.201563 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.201518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2j55\" (UniqueName: \"kubernetes.io/projected/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934-kube-api-access-r2j55\") pod \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" (UID: \"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:23:47.215723 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.215690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2j55\" (UniqueName: \"kubernetes.io/projected/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934-kube-api-access-r2j55\") pod \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" (UID: \"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:23:47.373448 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:47.373358 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:23:48.166622 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.166588 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx"] Jul 17 18:23:48.170272 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:48.170223 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c15fc1_2cb2_4154_b7f5_b9e1ced80934.slice/crio-851f804b584679d73c908ad6e213827ae851912c5dea736240d8bff9333fcb36 WatchSource:0}: Error finding container 851f804b584679d73c908ad6e213827ae851912c5dea736240d8bff9333fcb36: Status 404 returned error can't find the container with id 851f804b584679d73c908ad6e213827ae851912c5dea736240d8bff9333fcb36 Jul 17 18:23:48.195988 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.195955 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" event={"ID":"084f036b-fa7a-41de-986a-efde07572272","Type":"ContainerStarted","Data":"89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a"} Jul 17 18:23:48.196178 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.196067 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:23:48.197755 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.197729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" event={"ID":"0490fd85-d44d-4dd2-a877-e53c2d846934","Type":"ContainerStarted","Data":"d9305da79df4bbb734c1335597fd1bf2a1b088a184740373a1aff25551490cba"} Jul 17 18:23:48.197883 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.197787 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:48.199255 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.199216 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" event={"ID":"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934","Type":"ContainerStarted","Data":"851f804b584679d73c908ad6e213827ae851912c5dea736240d8bff9333fcb36"} Jul 17 18:23:48.214351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.214304 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" podStartSLOduration=0.892526707 podStartE2EDuration="6.214288982s" totalImagesPullingTime="5.321762275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:48.213068034 +0000 UTC m=+472.257468279" watchObservedRunningTime="2026-07-17 18:23:48.214288982 +0000 UTC m=+472.258689296" Jul 17 18:23:48.230036 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:48.229987 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" podStartSLOduration=0.939564321 podStartE2EDuration="4.229969915s" totalImagesPullingTime="3.290405594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:48.229487175 +0000 UTC m=+472.273887421" watchObservedRunningTime="2026-07-17 18:23:48.229969915 +0000 UTC m=+472.274370160" Jul 17 18:23:50.210911 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:50.210867 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" event={"ID":"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934","Type":"ContainerStarted","Data":"4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0"} Jul 17 18:23:50.211302 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:50.211037 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:23:50.229088 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:50.229035 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" podStartSLOduration=1.403270292 podStartE2EDuration="3.229016757s" totalImagesPullingTime="1.825746465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:50.22796605 +0000 UTC m=+474.272366306" watchObservedRunningTime="2026-07-17 18:23:50.229016757 +0000 UTC m=+474.273417002" Jul 17 18:23:51.253263 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.250901 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl"] Jul 17 18:23:51.263478 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.263451 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.269810 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.266746 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vdnr2\"" Jul 17 18:23:51.269810 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.266972 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 17 18:23:51.269810 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.267415 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 17 18:23:51.269810 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.269695 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl"] Jul 17 18:23:51.337990 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.337959 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zlx\" (UniqueName: \"kubernetes.io/projected/2bc23cec-a9e5-472f-946a-1f34bf04bf96-kube-api-access-w4zlx\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.338169 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.338000 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bc23cec-a9e5-472f-946a-1f34bf04bf96-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.338169 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.338020 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2bc23cec-a9e5-472f-946a-1f34bf04bf96-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.439396 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.439363 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2bc23cec-a9e5-472f-946a-1f34bf04bf96-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.439576 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.439518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zlx\" (UniqueName: \"kubernetes.io/projected/2bc23cec-a9e5-472f-946a-1f34bf04bf96-kube-api-access-w4zlx\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.439629 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.439583 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bc23cec-a9e5-472f-946a-1f34bf04bf96-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.440154 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.440119 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2bc23cec-a9e5-472f-946a-1f34bf04bf96-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.442079 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.442051 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2bc23cec-a9e5-472f-946a-1f34bf04bf96-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.448595 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.448573 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zlx\" (UniqueName: \"kubernetes.io/projected/2bc23cec-a9e5-472f-946a-1f34bf04bf96-kube-api-access-w4zlx\") pod \"kuadrant-console-plugin-66b5774985-s47gl\" (UID: \"2bc23cec-a9e5-472f-946a-1f34bf04bf96\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.581834 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.581789 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" Jul 17 18:23:51.718440 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:51.718411 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl"] Jul 17 18:23:51.720900 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:23:51.720876 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bc23cec_a9e5_472f_946a_1f34bf04bf96.slice/crio-d3960e6ddcc4e97742d749814489f4b7f955f039f1ef4a85854554b58d0f3f0d WatchSource:0}: Error finding container d3960e6ddcc4e97742d749814489f4b7f955f039f1ef4a85854554b58d0f3f0d: Status 404 returned error can't find the container with id d3960e6ddcc4e97742d749814489f4b7f955f039f1ef4a85854554b58d0f3f0d Jul 17 18:23:52.220914 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:52.220867 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" event={"ID":"2bc23cec-a9e5-472f-946a-1f34bf04bf96","Type":"ContainerStarted","Data":"d3960e6ddcc4e97742d749814489f4b7f955f039f1ef4a85854554b58d0f3f0d"} Jul 17 18:23:53.170205 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:53.170169 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-x4z2j" Jul 17 18:23:59.206701 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:59.206656 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ff4bm" Jul 17 18:23:59.207139 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:23:59.206825 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:01.093044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.093010 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp"] Jul 17 18:24:01.093546 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.093227 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" podUID="084f036b-fa7a-41de-986a-efde07572272" containerName="manager" containerID="cri-o://89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a" gracePeriod=2 Jul 17 18:24:01.104811 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.104782 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp"] Jul 17 18:24:01.107433 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.107386 2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"084f036b-fa7a-41de-986a-efde07572272\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:01.122592 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.122567 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx"] Jul 17 18:24:01.122826 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.122800 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" containerName="manager" containerID="cri-o://4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0" gracePeriod=2 Jul 17 18:24:01.124565 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.124474 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx"] Jul 17 18:24:01.124918 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.124899 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084f036b-fa7a-41de-986a-efde07572272" containerName="manager" Jul 17 18:24:01.125036 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.125023 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="084f036b-fa7a-41de-986a-efde07572272" containerName="manager" Jul 17 18:24:01.125233 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.125216 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="084f036b-fa7a-41de-986a-efde07572272" containerName="manager" Jul 17 18:24:01.129324 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.129304 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:01.129448 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.129349 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.135543 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.135513 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx"] Jul 17 18:24:01.138141 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.138118 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx"] Jul 17 18:24:01.143414 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.143374 2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-tr7nx\": pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:01.145406 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.145369 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:01.163121 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.163092 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm"] Jul 17 18:24:01.163557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.163537 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" containerName="manager" Jul 17 18:24:01.163708 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.163693 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" containerName="manager" Jul 17 18:24:01.163928 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.163907 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" containerName="manager" Jul 17 18:24:01.168287 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.168236 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:01.169752 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.169719 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:01.171733 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.171703 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:01.183038 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.183008 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm"] Jul 17 18:24:01.196299 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.196187 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:01.198570 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:01.198529 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:01.227197 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.227160 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqvd\" (UniqueName: \"kubernetes.io/projected/26d13d43-c41f-457c-8537-7c91621fb7e4-kube-api-access-brqvd\") pod \"limitador-operator-controller-manager-859d7b78bd-f5cwm\" (UID: \"26d13d43-c41f-457c-8537-7c91621fb7e4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:01.227351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.227215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c357813a-fc20-4903-8eda-0160ab231833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldnfx\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.227351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.227285 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzgqg\" (UniqueName: \"kubernetes.io/projected/c357813a-fc20-4903-8eda-0160ab231833-kube-api-access-dzgqg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldnfx\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.328617 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.328577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c357813a-fc20-4903-8eda-0160ab231833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldnfx\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.328617 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.328627 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzgqg\" (UniqueName: \"kubernetes.io/projected/c357813a-fc20-4903-8eda-0160ab231833-kube-api-access-dzgqg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldnfx\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.328864 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.328730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqvd\" (UniqueName: \"kubernetes.io/projected/26d13d43-c41f-457c-8537-7c91621fb7e4-kube-api-access-brqvd\") pod \"limitador-operator-controller-manager-859d7b78bd-f5cwm\" (UID: \"26d13d43-c41f-457c-8537-7c91621fb7e4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:01.329002 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.328962 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c357813a-fc20-4903-8eda-0160ab231833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldnfx\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.333028 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.332966 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd"] Jul 17 18:24:01.341453 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.341428 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.342979 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.342954 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzgqg\" (UniqueName: \"kubernetes.io/projected/c357813a-fc20-4903-8eda-0160ab231833-kube-api-access-dzgqg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ldnfx\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.345578 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.345521 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqvd\" (UniqueName: \"kubernetes.io/projected/26d13d43-c41f-457c-8537-7c91621fb7e4-kube-api-access-brqvd\") pod \"limitador-operator-controller-manager-859d7b78bd-f5cwm\" (UID: \"26d13d43-c41f-457c-8537-7c91621fb7e4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:01.349177 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.349152 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd"] Jul 17 18:24:01.429904 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.429857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7pkf\" (UniqueName: \"kubernetes.io/projected/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-kube-api-access-m7pkf\") pod \"kuadrant-operator-controller-manager-86878c769f-m7sdd\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.430104 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.429924 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m7sdd\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.512596 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.512564 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:01.518695 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.518662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:01.531266 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.531229 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7pkf\" (UniqueName: \"kubernetes.io/projected/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-kube-api-access-m7pkf\") pod \"kuadrant-operator-controller-manager-86878c769f-m7sdd\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.531396 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.531290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m7sdd\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.531626 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.531607 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m7sdd\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.540450 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.540425 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7pkf\" (UniqueName: \"kubernetes.io/projected/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-kube-api-access-m7pkf\") pod \"kuadrant-operator-controller-manager-86878c769f-m7sdd\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:01.669970 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:01.669894 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:14.185824 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.185532 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.187763 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.187718 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.215139 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.215086 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.217697 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.217664 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.219770 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.219637 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.240339 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.240203 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd"] Jul 17 18:24:14.244312 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:24:14.244277 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e1c0dc_9406_4bde_8e77_617a90ed1f7d.slice/crio-c68ec3d383e65c884c7dcc9fbcd7ee6ddb9a6421c1820a1e5d745b4ad943b9a8 WatchSource:0}: Error finding container c68ec3d383e65c884c7dcc9fbcd7ee6ddb9a6421c1820a1e5d745b4ad943b9a8: Status 404 returned error can't find the container with id c68ec3d383e65c884c7dcc9fbcd7ee6ddb9a6421c1820a1e5d745b4ad943b9a8 Jul 17 18:24:14.335602 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.335574 2569 generic.go:356] "Generic (PLEG): container finished" podID="084f036b-fa7a-41de-986a-efde07572272" containerID="89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a" exitCode=0 Jul 17 18:24:14.335788 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.335616 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.335788 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.335679 2569 scope.go:117] "RemoveContainer" containerID="89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a" Jul 17 18:24:14.337397 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.337365 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" event={"ID":"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d","Type":"ContainerStarted","Data":"8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d"} Jul 17 18:24:14.337587 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.337431 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" event={"ID":"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d","Type":"ContainerStarted","Data":"c68ec3d383e65c884c7dcc9fbcd7ee6ddb9a6421c1820a1e5d745b4ad943b9a8"} Jul 17 18:24:14.337587 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.337543 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:14.337717 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.337663 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.338774 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.338755 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" containerID="4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0" exitCode=0 Jul 17 18:24:14.338882 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.338798 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.339549 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.339526 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.340319 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.340284 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" event={"ID":"2bc23cec-a9e5-472f-946a-1f34bf04bf96","Type":"ContainerStarted","Data":"7b18c4e94e2f688b9ea98e0179b9ae3336377f30f7bd4ae25846a9c75caf0a88"} Jul 17 18:24:14.344507 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.344491 2569 scope.go:117] "RemoveContainer" containerID="89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a" Jul 17 18:24:14.344758 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.344740 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a\": container with ID starting with 89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a not found: ID does not exist" containerID="89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a" Jul 17 18:24:14.344843 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.344771 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a"} err="failed to get container status \"89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a\": rpc error: code = NotFound desc = could not find container \"89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a\": container with ID starting with 89b7059ff76910db076468f288dbc5a36203a8de5de4dff71eb6560becd10a6a not found: ID does not exist" Jul 17 18:24:14.344843 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.344796 2569 scope.go:117] "RemoveContainer" containerID="4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0" Jul 17 18:24:14.349949 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.349914 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2j55\" (UniqueName: \"kubernetes.io/projected/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934-kube-api-access-r2j55\") pod \"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934\" (UID: \"c8c15fc1-2cb2-4154-b7f5-b9e1ced80934\") " Jul 17 18:24:14.350068 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.349968 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2592d\" (UniqueName: \"kubernetes.io/projected/084f036b-fa7a-41de-986a-efde07572272-kube-api-access-2592d\") pod \"084f036b-fa7a-41de-986a-efde07572272\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " Jul 17 18:24:14.350068 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.349998 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f036b-fa7a-41de-986a-efde07572272-extensions-socket-volume\") pod \"084f036b-fa7a-41de-986a-efde07572272\" (UID: \"084f036b-fa7a-41de-986a-efde07572272\") " Jul 17 18:24:14.350527 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.350487 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/084f036b-fa7a-41de-986a-efde07572272-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "084f036b-fa7a-41de-986a-efde07572272" (UID: "084f036b-fa7a-41de-986a-efde07572272"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:24:14.351979 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.351958 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934-kube-api-access-r2j55" (OuterVolumeSpecName: "kube-api-access-r2j55") pod "c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" (UID: "c8c15fc1-2cb2-4154-b7f5-b9e1ced80934"). InnerVolumeSpecName "kube-api-access-r2j55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:24:14.352270 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.352236 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084f036b-fa7a-41de-986a-efde07572272-kube-api-access-2592d" (OuterVolumeSpecName: "kube-api-access-2592d") pod "084f036b-fa7a-41de-986a-efde07572272" (UID: "084f036b-fa7a-41de-986a-efde07572272"). InnerVolumeSpecName "kube-api-access-2592d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:24:14.353136 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.353117 2569 scope.go:117] "RemoveContainer" containerID="4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0" Jul 17 18:24:14.353460 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.353439 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0\": container with ID starting with 4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0 not found: ID does not exist" containerID="4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0" Jul 17 18:24:14.353536 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.353469 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0"} err="failed to get container status \"4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0\": rpc error: code = NotFound desc = could not find container \"4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0\": container with ID starting with 4493b018101b99e6e36eb563bde0b5a8ed94167d1e72deba22771c02114bb2f0 not found: ID does not exist" Jul 17 18:24:14.364788 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.364755 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.365742 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.365705 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" podStartSLOduration=13.365690524 podStartE2EDuration="13.365690524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:24:14.362414305 +0000 UTC m=+498.406814548" watchObservedRunningTime="2026-07-17 18:24:14.365690524 +0000 UTC m=+498.410090768" Jul 17 18:24:14.366733 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.366710 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.368613 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.368590 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.370812 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.370790 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.385973 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.385904 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s47gl" podStartSLOduration=1.005137216 podStartE2EDuration="23.38588588s" totalImagesPullingTime="22.380748664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:24:14.385782164 +0000 UTC m=+498.430182408" watchObservedRunningTime="2026-07-17 18:24:14.38588588 +0000 UTC m=+498.430286123" Jul 17 18:24:14.451340 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.451306 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2j55\" (UniqueName: \"kubernetes.io/projected/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934-kube-api-access-r2j55\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:24:14.451564 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.451543 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2592d\" (UniqueName: \"kubernetes.io/projected/084f036b-fa7a-41de-986a-efde07572272-kube-api-access-2592d\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:24:14.451653 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.451586 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/084f036b-fa7a-41de-986a-efde07572272-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:24:14.480407 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.480371 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm"] Jul 17 18:24:14.481932 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:14.481890 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx"] Jul 17 18:24:14.482938 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:24:14.482905 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d13d43_c41f_457c_8537_7c91621fb7e4.slice/crio-780b90667a76380f96ca24d8db6532eb66b5096f1d91b532563993d5c575da2e WatchSource:0}: Error finding container 780b90667a76380f96ca24d8db6532eb66b5096f1d91b532563993d5c575da2e: Status 404 returned error can't find the container with id 780b90667a76380f96ca24d8db6532eb66b5096f1d91b532563993d5c575da2e Jul 17 18:24:14.483710 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:24:14.483688 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc357813a_fc20_4903_8eda_0160ab231833.slice/crio-971a76cc7297ef73d6096c2cb72fac422ebc3b1149624d111f6fbe7e273118e4 WatchSource:0}: Error finding container 971a76cc7297ef73d6096c2cb72fac422ebc3b1149624d111f6fbe7e273118e4: Status 404 returned error can't find the container with id 971a76cc7297ef73d6096c2cb72fac422ebc3b1149624d111f6fbe7e273118e4 Jul 17 18:24:14.646907 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.646872 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:14.648818 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.648787 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.650681 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.650660 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qzjqp\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="084f036b-fa7a-41de-986a-efde07572272" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qzjqp" Jul 17 18:24:14.652396 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:14.652367 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tr7nx\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tr7nx" Jul 17 18:24:15.331566 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.331521 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084f036b-fa7a-41de-986a-efde07572272" path="/var/lib/kubelet/pods/084f036b-fa7a-41de-986a-efde07572272/volumes" Jul 17 18:24:15.332118 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.331968 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8c15fc1-2cb2-4154-b7f5-b9e1ced80934" path="/var/lib/kubelet/pods/c8c15fc1-2cb2-4154-b7f5-b9e1ced80934/volumes" Jul 17 18:24:15.350157 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.350120 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" event={"ID":"c357813a-fc20-4903-8eda-0160ab231833","Type":"ContainerStarted","Data":"3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b"} Jul 17 18:24:15.350347 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.350171 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" event={"ID":"c357813a-fc20-4903-8eda-0160ab231833","Type":"ContainerStarted","Data":"971a76cc7297ef73d6096c2cb72fac422ebc3b1149624d111f6fbe7e273118e4"} Jul 17 18:24:15.350347 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.350232 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:15.351680 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.351650 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" event={"ID":"26d13d43-c41f-457c-8537-7c91621fb7e4","Type":"ContainerStarted","Data":"fa33e6412e1b2d87b95f579e0582a59693991e44f93d3fbd5add2460b5079a24"} Jul 17 18:24:15.351844 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.351702 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:15.351844 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.351728 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" event={"ID":"26d13d43-c41f-457c-8537-7c91621fb7e4","Type":"ContainerStarted","Data":"780b90667a76380f96ca24d8db6532eb66b5096f1d91b532563993d5c575da2e"} Jul 17 18:24:15.371297 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.371233 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" podStartSLOduration=14.371217345 podStartE2EDuration="14.371217345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:24:15.369858096 +0000 UTC m=+499.414258342" watchObservedRunningTime="2026-07-17 18:24:15.371217345 +0000 UTC m=+499.415617589" Jul 17 18:24:15.388220 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:15.388166 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" podStartSLOduration=14.388149366 podStartE2EDuration="14.388149366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:24:15.387165472 +0000 UTC m=+499.431565718" watchObservedRunningTime="2026-07-17 18:24:15.388149366 +0000 UTC m=+499.432549609" Jul 17 18:24:25.355168 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.355138 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:24:25.406906 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.406872 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx"] Jul 17 18:24:25.407115 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.407085 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" podUID="c357813a-fc20-4903-8eda-0160ab231833" containerName="manager" containerID="cri-o://3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b" gracePeriod=10 Jul 17 18:24:25.409058 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.409036 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:25.650403 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.650378 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:25.654461 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.654443 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c357813a-fc20-4903-8eda-0160ab231833-extensions-socket-volume\") pod \"c357813a-fc20-4903-8eda-0160ab231833\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " Jul 17 18:24:25.654595 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.654479 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzgqg\" (UniqueName: \"kubernetes.io/projected/c357813a-fc20-4903-8eda-0160ab231833-kube-api-access-dzgqg\") pod \"c357813a-fc20-4903-8eda-0160ab231833\" (UID: \"c357813a-fc20-4903-8eda-0160ab231833\") " Jul 17 18:24:25.654786 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.654764 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c357813a-fc20-4903-8eda-0160ab231833-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c357813a-fc20-4903-8eda-0160ab231833" (UID: "c357813a-fc20-4903-8eda-0160ab231833"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:24:25.656459 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.656436 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c357813a-fc20-4903-8eda-0160ab231833-kube-api-access-dzgqg" (OuterVolumeSpecName: "kube-api-access-dzgqg") pod "c357813a-fc20-4903-8eda-0160ab231833" (UID: "c357813a-fc20-4903-8eda-0160ab231833"). InnerVolumeSpecName "kube-api-access-dzgqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:24:25.755135 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.755105 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c357813a-fc20-4903-8eda-0160ab231833-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:24:25.755135 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:25.755133 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzgqg\" (UniqueName: \"kubernetes.io/projected/c357813a-fc20-4903-8eda-0160ab231833-kube-api-access-dzgqg\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:24:26.360259 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.360213 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f5cwm" Jul 17 18:24:26.406351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.406308 2569 generic.go:356] "Generic (PLEG): container finished" podID="c357813a-fc20-4903-8eda-0160ab231833" containerID="3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b" exitCode=0 Jul 17 18:24:26.406351 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.406355 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" Jul 17 18:24:26.406559 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.406382 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" event={"ID":"c357813a-fc20-4903-8eda-0160ab231833","Type":"ContainerDied","Data":"3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b"} Jul 17 18:24:26.406559 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.406442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx" event={"ID":"c357813a-fc20-4903-8eda-0160ab231833","Type":"ContainerDied","Data":"971a76cc7297ef73d6096c2cb72fac422ebc3b1149624d111f6fbe7e273118e4"} Jul 17 18:24:26.406559 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.406464 2569 scope.go:117] "RemoveContainer" containerID="3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b" Jul 17 18:24:26.416064 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.416040 2569 scope.go:117] "RemoveContainer" containerID="3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b" Jul 17 18:24:26.416422 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:24:26.416399 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b\": container with ID starting with 3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b not found: ID does not exist" containerID="3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b" Jul 17 18:24:26.416501 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.416435 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b"} err="failed to get container status \"3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b\": rpc error: code = NotFound desc = could not find container \"3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b\": container with ID starting with 3ce0da039fff97eba6d8b7906e2fa71cd5046f18cc49f115c1578ee3c6a12b3b not found: ID does not exist" Jul 17 18:24:26.428456 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.428430 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx"] Jul 17 18:24:26.433591 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:26.433569 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ldnfx"] Jul 17 18:24:27.331061 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:27.331023 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c357813a-fc20-4903-8eda-0160ab231833" path="/var/lib/kubelet/pods/c357813a-fc20-4903-8eda-0160ab231833/volumes" Jul 17 18:24:44.108735 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.108698 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:24:44.109211 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.109053 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c357813a-fc20-4903-8eda-0160ab231833" containerName="manager" Jul 17 18:24:44.109211 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.109066 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c357813a-fc20-4903-8eda-0160ab231833" containerName="manager" Jul 17 18:24:44.109211 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.109116 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c357813a-fc20-4903-8eda-0160ab231833" containerName="manager" Jul 17 18:24:44.384663 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.384576 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:24:44.384663 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.384621 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:24:44.384868 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.384714 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.385582 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.385550 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/767c793b-7188-4fd7-be2d-35074c177b98-config-file\") pod \"limitador-limitador-64c94fd64f-b5nvq\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.385678 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.385604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28796\" (UniqueName: \"kubernetes.io/projected/767c793b-7188-4fd7-be2d-35074c177b98-kube-api-access-28796\") pod \"limitador-limitador-64c94fd64f-b5nvq\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.386983 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.386965 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 18:24:44.486149 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.486112 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/767c793b-7188-4fd7-be2d-35074c177b98-config-file\") pod \"limitador-limitador-64c94fd64f-b5nvq\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.486149 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.486153 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28796\" (UniqueName: \"kubernetes.io/projected/767c793b-7188-4fd7-be2d-35074c177b98-kube-api-access-28796\") pod \"limitador-limitador-64c94fd64f-b5nvq\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.486832 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.486811 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/767c793b-7188-4fd7-be2d-35074c177b98-config-file\") pod \"limitador-limitador-64c94fd64f-b5nvq\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.499873 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.499848 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28796\" (UniqueName: \"kubernetes.io/projected/767c793b-7188-4fd7-be2d-35074c177b98-kube-api-access-28796\") pod \"limitador-limitador-64c94fd64f-b5nvq\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.695631 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.695524 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:44.832642 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:44.832593 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:24:44.839356 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:24:44.839331 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767c793b_7188_4fd7_be2d_35074c177b98.slice/crio-ce2f829c65e76b6bc2a5490471b98af81207531b2bb2b57e59c87a6b578442a0 WatchSource:0}: Error finding container ce2f829c65e76b6bc2a5490471b98af81207531b2bb2b57e59c87a6b578442a0: Status 404 returned error can't find the container with id ce2f829c65e76b6bc2a5490471b98af81207531b2bb2b57e59c87a6b578442a0 Jul 17 18:24:45.498697 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:45.498660 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" event={"ID":"767c793b-7188-4fd7-be2d-35074c177b98","Type":"ContainerStarted","Data":"ce2f829c65e76b6bc2a5490471b98af81207531b2bb2b57e59c87a6b578442a0"} Jul 17 18:24:48.515686 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:48.515645 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" event={"ID":"767c793b-7188-4fd7-be2d-35074c177b98","Type":"ContainerStarted","Data":"9b61c71552e772a45363d4033a386d9234e440afd9750b688cd3560b6ea069f9"} Jul 17 18:24:48.516137 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:48.515740 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:48.533130 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:48.533077 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" podStartSLOduration=1.790523947 podStartE2EDuration="4.533060208s" totalImagesPullingTime="2.742536261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:24:48.532196034 +0000 UTC m=+532.576596271" watchObservedRunningTime="2026-07-17 18:24:48.533060208 +0000 UTC m=+532.577460477" Jul 17 18:24:59.152267 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.152221 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:24:59.152719 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.152429 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" podUID="767c793b-7188-4fd7-be2d-35074c177b98" containerName="limitador" containerID="cri-o://9b61c71552e772a45363d4033a386d9234e440afd9750b688cd3560b6ea069f9" gracePeriod=30 Jul 17 18:24:59.153108 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.153089 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:59.567692 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.567663 2569 generic.go:356] "Generic (PLEG): container finished" podID="767c793b-7188-4fd7-be2d-35074c177b98" containerID="9b61c71552e772a45363d4033a386d9234e440afd9750b688cd3560b6ea069f9" exitCode=0 Jul 17 18:24:59.567829 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.567734 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" event={"ID":"767c793b-7188-4fd7-be2d-35074c177b98","Type":"ContainerDied","Data":"9b61c71552e772a45363d4033a386d9234e440afd9750b688cd3560b6ea069f9"} Jul 17 18:24:59.704361 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.704337 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:24:59.808458 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.808427 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28796\" (UniqueName: \"kubernetes.io/projected/767c793b-7188-4fd7-be2d-35074c177b98-kube-api-access-28796\") pod \"767c793b-7188-4fd7-be2d-35074c177b98\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " Jul 17 18:24:59.808619 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.808486 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/767c793b-7188-4fd7-be2d-35074c177b98-config-file\") pod \"767c793b-7188-4fd7-be2d-35074c177b98\" (UID: \"767c793b-7188-4fd7-be2d-35074c177b98\") " Jul 17 18:24:59.808848 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.808819 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/767c793b-7188-4fd7-be2d-35074c177b98-config-file" (OuterVolumeSpecName: "config-file") pod "767c793b-7188-4fd7-be2d-35074c177b98" (UID: "767c793b-7188-4fd7-be2d-35074c177b98"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:24:59.810625 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.810603 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767c793b-7188-4fd7-be2d-35074c177b98-kube-api-access-28796" (OuterVolumeSpecName: "kube-api-access-28796") pod "767c793b-7188-4fd7-be2d-35074c177b98" (UID: "767c793b-7188-4fd7-be2d-35074c177b98"). InnerVolumeSpecName "kube-api-access-28796". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:24:59.909856 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.909822 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28796\" (UniqueName: \"kubernetes.io/projected/767c793b-7188-4fd7-be2d-35074c177b98-kube-api-access-28796\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:24:59.909856 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:24:59.909853 2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/767c793b-7188-4fd7-be2d-35074c177b98-config-file\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:25:00.573397 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:00.573368 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" Jul 17 18:25:00.573397 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:00.573389 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b5nvq" event={"ID":"767c793b-7188-4fd7-be2d-35074c177b98","Type":"ContainerDied","Data":"ce2f829c65e76b6bc2a5490471b98af81207531b2bb2b57e59c87a6b578442a0"} Jul 17 18:25:00.573934 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:00.573446 2569 scope.go:117] "RemoveContainer" containerID="9b61c71552e772a45363d4033a386d9234e440afd9750b688cd3560b6ea069f9" Jul 17 18:25:00.609368 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:00.609335 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:25:00.616528 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:00.616498 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b5nvq"] Jul 17 18:25:01.331744 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:01.331703 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767c793b-7188-4fd7-be2d-35074c177b98" path="/var/lib/kubelet/pods/767c793b-7188-4fd7-be2d-35074c177b98/volumes" Jul 17 18:25:05.939752 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.939715 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n"] Jul 17 18:25:05.940124 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.940080 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767c793b-7188-4fd7-be2d-35074c177b98" containerName="limitador" Jul 17 18:25:05.940124 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.940098 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="767c793b-7188-4fd7-be2d-35074c177b98" containerName="limitador" Jul 17 18:25:05.940380 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.940359 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="767c793b-7188-4fd7-be2d-35074c177b98" containerName="limitador" Jul 17 18:25:05.943006 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.942990 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:05.947175 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.947155 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 17 18:25:05.947310 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.947291 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 18:25:05.947484 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.947468 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-fwzdp\"" Jul 17 18:25:05.948122 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.948104 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 18:25:05.953542 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:05.953516 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n"] Jul 17 18:25:06.063006 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.062969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa8ac49f-a435-42e3-b17f-c86c6cb6c341-data\") pod \"postgres-69fb4594cf-zcq4n\" (UID: \"aa8ac49f-a435-42e3-b17f-c86c6cb6c341\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.063180 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.063045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c8qh\" (UniqueName: \"kubernetes.io/projected/aa8ac49f-a435-42e3-b17f-c86c6cb6c341-kube-api-access-9c8qh\") pod \"postgres-69fb4594cf-zcq4n\" (UID: \"aa8ac49f-a435-42e3-b17f-c86c6cb6c341\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.163626 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.163569 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c8qh\" (UniqueName: \"kubernetes.io/projected/aa8ac49f-a435-42e3-b17f-c86c6cb6c341-kube-api-access-9c8qh\") pod \"postgres-69fb4594cf-zcq4n\" (UID: \"aa8ac49f-a435-42e3-b17f-c86c6cb6c341\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.163796 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.163665 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa8ac49f-a435-42e3-b17f-c86c6cb6c341-data\") pod \"postgres-69fb4594cf-zcq4n\" (UID: \"aa8ac49f-a435-42e3-b17f-c86c6cb6c341\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.164027 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.164012 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa8ac49f-a435-42e3-b17f-c86c6cb6c341-data\") pod \"postgres-69fb4594cf-zcq4n\" (UID: \"aa8ac49f-a435-42e3-b17f-c86c6cb6c341\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.176569 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.176540 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c8qh\" (UniqueName: \"kubernetes.io/projected/aa8ac49f-a435-42e3-b17f-c86c6cb6c341-kube-api-access-9c8qh\") pod \"postgres-69fb4594cf-zcq4n\" (UID: \"aa8ac49f-a435-42e3-b17f-c86c6cb6c341\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.253713 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.253619 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:06.408343 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.408312 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n"] Jul 17 18:25:06.411514 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:25:06.411485 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8ac49f_a435_42e3_b17f_c86c6cb6c341.slice/crio-ba7372f6352dda37879ff61b868638deb24f9c5e1e85e165469098b302c1dc6d WatchSource:0}: Error finding container ba7372f6352dda37879ff61b868638deb24f9c5e1e85e165469098b302c1dc6d: Status 404 returned error can't find the container with id ba7372f6352dda37879ff61b868638deb24f9c5e1e85e165469098b302c1dc6d Jul 17 18:25:06.601003 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:06.600967 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" event={"ID":"aa8ac49f-a435-42e3-b17f-c86c6cb6c341","Type":"ContainerStarted","Data":"ba7372f6352dda37879ff61b868638deb24f9c5e1e85e165469098b302c1dc6d"} Jul 17 18:25:11.626849 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:11.626812 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" event={"ID":"aa8ac49f-a435-42e3-b17f-c86c6cb6c341","Type":"ContainerStarted","Data":"578c4e6fc6944d24c9ecf84c17f6c3a07216de44fd2f195cc118e58cef231ef7"} Jul 17 18:25:11.627322 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:11.626901 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:25:11.654541 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:11.654479 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" podStartSLOduration=2.164181125 podStartE2EDuration="6.654463163s" totalImagesPullingTime="4.490282038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:25:11.653685902 +0000 UTC m=+555.698086147" watchObservedRunningTime="2026-07-17 18:25:11.654463163 +0000 UTC m=+555.698863408" Jul 17 18:25:17.661092 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:25:17.661056 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zcq4n" Jul 17 18:26:02.835835 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.835798 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2"] Jul 17 18:26:02.838968 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.838950 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:02.841601 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.841578 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sqfqz\"" Jul 17 18:26:02.842595 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.842574 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 17 18:26:02.853338 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.853311 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2"] Jul 17 18:26:02.944054 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.944010 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpkt\" (UniqueName: \"kubernetes.io/projected/29b903f6-c361-457e-aaf2-6093e5bb4984-kube-api-access-jrpkt\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:02.944235 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.944077 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b903f6-c361-457e-aaf2-6093e5bb4984-maas-api-tls\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:02.944235 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:02.944106 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b903f6-c361-457e-aaf2-6093e5bb4984-openshift-service-ca\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.045110 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.045071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b903f6-c361-457e-aaf2-6093e5bb4984-maas-api-tls\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.045328 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.045115 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b903f6-c361-457e-aaf2-6093e5bb4984-openshift-service-ca\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.045328 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.045201 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpkt\" (UniqueName: \"kubernetes.io/projected/29b903f6-c361-457e-aaf2-6093e5bb4984-kube-api-access-jrpkt\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.045921 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.045902 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29b903f6-c361-457e-aaf2-6093e5bb4984-openshift-service-ca\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.047532 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.047514 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29b903f6-c361-457e-aaf2-6093e5bb4984-maas-api-tls\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.064958 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.064932 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpkt\" (UniqueName: \"kubernetes.io/projected/29b903f6-c361-457e-aaf2-6093e5bb4984-kube-api-access-jrpkt\") pod \"maas-api-856fb9795b-5xbx2\" (UID: \"29b903f6-c361-457e-aaf2-6093e5bb4984\") " pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.148986 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.148898 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:03.295425 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.295388 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2"] Jul 17 18:26:03.298549 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:26:03.298520 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b903f6_c361_457e_aaf2_6093e5bb4984.slice/crio-fca2138efd9faf64937c8f95884e0e549439197864da75d0bfcc82a90d564e40 WatchSource:0}: Error finding container fca2138efd9faf64937c8f95884e0e549439197864da75d0bfcc82a90d564e40: Status 404 returned error can't find the container with id fca2138efd9faf64937c8f95884e0e549439197864da75d0bfcc82a90d564e40 Jul 17 18:26:03.633224 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.633184 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dq5vl"] Jul 17 18:26:03.636181 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.636160 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.638838 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.638813 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 18:26:03.648383 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.648354 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dq5vl"] Jul 17 18:26:03.752055 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.751995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbw7q\" (UniqueName: \"kubernetes.io/projected/8b6f31d2-8d8a-48b4-834c-6e5e06edc827-kube-api-access-wbw7q\") pod \"payload-processing-5bf47cd988-dq5vl\" (UID: \"8b6f31d2-8d8a-48b4-834c-6e5e06edc827\") " pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.752232 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.752139 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b6f31d2-8d8a-48b4-834c-6e5e06edc827-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dq5vl\" (UID: \"8b6f31d2-8d8a-48b4-834c-6e5e06edc827\") " pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.852600 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.852564 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbw7q\" (UniqueName: \"kubernetes.io/projected/8b6f31d2-8d8a-48b4-834c-6e5e06edc827-kube-api-access-wbw7q\") pod \"payload-processing-5bf47cd988-dq5vl\" (UID: \"8b6f31d2-8d8a-48b4-834c-6e5e06edc827\") " pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.853087 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.852665 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b6f31d2-8d8a-48b4-834c-6e5e06edc827-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dq5vl\" (UID: \"8b6f31d2-8d8a-48b4-834c-6e5e06edc827\") " pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.853591 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.853556 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b6f31d2-8d8a-48b4-834c-6e5e06edc827-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dq5vl\" (UID: \"8b6f31d2-8d8a-48b4-834c-6e5e06edc827\") " pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.869994 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.869964 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" event={"ID":"29b903f6-c361-457e-aaf2-6093e5bb4984","Type":"ContainerStarted","Data":"fca2138efd9faf64937c8f95884e0e549439197864da75d0bfcc82a90d564e40"} Jul 17 18:26:03.870161 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.870066 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbw7q\" (UniqueName: \"kubernetes.io/projected/8b6f31d2-8d8a-48b4-834c-6e5e06edc827-kube-api-access-wbw7q\") pod \"payload-processing-5bf47cd988-dq5vl\" (UID: \"8b6f31d2-8d8a-48b4-834c-6e5e06edc827\") " pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:03.948746 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:03.948658 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:04.137717 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:04.137623 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dq5vl"] Jul 17 18:26:04.141031 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:26:04.140346 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6f31d2_8d8a_48b4_834c_6e5e06edc827.slice/crio-88bba7d5ed4caa380dd15b513491598a053e0ce10b729b2b0e9266c64d831dbd WatchSource:0}: Error finding container 88bba7d5ed4caa380dd15b513491598a053e0ce10b729b2b0e9266c64d831dbd: Status 404 returned error can't find the container with id 88bba7d5ed4caa380dd15b513491598a053e0ce10b729b2b0e9266c64d831dbd Jul 17 18:26:04.875885 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:04.875844 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" event={"ID":"8b6f31d2-8d8a-48b4-834c-6e5e06edc827","Type":"ContainerStarted","Data":"88bba7d5ed4caa380dd15b513491598a053e0ce10b729b2b0e9266c64d831dbd"} Jul 17 18:26:05.885530 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:05.885456 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" event={"ID":"29b903f6-c361-457e-aaf2-6093e5bb4984","Type":"ContainerStarted","Data":"05f7232c09f73c5188a6a6f64d570126aba5053d122d24564161b5cc369d983e"} Jul 17 18:26:05.886557 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:05.886099 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:05.906295 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:05.906232 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" podStartSLOduration=1.6840246479999998 podStartE2EDuration="3.906214617s" totalImagesPullingTime="2.222189969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:05.904933213 +0000 UTC m=+609.949333482" watchObservedRunningTime="2026-07-17 18:26:05.906214617 +0000 UTC m=+609.950614861" Jul 17 18:26:07.898466 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:07.898425 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" event={"ID":"8b6f31d2-8d8a-48b4-834c-6e5e06edc827","Type":"ContainerStarted","Data":"7cf6eec46b073022ab56754009ea7e3cdf674522298bbb9903b82b47236d5f0f"} Jul 17 18:26:07.898996 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:07.898557 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:07.917809 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:07.917751 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" podStartSLOduration=1.779076093 podStartE2EDuration="4.917733393s" totalImagesPullingTime="3.1386573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:07.917426467 +0000 UTC m=+611.961826716" watchObservedRunningTime="2026-07-17 18:26:07.917733393 +0000 UTC m=+611.962133639" Jul 17 18:26:11.895974 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:11.895942 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-856fb9795b-5xbx2" Jul 17 18:26:18.905646 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:18.905569 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-dq5vl" Jul 17 18:26:28.541151 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.541118 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-997q7"] Jul 17 18:26:28.556061 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.556031 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.558158 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.558132 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-997q7"] Jul 17 18:26:28.559011 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.558990 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c8rxz\"" Jul 17 18:26:28.559297 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.559280 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 18:26:28.559386 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.559301 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 18:26:28.559817 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.559801 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 18:26:28.676191 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.676155 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.676191 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.676190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.676477 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.676210 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0805f-f565-44a9-b48a-89fb204b63d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.676477 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.676296 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmf82\" (UniqueName: \"kubernetes.io/projected/c0b0805f-f565-44a9-b48a-89fb204b63d5-kube-api-access-rmf82\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.676477 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.676365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.676477 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.676398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.776938 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.776901 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777228 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777008 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777228 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777039 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777228 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777063 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0805f-f565-44a9-b48a-89fb204b63d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777228 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmf82\" (UniqueName: \"kubernetes.io/projected/c0b0805f-f565-44a9-b48a-89fb204b63d5-kube-api-access-rmf82\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777228 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777636 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777573 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.777960 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.777934 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.778218 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.778196 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.780699 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.780668 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0805f-f565-44a9-b48a-89fb204b63d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.780812 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.780710 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0b0805f-f565-44a9-b48a-89fb204b63d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.787046 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.787020 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmf82\" (UniqueName: \"kubernetes.io/projected/c0b0805f-f565-44a9-b48a-89fb204b63d5-kube-api-access-rmf82\") pod \"e2e-distinct-simulated-kserve-59975d69f9-997q7\" (UID: \"c0b0805f-f565-44a9-b48a-89fb204b63d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:28.867502 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:28.867471 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:29.030846 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:29.030816 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-997q7"] Jul 17 18:26:29.032787 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:26:29.032760 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b0805f_f565_44a9_b48a_89fb204b63d5.slice/crio-bbef5aa9b362d4c401eaf280e63b73605938d9caccae66f49b5c72489c07f1f3 WatchSource:0}: Error finding container bbef5aa9b362d4c401eaf280e63b73605938d9caccae66f49b5c72489c07f1f3: Status 404 returned error can't find the container with id bbef5aa9b362d4c401eaf280e63b73605938d9caccae66f49b5c72489c07f1f3 Jul 17 18:26:30.005329 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:30.005277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" event={"ID":"c0b0805f-f565-44a9-b48a-89fb204b63d5","Type":"ContainerStarted","Data":"bbef5aa9b362d4c401eaf280e63b73605938d9caccae66f49b5c72489c07f1f3"} Jul 17 18:26:31.011471 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:31.011432 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" event={"ID":"c0b0805f-f565-44a9-b48a-89fb204b63d5","Type":"ContainerStarted","Data":"2f1d39fd3b3bf2e7de8f98f1b69ca466c22926d0fa948eb22dd4edac3410a24b"} Jul 17 18:26:31.035218 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:31.035155 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" podStartSLOduration=1.937843908 podStartE2EDuration="3.035136647s" totalImagesPullingTime="1.097292739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:31.034857477 +0000 UTC m=+635.079257792" watchObservedRunningTime="2026-07-17 18:26:31.035136647 +0000 UTC m=+635.079536891" Jul 17 18:26:36.239153 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.239120 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h"] Jul 17 18:26:36.242661 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.242642 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.245748 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.245729 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 18:26:36.258882 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.258847 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h"] Jul 17 18:26:36.432261 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.432201 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.432440 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.432334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.432440 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.432361 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1446f0a2-5397-4670-ba1f-ad3d157f05c4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.432440 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.432380 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.432550 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.432477 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.432550 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.432522 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p5gn\" (UniqueName: \"kubernetes.io/projected/1446f0a2-5397-4670-ba1f-ad3d157f05c4-kube-api-access-4p5gn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.532921 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.532890 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533151 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.532958 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533151 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.532983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1446f0a2-5397-4670-ba1f-ad3d157f05c4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533151 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.533010 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533151 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.533067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533151 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.533112 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p5gn\" (UniqueName: \"kubernetes.io/projected/1446f0a2-5397-4670-ba1f-ad3d157f05c4-kube-api-access-4p5gn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533536 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.533390 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533536 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.533471 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.533695 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.533675 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.535307 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.535281 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1446f0a2-5397-4670-ba1f-ad3d157f05c4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.535580 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.535557 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1446f0a2-5397-4670-ba1f-ad3d157f05c4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.541888 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.541863 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p5gn\" (UniqueName: \"kubernetes.io/projected/1446f0a2-5397-4670-ba1f-ad3d157f05c4-kube-api-access-4p5gn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5s72h\" (UID: \"1446f0a2-5397-4670-ba1f-ad3d157f05c4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.552571 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.552549 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:36.684747 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:36.684724 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h"] Jul 17 18:26:36.687506 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:26:36.687478 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1446f0a2_5397_4670_ba1f_ad3d157f05c4.slice/crio-b1ac5decc8eee857499264739f735dc89fb14fa704ea17040c00c00d64d19044 WatchSource:0}: Error finding container b1ac5decc8eee857499264739f735dc89fb14fa704ea17040c00c00d64d19044: Status 404 returned error can't find the container with id b1ac5decc8eee857499264739f735dc89fb14fa704ea17040c00c00d64d19044 Jul 17 18:26:37.040392 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:37.040356 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" event={"ID":"1446f0a2-5397-4670-ba1f-ad3d157f05c4","Type":"ContainerStarted","Data":"afc7a7e0d4438a783ba9a7e69f4a2a2b42912c7d95a3df3ad75c79620b4e8874"} Jul 17 18:26:37.040565 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:37.040419 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" event={"ID":"1446f0a2-5397-4670-ba1f-ad3d157f05c4","Type":"ContainerStarted","Data":"b1ac5decc8eee857499264739f735dc89fb14fa704ea17040c00c00d64d19044"} Jul 17 18:26:37.059606 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:37.059550 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" podStartSLOduration=0.877336094 podStartE2EDuration="1.059533165s" totalImagesPullingTime="182.197071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:37.058805978 +0000 UTC m=+641.103206238" watchObservedRunningTime="2026-07-17 18:26:37.059533165 +0000 UTC m=+641.103933444" Jul 17 18:26:38.867631 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:38.867600 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:38.868108 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:38.867661 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:38.881778 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:38.881745 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:39.067418 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:39.067386 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-997q7" Jul 17 18:26:46.553702 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:46.553659 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:46.554173 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:46.553727 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:46.566830 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:46.566802 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:26:47.103882 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:26:47.103855 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5s72h" Jul 17 18:27:27.118635 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.118598 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk"] Jul 17 18:27:27.122085 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.122055 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.131539 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.131515 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 17 18:27:27.161714 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.161678 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk"] Jul 17 18:27:27.264044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.264009 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.264044 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.264047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.264370 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.264068 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.264370 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.264091 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kstq7\" (UniqueName: \"kubernetes.io/projected/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-kube-api-access-kstq7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.264370 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.264193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.264370 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.264309 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365162 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365121 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365186 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365207 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365226 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365281 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstq7\" (UniqueName: \"kubernetes.io/projected/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-kube-api-access-kstq7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365381 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365733 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365682 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365733 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365708 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.365895 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.365872 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.367660 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.367639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.367934 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.367915 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.376719 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.376648 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kstq7\" (UniqueName: \"kubernetes.io/projected/b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a-kube-api-access-kstq7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk\" (UID: \"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.431365 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.431326 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:27.573602 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.573532 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk"] Jul 17 18:27:27.576145 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:27:27.576113 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6b46fd8_f1bf_4e39_9b40_b778b3d06c3a.slice/crio-160eabd943a7eae1ba708923dc801a6e0f45000fb0541b0cc7761e26907ee011 WatchSource:0}: Error finding container 160eabd943a7eae1ba708923dc801a6e0f45000fb0541b0cc7761e26907ee011: Status 404 returned error can't find the container with id 160eabd943a7eae1ba708923dc801a6e0f45000fb0541b0cc7761e26907ee011 Jul 17 18:27:27.578005 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:27.577983 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:27:28.283326 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:28.283281 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" event={"ID":"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a","Type":"ContainerStarted","Data":"4770b711c0db918e7231881c6c37611459a4cdfc2d2c7fbccaf50372e8ea41a9"} Jul 17 18:27:28.283326 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:28.283333 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" event={"ID":"b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a","Type":"ContainerStarted","Data":"160eabd943a7eae1ba708923dc801a6e0f45000fb0541b0cc7761e26907ee011"} Jul 17 18:27:28.306128 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:28.306063 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" podStartSLOduration=1.117493818 podStartE2EDuration="1.306045928s" totalImagesPullingTime="188.55211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:27:28.305155363 +0000 UTC m=+692.349555607" watchObservedRunningTime="2026-07-17 18:27:28.306045928 +0000 UTC m=+692.350446173" Jul 17 18:27:37.432439 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:37.432392 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:37.432836 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:37.432454 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:37.445348 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:37.445324 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:27:38.347157 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:27:38.347124 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk" Jul 17 18:35:16.748751 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:16.748711 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd"] Jul 17 18:35:16.749337 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:16.748974 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" podUID="a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" containerName="manager" containerID="cri-o://8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d" gracePeriod=10 Jul 17 18:35:19.416875 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.416849 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:35:19.529899 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.529810 2569 generic.go:356] "Generic (PLEG): container finished" podID="a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" containerID="8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d" exitCode=0 Jul 17 18:35:19.529899 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.529859 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" Jul 17 18:35:19.530081 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.529896 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" event={"ID":"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d","Type":"ContainerDied","Data":"8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d"} Jul 17 18:35:19.530081 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.529955 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd" event={"ID":"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d","Type":"ContainerDied","Data":"c68ec3d383e65c884c7dcc9fbcd7ee6ddb9a6421c1820a1e5d745b4ad943b9a8"} Jul 17 18:35:19.530081 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.529979 2569 scope.go:117] "RemoveContainer" containerID="8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d" Jul 17 18:35:19.531337 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.531316 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-extensions-socket-volume\") pod \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " Jul 17 18:35:19.531479 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.531362 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7pkf\" (UniqueName: \"kubernetes.io/projected/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-kube-api-access-m7pkf\") pod \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\" (UID: \"a2e1c0dc-9406-4bde-8e77-617a90ed1f7d\") " Jul 17 18:35:19.531774 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.531752 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" (UID: "a2e1c0dc-9406-4bde-8e77-617a90ed1f7d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:35:19.533639 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.533613 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-kube-api-access-m7pkf" (OuterVolumeSpecName: "kube-api-access-m7pkf") pod "a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" (UID: "a2e1c0dc-9406-4bde-8e77-617a90ed1f7d"). InnerVolumeSpecName "kube-api-access-m7pkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:35:19.544608 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.544586 2569 scope.go:117] "RemoveContainer" containerID="8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d" Jul 17 18:35:19.544915 ip-10-0-136-174 kubenswrapper[2569]: E0717 18:35:19.544894 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d\": container with ID starting with 8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d not found: ID does not exist" containerID="8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d" Jul 17 18:35:19.544976 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.544930 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d"} err="failed to get container status \"8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d\": rpc error: code = NotFound desc = could not find container \"8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d\": container with ID starting with 8b75e8292d400dc58cfaa6b3206e3758d8f40dbd65544f42befe157fbc1c632d not found: ID does not exist" Jul 17 18:35:19.632970 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.632938 2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:35:19.632970 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.632964 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7pkf\" (UniqueName: \"kubernetes.io/projected/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d-kube-api-access-m7pkf\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\"" Jul 17 18:35:19.853015 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.852987 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd"] Jul 17 18:35:19.859378 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:19.859354 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m7sdd"] Jul 17 18:35:21.331322 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:35:21.331287 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" path="/var/lib/kubelet/pods/a2e1c0dc-9406-4bde-8e77-617a90ed1f7d/volumes" Jul 17 18:36:17.922831 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.922796 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg"] Jul 17 18:36:17.923270 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.923145 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" containerName="manager" Jul 17 18:36:17.923270 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.923155 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" containerName="manager" Jul 17 18:36:17.923270 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.923234 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2e1c0dc-9406-4bde-8e77-617a90ed1f7d" containerName="manager" Jul 17 18:36:17.927488 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.927472 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:17.931395 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.931373 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5658k\"" Jul 17 18:36:17.936186 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:17.936161 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg"] Jul 17 18:36:18.049174 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.049135 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pw9r\" (UniqueName: \"kubernetes.io/projected/5808826b-1b89-4357-9bf4-380e2c652a23-kube-api-access-9pw9r\") pod \"kuadrant-operator-controller-manager-86878c769f-fl4tg\" (UID: \"5808826b-1b89-4357-9bf4-380e2c652a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.049382 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.049194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5808826b-1b89-4357-9bf4-380e2c652a23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fl4tg\" (UID: \"5808826b-1b89-4357-9bf4-380e2c652a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.149882 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.149847 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pw9r\" (UniqueName: \"kubernetes.io/projected/5808826b-1b89-4357-9bf4-380e2c652a23-kube-api-access-9pw9r\") pod \"kuadrant-operator-controller-manager-86878c769f-fl4tg\" (UID: \"5808826b-1b89-4357-9bf4-380e2c652a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.150064 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.149898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5808826b-1b89-4357-9bf4-380e2c652a23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fl4tg\" (UID: \"5808826b-1b89-4357-9bf4-380e2c652a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.150374 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.150354 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5808826b-1b89-4357-9bf4-380e2c652a23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fl4tg\" (UID: \"5808826b-1b89-4357-9bf4-380e2c652a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.160176 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.160151 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pw9r\" (UniqueName: \"kubernetes.io/projected/5808826b-1b89-4357-9bf4-380e2c652a23-kube-api-access-9pw9r\") pod \"kuadrant-operator-controller-manager-86878c769f-fl4tg\" (UID: \"5808826b-1b89-4357-9bf4-380e2c652a23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.237967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.237884 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.398757 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.398729 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg"] Jul 17 18:36:18.399721 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:36:18.399700 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5808826b_1b89_4357_9bf4_380e2c652a23.slice/crio-a44602115566ad4bc53f9ce0c754fa13c3f9ea37c324ebdb591037ffce9a9727 WatchSource:0}: Error finding container a44602115566ad4bc53f9ce0c754fa13c3f9ea37c324ebdb591037ffce9a9727: Status 404 returned error can't find the container with id a44602115566ad4bc53f9ce0c754fa13c3f9ea37c324ebdb591037ffce9a9727 Jul 17 18:36:18.813967 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.813934 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" event={"ID":"5808826b-1b89-4357-9bf4-380e2c652a23","Type":"ContainerStarted","Data":"f0e493606b230e7054c38860fd304f5f9d892066fe0e7c5a0ee78ef8f2260964"} Jul 17 18:36:18.814148 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.813995 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:36:18.814148 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.814018 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" event={"ID":"5808826b-1b89-4357-9bf4-380e2c652a23","Type":"ContainerStarted","Data":"a44602115566ad4bc53f9ce0c754fa13c3f9ea37c324ebdb591037ffce9a9727"} Jul 17 18:36:18.859418 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:18.859366 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" podStartSLOduration=1.859348167 podStartE2EDuration="1.859348167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:36:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:36:18.859276781 +0000 UTC m=+1222.903677024" watchObservedRunningTime="2026-07-17 18:36:18.859348167 +0000 UTC m=+1222.903748410" Jul 17 18:36:29.821388 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:36:29.821359 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fl4tg" Jul 17 18:43:55.144066 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:55.144028 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6nc98_f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb/manager/0.log" Jul 17 18:43:55.273754 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:55.273714 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rglc5_215a8dc3-9920-4a08-b5dc-130884601da7/manager/0.log" Jul 17 18:43:55.539519 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:55.539437 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mfxcs_fffafcc0-a8e2-4d57-92e4-6f32a3cc731d/server/0.log" Jul 17 18:43:55.668317 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:55.668272 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zlnm_7da711e8-e662-4752-8c58-3b589def1aab/manager/0.log" Jul 17 18:43:55.789659 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:55.789574 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c97dcbdf-5ls5f_44a716fa-afb5-48a5-b905-cb6b3bc97715/copy-manifests/0.log" Jul 17 18:43:55.797987 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:55.797957 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c97dcbdf-5ls5f_44a716fa-afb5-48a5-b905-cb6b3bc97715/manager/0.log" Jul 17 18:43:56.470170 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:56.470141 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-856fb9795b-5xbx2_29b903f6-c361-457e-aaf2-6093e5bb4984/maas-api/0.log" Jul 17 18:43:56.709365 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:56.709340 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zcq4n_aa8ac49f-a435-42e3-b17f-c86c6cb6c341/postgres/0.log" Jul 17 18:43:58.217703 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:58.217668 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-x4z2j_2ca0f477-0d65-41c1-abc5-c572b7dde96d/manager/0.log" Jul 17 18:43:58.337518 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:58.337484 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ff4bm_0490fd85-d44d-4dd2-a877-e53c2d846934/manager/0.log" Jul 17 18:43:58.456383 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:58.456357 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s47gl_2bc23cec-a9e5-472f-946a-1f34bf04bf96/kuadrant-console-plugin/0.log" Jul 17 18:43:58.586879 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:58.586845 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qtgp5_ee6f74b3-af0d-490e-9fe5-df55a4940aff/registry-server/0.log" Jul 17 18:43:58.721159 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:58.721125 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fl4tg_5808826b-1b89-4357-9bf4-380e2c652a23/manager/0.log" Jul 17 18:43:58.997544 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:58.997449 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f5cwm_26d13d43-c41f-457c-8537-7c91621fb7e4/manager/0.log" Jul 17 18:43:59.617399 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:43:59.617368 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55dd66f79f-qr4jb_998d38d7-c0f1-40e2-9296-390188d093ed/kube-auth-proxy/0.log" Jul 17 18:44:00.105994 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:00.105959 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dq5vl_8b6f31d2-8d8a-48b4-834c-6e5e06edc827/payload-processing/0.log" Jul 17 18:44:00.222975 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:00.222947 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d94db4774-hj7jp_472565f6-6b10-4c1a-9fab-4bc337422849/router/0.log" Jul 17 18:44:00.707971 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:00.707934 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-997q7_c0b0805f-f565-44a9-b48a-89fb204b63d5/main/0.log" Jul 17 18:44:00.830805 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:00.830774 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5s72h_1446f0a2-5397-4670-ba1f-ad3d157f05c4/main/0.log" Jul 17 18:44:01.219390 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:01.219362 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-f8sdk_b6b46fd8-f1bf-4e39-9b40-b778b3d06c3a/main/0.log" Jul 17 18:44:10.593299 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:10.593222 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gfpz4_d259984a-d57a-40d6-98ad-5693f379467e/global-pull-secret-syncer/0.log" Jul 17 18:44:10.758129 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:10.758093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m52p7_d42a7e9e-7ab7-4601-8ee4-22bb48a4c0e7/konnectivity-agent/0.log" Jul 17 18:44:10.778947 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:10.778913 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-174.ec2.internal_6230e03fa0ffb4d76dbad775c022c2a4/haproxy/0.log" Jul 17 18:44:16.288177 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:16.288147 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-x4z2j_2ca0f477-0d65-41c1-abc5-c572b7dde96d/manager/0.log" Jul 17 18:44:16.318012 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:16.317971 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ff4bm_0490fd85-d44d-4dd2-a877-e53c2d846934/manager/0.log" Jul 17 18:44:16.351484 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:16.351454 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s47gl_2bc23cec-a9e5-472f-946a-1f34bf04bf96/kuadrant-console-plugin/0.log" Jul 17 18:44:16.394703 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:16.394666 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qtgp5_ee6f74b3-af0d-490e-9fe5-df55a4940aff/registry-server/0.log" Jul 17 18:44:16.492892 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:16.492853 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fl4tg_5808826b-1b89-4357-9bf4-380e2c652a23/manager/0.log" Jul 17 18:44:16.584017 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:16.583975 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f5cwm_26d13d43-c41f-457c-8537-7c91621fb7e4/manager/0.log" Jul 17 18:44:18.528550 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:18.528511 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-twrhp_db200087-0d46-4376-8c08-77b87561c29d/cluster-monitoring-operator/0.log" Jul 17 18:44:18.959048 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:18.959008 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzbmb_c7e92c0a-6b34-4426-b680-a56c5ae9f5df/node-exporter/0.log" Jul 17 18:44:18.990891 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:18.990868 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzbmb_c7e92c0a-6b34-4426-b680-a56c5ae9f5df/kube-rbac-proxy/0.log" Jul 17 18:44:19.017423 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:19.017396 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nzbmb_c7e92c0a-6b34-4426-b680-a56c5ae9f5df/init-textfile/0.log" Jul 17 18:44:20.140145 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.140106 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m"] Jul 17 18:44:20.143837 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.143815 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.146427 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.146405 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp5dl\"/\"kube-root-ca.crt\"" Jul 17 18:44:20.146561 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.146504 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tp5dl\"/\"default-dockercfg-45mlf\"" Jul 17 18:44:20.147349 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.147334 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp5dl\"/\"openshift-service-ca.crt\"" Jul 17 18:44:20.158302 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.158278 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m"] Jul 17 18:44:20.276716 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.276662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-sys\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.276716 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.276712 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-proc\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.276963 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.276783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79cln\" (UniqueName: \"kubernetes.io/projected/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-kube-api-access-79cln\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.276963 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.276814 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-podres\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.276963 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.276888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-lib-modules\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378260 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-sys\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-proc\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378313 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79cln\" (UniqueName: \"kubernetes.io/projected/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-kube-api-access-79cln\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378325 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-sys\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-podres\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378385 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-proc\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378445 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378410 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-lib-modules\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378651 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378533 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-lib-modules\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.378651 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.378540 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-podres\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.392625 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.392566 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79cln\" (UniqueName: \"kubernetes.io/projected/a57ac9a5-7486-4fa9-bfc9-28b41a265a45-kube-api-access-79cln\") pod \"perf-node-gather-daemonset-b2g2m\" (UID: \"a57ac9a5-7486-4fa9-bfc9-28b41a265a45\") " pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.453923 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.453885 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:20.598540 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:20.598513 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m"] Jul 17 18:44:20.601502 ip-10-0-136-174 kubenswrapper[2569]: W0717 18:44:20.601457 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda57ac9a5_7486_4fa9_bfc9_28b41a265a45.slice/crio-0ab1ed7adc6fdf026ea333170ec02a0462c70245d204e4166a617c96c46db7fc WatchSource:0}: Error finding container 0ab1ed7adc6fdf026ea333170ec02a0462c70245d204e4166a617c96c46db7fc: Status 404 returned error can't find the container with id 0ab1ed7adc6fdf026ea333170ec02a0462c70245d204e4166a617c96c46db7fc Jul 17 18:44:21.082841 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:21.082803 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" event={"ID":"a57ac9a5-7486-4fa9-bfc9-28b41a265a45","Type":"ContainerStarted","Data":"ce0c6c0ab17cea2d7deb0a9e3f377075c4a1f1a712b29dfc0f3082c22689cafb"} Jul 17 18:44:21.083007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:21.082891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" event={"ID":"a57ac9a5-7486-4fa9-bfc9-28b41a265a45","Type":"ContainerStarted","Data":"0ab1ed7adc6fdf026ea333170ec02a0462c70245d204e4166a617c96c46db7fc"} Jul 17 18:44:21.083007 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:21.082919 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:21.109881 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:21.109827 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" podStartSLOduration=1.109810947 podStartE2EDuration="1.109810947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:21.107205557 +0000 UTC m=+1705.151605803" watchObservedRunningTime="2026-07-17 18:44:21.109810947 +0000 UTC m=+1705.154211245" Jul 17 18:44:24.062677 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:24.062647 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vlpvt_3f96ac85-0af3-4d7e-88c6-311f493ab742/dns/0.log" Jul 17 18:44:24.088062 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:24.088031 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vlpvt_3f96ac85-0af3-4d7e-88c6-311f493ab742/kube-rbac-proxy/0.log" Jul 17 18:44:24.162893 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:24.162862 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sh4fx_e135cff5-a3d7-4d6d-9f50-d07ee46dc149/dns-node-resolver/0.log" Jul 17 18:44:24.751902 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:24.751871 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bn7l_d3025e01-c1d0-4da7-9da5-e8a26336a692/node-ca/0.log" Jul 17 18:44:25.854632 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:25.854599 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55dd66f79f-qr4jb_998d38d7-c0f1-40e2-9296-390188d093ed/kube-auth-proxy/0.log" Jul 17 18:44:26.063979 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:26.063948 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dq5vl_8b6f31d2-8d8a-48b4-834c-6e5e06edc827/payload-processing/0.log" Jul 17 18:44:26.100254 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:26.100222 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d94db4774-hj7jp_472565f6-6b10-4c1a-9fab-4bc337422849/router/0.log" Jul 17 18:44:26.796147 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:26.796109 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5vvd7_71a328f6-a7af-44a0-9494-eb4c5c9d8ef6/serve-healthcheck-canary/0.log" Jul 17 18:44:27.098312 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:27.098283 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tp5dl/perf-node-gather-daemonset-b2g2m" Jul 17 18:44:27.457775 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:27.457691 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmjr7_6691bd54-709b-4361-92ad-e7c89547b445/kube-rbac-proxy/0.log" Jul 17 18:44:27.491974 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:27.491943 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmjr7_6691bd54-709b-4361-92ad-e7c89547b445/exporter/0.log" Jul 17 18:44:27.526174 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:27.526144 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmjr7_6691bd54-709b-4361-92ad-e7c89547b445/extractor/0.log" Jul 17 18:44:30.482358 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:30.482262 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6nc98_f576a8ea-8d9c-46ea-ac74-9ed4e6aa75bb/manager/0.log" Jul 17 18:44:30.595649 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:30.595621 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rglc5_215a8dc3-9920-4a08-b5dc-130884601da7/manager/0.log" Jul 17 18:44:30.725468 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:30.725439 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mfxcs_fffafcc0-a8e2-4d57-92e4-6f32a3cc731d/server/0.log" Jul 17 18:44:30.807110 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:30.807079 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zlnm_7da711e8-e662-4752-8c58-3b589def1aab/manager/0.log" Jul 17 18:44:30.848361 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:30.848335 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c97dcbdf-5ls5f_44a716fa-afb5-48a5-b905-cb6b3bc97715/manager/0.log" Jul 17 18:44:30.887022 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:30.886994 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c97dcbdf-5ls5f_44a716fa-afb5-48a5-b905-cb6b3bc97715/copy-manifests/0.log" Jul 17 18:44:31.511595 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:31.511560 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55dd66f79f-qr4jb_998d38d7-c0f1-40e2-9296-390188d093ed/kube-auth-proxy/0.log" Jul 17 18:44:31.815132 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:31.815103 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dq5vl_8b6f31d2-8d8a-48b4-834c-6e5e06edc827/payload-processing/0.log" Jul 17 18:44:31.853082 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:31.853052 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d94db4774-hj7jp_472565f6-6b10-4c1a-9fab-4bc337422849/router/0.log" Jul 17 18:44:33.143474 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:33.143445 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55dd66f79f-qr4jb_998d38d7-c0f1-40e2-9296-390188d093ed/kube-auth-proxy/0.log" Jul 17 18:44:33.303920 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:33.303888 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dq5vl_8b6f31d2-8d8a-48b4-834c-6e5e06edc827/payload-processing/0.log" Jul 17 18:44:33.328228 ip-10-0-136-174 kubenswrapper[2569]: I0717 18:44:33.328197 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d94db4774-hj7jp_472565f6-6b10-4c1a-9fab-4bc337422849/router/0.log"