Jul 14 20:22:17.293657 ip-10-0-142-126 systemd[1]: Starting Kubernetes Kubelet... Jul 14 20:22:17.660741 ip-10-0-142-126 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 20:22:17.660741 ip-10-0-142-126 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 20:22:17.660741 ip-10-0-142-126 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 20:22:17.660741 ip-10-0-142-126 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 20:22:17.660741 ip-10-0-142-126 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 20:22:17.661600 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.661509 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 20:22:17.666866 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666843 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:17.666866 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666862 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:17.666866 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666866 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:17.666866 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666869 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:17.666866 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666872 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:17.666866 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666876 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666879 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666882 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666885 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666887 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666890 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666892 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666895 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666898 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666900 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666902 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666905 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666907 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666910 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666913 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666915 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666918 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666921 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666923 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666925 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:17.667099 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666928 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666930 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666933 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666935 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666937 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666940 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666943 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666946 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666949 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666951 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666954 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666957 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666959 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666961 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666965 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666967 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666970 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666974 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666978 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:17.667595 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666981 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666984 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666986 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666989 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666991 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666994 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666996 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.666999 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667002 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667005 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667008 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667010 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667012 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667015 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667017 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667019 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667022 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667025 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667028 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667030 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:17.668085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667033 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667036 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667039 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667041 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667044 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667054 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667058 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667061 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667064 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667066 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667069 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667073 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667077 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667080 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667084 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667086 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667089 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667092 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667094 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:17.668584 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667100 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667104 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667107 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667110 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667113 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667116 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667119 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667122 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667125 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667127 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667130 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667132 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667135 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667137 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667140 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667143 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667888 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667894 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667898 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667901 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:17.669036 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667904 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667907 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667910 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667912 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667915 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667917 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667920 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667923 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667925 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667927 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667930 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667932 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667937 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667947 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667950 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667953 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667956 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667959 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667961 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:17.669530 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667964 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667966 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667969 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667971 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667974 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667977 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667979 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667984 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667986 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667989 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667992 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667995 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.667999 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668003 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668006 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668009 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668012 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668014 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668017 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:17.670000 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668020 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668022 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668025 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668028 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668030 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668032 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668035 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668037 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668045 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668048 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668050 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668053 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668055 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668058 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668060 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668062 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668065 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668067 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668069 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668072 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:17.670483 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668074 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668077 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668079 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668082 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668084 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668086 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668089 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668092 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668094 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668097 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668100 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668102 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668105 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668107 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668109 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668112 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668114 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668117 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668119 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668121 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:17.670957 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668124 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668139 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668142 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668147 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668150 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668153 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668155 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668158 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668160 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668163 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668165 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668168 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668171 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668174 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668176 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668178 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668181 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668607 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668615 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:17.671456 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668619 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668621 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668624 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668626 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668629 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668631 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668634 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668636 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668639 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668641 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668644 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668646 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668649 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668651 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668659 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668662 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668665 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668667 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668671 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668675 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:17.671926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668678 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668682 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668685 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668688 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668690 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668693 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668696 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668698 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668700 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668703 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668706 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668709 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668712 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668714 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668716 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668719 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668721 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668724 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668726 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:17.672424 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668729 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668731 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668733 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668736 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668738 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668740 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668748 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668751 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668759 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668762 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668765 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668767 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668770 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668772 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668774 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668777 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668779 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668782 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668784 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:17.672887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668787 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668789 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668792 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668794 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668797 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668800 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668803 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668805 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668807 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668810 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668813 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668815 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668817 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668820 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668822 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668825 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668827 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668830 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668832 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668839 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:17.673367 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668842 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668844 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668853 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668856 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668858 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668862 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668865 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668867 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668869 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668872 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668875 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668879 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668881 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668884 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668886 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668888 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668891 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668894 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.668897 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668968 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668975 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 20:22:17.673887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668983 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668988 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668991 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668994 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.668998 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669003 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669005 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669008 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669011 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669014 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669017 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669020 2554 flags.go:64] FLAG: --cgroup-root="" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669023 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669026 2554 flags.go:64] FLAG: --client-ca-file="" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669034 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669037 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669046 2554 flags.go:64] FLAG: --cluster-domain="" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669049 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669052 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669055 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669058 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669062 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669065 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 20:22:17.674395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669067 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669070 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669074 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669076 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669079 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669083 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669086 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669090 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669093 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669096 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669098 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669101 2554 flags.go:64] FLAG: --enable-server="true" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669103 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669110 2554 flags.go:64] FLAG: --event-burst="100" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669113 2554 flags.go:64] FLAG: --event-qps="50" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669115 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669118 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669121 2554 flags.go:64] FLAG: --eviction-hard="" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669124 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669127 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669130 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669133 2554 flags.go:64] FLAG: --eviction-soft="" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669136 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669138 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669147 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 20:22:17.674974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669151 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669154 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669157 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669160 2554 flags.go:64] FLAG: --feature-gates="" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669163 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669166 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669170 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669173 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669175 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669178 2554 flags.go:64] FLAG: --help="false" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669181 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-142-126.ec2.internal" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669184 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669188 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669191 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669194 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669197 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669200 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669203 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669205 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669208 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669211 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669214 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669216 2554 flags.go:64] FLAG: --kube-reserved="" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669219 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 20:22:17.675611 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669222 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669224 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669227 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669230 2554 flags.go:64] FLAG: --lock-file="" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669232 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669235 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669238 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669243 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669252 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669255 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669258 2554 flags.go:64] FLAG: --logging-format="text" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669261 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669264 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669266 2554 flags.go:64] FLAG: --manifest-url="" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669269 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669273 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669276 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669280 2554 flags.go:64] FLAG: --max-pods="110" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669282 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669285 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669290 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669293 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669296 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669298 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669301 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 20:22:17.676196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669312 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669314 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669317 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669320 2554 flags.go:64] FLAG: --pod-cidr="" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669323 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669328 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669330 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669333 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669336 2554 flags.go:64] FLAG: --port="10250" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669339 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669341 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a44b8e78b8cc5d3d" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669344 2554 flags.go:64] FLAG: --qos-reserved="" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669347 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669350 2554 flags.go:64] FLAG: --register-node="true" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669353 2554 flags.go:64] FLAG: --register-with-taints="" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669358 2554 flags.go:64] FLAG: --registry-burst="10" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669366 2554 flags.go:64] FLAG: --registry-qps="5" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669369 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669372 2554 flags.go:64] FLAG: --reserved-memory="" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669376 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669378 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669399 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669404 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669407 2554 flags.go:64] FLAG: --runonce="false" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669409 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 20:22:17.676814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669412 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669415 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669418 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669423 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669426 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669437 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669440 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669443 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669445 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669448 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669451 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669453 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669457 2554 flags.go:64] FLAG: --system-cgroups="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669459 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669464 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669467 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669470 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669477 2554 flags.go:64] FLAG: --tls-min-version="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669479 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669482 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669484 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669487 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669491 2554 flags.go:64] FLAG: --v="2" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669495 2554 flags.go:64] FLAG: --version="false" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669505 2554 flags.go:64] FLAG: --vmodule="" Jul 14 20:22:17.677482 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669508 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.669511 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669634 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669638 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669641 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669644 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669648 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669650 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669653 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669656 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669660 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669662 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669665 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669668 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669672 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669675 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669678 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669681 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669684 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669687 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:17.678082 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669690 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669692 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669696 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669698 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669701 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669704 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669707 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669709 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669711 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669715 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669718 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669720 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669724 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669726 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669729 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669731 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669733 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669736 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669739 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669743 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:17.678635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669746 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669748 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669752 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669754 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669756 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669759 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669761 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669764 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669766 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669769 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669771 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669773 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669776 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669778 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669781 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669783 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669786 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669788 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669790 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669793 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:17.679133 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669795 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669802 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669805 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669807 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669809 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669814 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669817 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669820 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669823 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669825 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669828 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669831 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669834 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669836 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669840 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669842 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669845 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669847 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:17.679747 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669850 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669852 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669855 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669857 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669860 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669862 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669865 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669867 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669869 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669872 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669875 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669877 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669879 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669882 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669885 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669888 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669891 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669893 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669896 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669898 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:17.680265 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669901 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669903 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.669906 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.670796 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.678700 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.678719 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.678739 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.678745 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678803 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678809 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678812 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678815 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678818 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678821 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678824 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:17.680762 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678826 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678829 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678832 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678834 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678837 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678839 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678842 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678845 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678847 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678849 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678852 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678854 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678857 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678859 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678861 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678864 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678866 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678869 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678871 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678874 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:17.681132 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678877 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678879 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678883 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678886 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678889 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678891 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678895 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678898 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678901 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678904 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678907 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678911 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678914 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678917 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678919 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678922 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678925 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678927 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678929 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:17.681635 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678932 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678935 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678937 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678939 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678942 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678944 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678947 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678950 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678952 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678955 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678958 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678960 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678963 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678966 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678969 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678972 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678975 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678977 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678980 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678982 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:17.682086 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678985 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678987 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678990 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678993 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678995 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.678998 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679000 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679003 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679006 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679010 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679012 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679016 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679018 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679021 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679024 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679026 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679029 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679032 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679034 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:17.682583 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679037 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679040 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679042 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679045 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679056 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679060 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679063 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679065 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679069 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679072 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679075 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679078 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679080 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679083 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.679088 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 20:22:17.683042 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679214 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679220 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679223 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679226 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679229 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679232 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679235 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679237 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679240 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679242 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679247 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679251 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679254 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679257 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679261 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679263 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679266 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679268 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679271 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:17.683522 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679273 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679276 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679278 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679281 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679284 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679287 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679290 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679293 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679295 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679298 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679301 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679304 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679306 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679308 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679311 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679313 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679315 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679318 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679320 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679322 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:17.683973 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679325 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679327 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679329 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679332 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679334 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679337 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679339 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679341 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679344 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679346 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679348 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679351 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679353 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679355 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679358 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679360 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679363 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679366 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679368 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679371 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:17.684451 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679373 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679376 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679397 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679403 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679408 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679412 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679415 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679418 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679420 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679423 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679425 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679428 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679430 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679433 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679435 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679438 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679440 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679443 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679446 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:17.684926 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679451 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679454 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679457 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679460 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679462 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679465 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679467 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679470 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679472 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679475 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679478 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679480 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679484 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679486 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679489 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679492 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679496 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679498 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679501 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679504 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:17.685376 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:17.679506 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.679512 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.679651 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.682104 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.683535 2554 server.go:1019] "Starting client certificate rotation" Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.683643 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.683683 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 20:22:17.685862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.685654 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 20:22:17.690187 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.690157 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 20:22:17.702647 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.702623 2554 log.go:25] "Validated CRI v1 runtime API" Jul 14 20:22:17.704925 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.704910 2554 log.go:25] "Validated CRI v1 image API" Jul 14 20:22:17.705781 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.705754 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 20:22:17.708286 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.708264 2554 fs.go:135] Filesystem UUIDs: map[3914f7c3-d22b-4861-9d00-8ff8de47c4d5:/dev/nvme0n1p4 6607df79-88a7-4dfd-84e5-648cd3b6ac35:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 14 20:22:17.708363 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.708285 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 20:22:17.709823 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.709806 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 20:22:17.714452 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.714326 2554 manager.go:216] Machine: {Timestamp:2026-07-14 20:22:17.713026758 +0000 UTC m=+0.311667636 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099862 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea9e80185e2080131a579a14447b3 SystemUUID:ec2ea9e8-0185-e208-0131-a579a14447b3 BootID:2181d089-3596-4ead-80f0-59ac895be402 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:62:1e:63:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:62:1e:63:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:1c:2c:ce:8b:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 20:22:17.714452 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.714450 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 20:22:17.714566 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.714540 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 20:22:17.717574 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.717545 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 20:22:17.717730 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.717577 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 20:22:17.718829 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.718818 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 20:22:17.718861 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.718832 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 20:22:17.718861 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.718840 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 20:22:17.719471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.719460 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 20:22:17.721086 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.721075 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 20:22:17.724520 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724507 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 14 20:22:17.724656 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724646 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 20:22:17.724700 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724678 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 14 20:22:17.724700 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724691 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 20:22:17.724768 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724706 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 20:22:17.724768 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724720 2554 kubelet.go:398] "Adding apiserver pod source" Jul 14 20:22:17.724768 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.724735 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 20:22:17.725135 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.725121 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 20:22:17.725176 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.725148 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 20:22:17.727008 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.726992 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 20:22:17.729239 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729224 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 20:22:17.729301 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729254 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 20:22:17.729432 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729421 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 20:22:17.729465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729438 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 20:22:17.729465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729445 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 20:22:17.729465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729450 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 20:22:17.729465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729459 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 20:22:17.729465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729465 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 20:22:17.729962 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729952 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 20:22:17.729962 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729961 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 20:22:17.730036 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729967 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 20:22:17.730036 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729973 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 20:22:17.730036 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729981 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 20:22:17.730036 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.729988 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 20:22:17.730695 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.730686 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 20:22:17.730695 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.730695 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 20:22:17.732400 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.732356 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wc2c9" Jul 14 20:22:17.733819 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.733789 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 20:22:17.733895 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.733789 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 20:22:17.733895 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.733825 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 20:22:17.734737 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.734593 2554 server.go:1268] "Started kubelet" Jul 14 20:22:17.734984 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.734948 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 20:22:17.735319 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.735267 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 20:22:17.735428 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.735371 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 20:22:17.735840 ip-10-0-142-126 systemd[1]: Started Kubernetes Kubelet. Jul 14 20:22:17.738676 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.738655 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 14 20:22:17.739633 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.739615 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 20:22:17.739906 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.739886 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wc2c9" Jul 14 20:22:17.741464 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.741435 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 20:22:17.743309 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.742401 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-126.ec2.internal.18c2419b5173cd81 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-126.ec2.internal,UID:ip-10-0-142-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-126.ec2.internal,},FirstTimestamp:2026-07-14 20:22:17.734417793 +0000 UTC m=+0.333058672,LastTimestamp:2026-07-14 20:22:17.734417793 +0000 UTC m=+0.333058672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-126.ec2.internal,}" Jul 14 20:22:17.746739 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.746721 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 20:22:17.746739 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.746732 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 20:22:17.746870 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.746813 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:17.747412 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747398 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 20:22:17.747532 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747505 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 20:22:17.747619 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747379 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 20:22:17.747619 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747609 2554 factory.go:55] Registering systemd factory Jul 14 20:22:17.747708 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747630 2554 factory.go:223] Registration of the systemd container factory successfully Jul 14 20:22:17.747708 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747631 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 14 20:22:17.747708 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747642 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 14 20:22:17.747865 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747851 2554 factory.go:153] Registering CRI-O factory Jul 14 20:22:17.747910 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747866 2554 factory.go:223] Registration of the crio container factory successfully Jul 14 20:22:17.747951 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747912 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 20:22:17.747951 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747931 2554 factory.go:103] Registering Raw factory Jul 14 20:22:17.747951 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.747940 2554 manager.go:1196] Started watching for new ooms in manager Jul 14 20:22:17.748561 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.748538 2554 manager.go:349] Starting recovery of all containers Jul 14 20:22:17.759403 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.759234 2554 manager.go:354] Recovery completed Jul 14 20:22:17.759739 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.759717 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:17.760964 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.760944 2554 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 14 20:22:17.762783 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.762759 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal" Jul 14 20:22:17.764521 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.764508 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:17.766517 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.766487 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:17.766586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.766534 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:17.766586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.766549 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:17.768234 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.768218 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 20:22:17.768309 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.768234 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 20:22:17.768309 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.768225 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:17.768309 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.768256 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 14 20:22:17.769093 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.769080 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:17.769137 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.769110 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:17.769137 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.769119 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:17.769602 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.769590 2554 policy_none.go:49] "None policy: Start" Jul 14 20:22:17.769641 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.769607 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 20:22:17.769641 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.769619 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 20:22:17.770664 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.770652 2554 policy_none.go:47] "Start" Jul 14 20:22:17.808946 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.808928 2554 manager.go:337] "Starting Device Plugin manager" Jul 14 20:22:17.809059 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.808962 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 20:22:17.809059 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.808972 2554 server.go:87] "Starting device plugin registration server" Jul 14 20:22:17.809250 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.809237 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 20:22:17.809294 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.809255 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 20:22:17.809360 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.809338 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 20:22:17.809461 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.809448 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 20:22:17.809512 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.809463 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 20:22:17.809998 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.809982 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 20:22:17.810062 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.810026 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:17.909732 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.909701 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:17.910775 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.910661 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:17.910775 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.910696 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:17.910775 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.910707 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:17.910775 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.910735 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-126.ec2.internal" Jul 14 20:22:17.919256 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.919238 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-126.ec2.internal" Jul 14 20:22:17.919360 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.919262 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-126.ec2.internal\": node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:17.933589 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.933571 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:17.935496 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.935469 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 20:22:17.936836 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.936820 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 20:22:17.936910 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.936858 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 20:22:17.936910 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.936877 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 20:22:17.936989 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:17.936912 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 20:22:17.939136 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:17.939120 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:18.034138 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.034090 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.037244 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.037222 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"] Jul 14 20:22:18.037309 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.037299 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:18.038968 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.038932 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:18.038968 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.038971 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:18.039123 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.038985 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:18.040177 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040166 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:18.040290 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040277 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.040323 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040319 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:18.040855 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040841 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:18.040855 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040850 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:18.040956 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040873 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:18.040956 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040885 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:18.040956 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040874 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:18.041051 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.040969 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:18.042180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.042167 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.042216 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.042192 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:18.042842 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.042828 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:18.042907 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.042848 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:18.042907 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.042864 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:18.049444 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.049428 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.049497 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.049451 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0679c59103ee362599b21375dbd0b93a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"0679c59103ee362599b21375dbd0b93a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.049497 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.049466 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.071975 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.071955 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.076295 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.076281 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.135230 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.135204 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.149685 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.149659 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0679c59103ee362599b21375dbd0b93a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"0679c59103ee362599b21375dbd0b93a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.149814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.149687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.149814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.149706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.149814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.149755 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0679c59103ee362599b21375dbd0b93a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"0679c59103ee362599b21375dbd0b93a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.149814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.149764 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.149814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.149757 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.235631 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.235563 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.336037 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.336010 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.374559 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.374532 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.380177 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.380158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 14 20:22:18.436850 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.436806 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.542932 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.542865 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.553570 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.553546 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:18.644573 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.644545 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.684862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.684802 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 20:22:18.685465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.684997 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 20:22:18.685465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.685028 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 20:22:18.685465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.685051 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 20:22:18.745244 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.745211 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.746334 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.746307 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 20:17:18 +0000 UTC" deadline="2028-04-09 12:59:30.331841978 +0000 UTC" Jul 14 20:22:18.746429 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.746333 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15232h37m11.585513289s" Jul 14 20:22:18.845420 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.845311 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.946238 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:18.946211 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found" Jul 14 20:22:18.959261 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:18.959234 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:19.028892 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:19.028851 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0679c59103ee362599b21375dbd0b93a.slice/crio-d3beeadbcfa23b3d1622f231f7b5c7739dd766b88a66a65bdbfcc62a1aa9c9b5 WatchSource:0}: Error finding container d3beeadbcfa23b3d1622f231f7b5c7739dd766b88a66a65bdbfcc62a1aa9c9b5: Status 404 returned error can't find the container with id d3beeadbcfa23b3d1622f231f7b5c7739dd766b88a66a65bdbfcc62a1aa9c9b5 Jul 14 20:22:19.029177 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:19.029150 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode856a531b29482c4ea43eb88a22001bd.slice/crio-dac44ab9d38b54a1dc439c708a38ea6171549b0d26cae135469380fa81d6c5ca WatchSource:0}: Error finding container dac44ab9d38b54a1dc439c708a38ea6171549b0d26cae135469380fa81d6c5ca: Status 404 returned error can't find the container with id dac44ab9d38b54a1dc439c708a38ea6171549b0d26cae135469380fa81d6c5ca Jul 14 20:22:19.033604 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.033588 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:22:19.046974 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.046953 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" Jul 14 20:22:19.059107 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.059084 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 20:22:19.060521 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.060506 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" Jul 14 20:22:19.069749 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.069724 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 20:22:19.511868 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.511832 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:19.586408 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.586371 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:19.726172 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.726135 2554 apiserver.go:52] "Watching apiserver" Jul 14 20:22:19.736325 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.736292 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 20:22:19.739062 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.739019 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vxpjb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp","openshift-cluster-node-tuning-operator/tuned-p4n78","openshift-image-registry/node-ca-wsw9t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal","openshift-network-diagnostics/network-check-target-kzmh8","openshift-network-operator/iptables-alerter-rp2gj","kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal","openshift-dns/node-resolver-fx65n","openshift-multus/multus-424v2","openshift-multus/multus-additional-cni-plugins-zhrq2","openshift-multus/network-metrics-daemon-h97zl","openshift-ovn-kubernetes/ovnkube-node-h4xvz","kube-system/global-pull-secret-syncer-zvrfm"] Jul 14 20:22:19.740731 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.740690 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.743609 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.742518 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.743609 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.743309 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.743609 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.743378 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 20:22:19.743609 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.743390 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-twxlb\"" Jul 14 20:22:19.743609 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.743311 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.743949 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.743741 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.744641 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.744381 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 20:22:19.744641 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.744411 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.744641 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.744518 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qmld8\"" Jul 14 20:22:19.744860 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.744780 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 20:22:19.744860 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.744817 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 20:22:19.745025 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.745006 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.745025 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.745031 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.745520 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.745501 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.745685 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.745665 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7c8jc\"" Jul 14 20:22:19.745868 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.745848 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.746470 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.746232 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.746470 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.746315 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:19.747121 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.746847 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 20:22:19.747121 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.746858 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.747266 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.747125 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.747346 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.747329 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ptfwh\"" Jul 14 20:22:19.747552 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.747530 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 20:22:19.748749 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.748727 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:19.748867 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.748843 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:19.750076 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.749820 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.751606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.751292 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.751796 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.751771 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.751936 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.751919 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hjbt2\"" Jul 14 20:22:19.752010 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.751964 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.752705 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.752687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.753979 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.753567 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 20:22:19.753979 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.753598 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tcb2j\"" Jul 14 20:22:19.753979 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.753858 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.754401 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754294 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.754401 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754358 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 20:22:19.754645 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754625 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 20:22:19.754714 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754672 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kzwtc\"" Jul 14 20:22:19.754773 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754706 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 20:22:19.754922 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754909 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 20:22:19.755010 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.754994 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 20:22:19.755177 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.755160 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-424v2" Jul 14 20:22:19.755260 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.755240 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 20:22:19.755969 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.755954 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.757253 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.757230 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 20:22:19.757400 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.757357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:19.757504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.757432 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:19.758612 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.758577 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dt9kg\"" Jul 14 20:22:19.759215 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.759194 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d6g7v\"" Jul 14 20:22:19.759464 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.759445 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 20:22:19.759886 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.759859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 20:22:19.761039 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761019 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-host-slash\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.761109 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-system-cni-dir\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761149 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761114 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761184 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysctl-d\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761218 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-systemd\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761270 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-lib-modules\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761310 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-os-release\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761344 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761332 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761383 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761418 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-kubernetes\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761501 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f773a7a-0bd9-4128-a449-2320de0fa76d-tmp\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761561 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9vnm\" (UniqueName: \"kubernetes.io/projected/3f773a7a-0bd9-4128-a449-2320de0fa76d-kube-api-access-d9vnm\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761617 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:19.761674 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761620 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b7fj\" (UniqueName: \"kubernetes.io/projected/291a6005-dc24-4df7-abb0-bd8804f470f4-kube-api-access-6b7fj\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761674 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-sys\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761780 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-tuned\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761830 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-cnibin\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.761830 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761815 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz84c\" (UniqueName: \"kubernetes.io/projected/5c1481c8-8059-40fe-909a-eb82c84c5277-kube-api-access-jz84c\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.761952 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-host\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.761952 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/536265ff-3cd8-4d94-8485-20d3cd72eced-serviceca\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.762065 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.761950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-iptables-alerter-script\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.762065 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.762065 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-modprobe-d\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.762292 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysconfig\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.762292 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762103 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 20:22:19.762292 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762156 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-var-lib-kubelet\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.762292 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1481c8-8059-40fe-909a-eb82c84c5277-tmp-dir\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.762292 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysctl-conf\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.762292 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-run\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzkk\" (UniqueName: \"kubernetes.io/projected/536265ff-3cd8-4d94-8485-20d3cd72eced-kube-api-access-4gzkk\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762337 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwxn\" (UniqueName: \"kubernetes.io/projected/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-kube-api-access-dpwxn\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762379 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c1481c8-8059-40fe-909a-eb82c84c5277-hosts-file\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762413 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/536265ff-3cd8-4d94-8485-20d3cd72eced-host\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-kubelet-config\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-dbus\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.762622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.762584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.788859 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.788831 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g4qrb" Jul 14 20:22:19.794722 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.794684 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g4qrb" Jul 14 20:22:19.849347 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.849309 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysctl-conf\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-os-release\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-daemon-config\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863310 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mg4r\" (UniqueName: \"kubernetes.io/projected/755bf49c-4f08-414a-b845-c9effa18c906-kube-api-access-6mg4r\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863328 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-node-log\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovnkube-config\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwxn\" (UniqueName: \"kubernetes.io/projected/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-kube-api-access-dpwxn\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863377 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c1481c8-8059-40fe-909a-eb82c84c5277-hosts-file\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-dbus\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.863434 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863428 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-systemd-units\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863450 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-socket-dir-parent\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-host-slash\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863514 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-systemd\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-ovn\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-cni-binary-copy\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-run-netns\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-cni-bin\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-hostroot\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863722 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-sys\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863746 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-tuned\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-log-socket\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-registration-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863827 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovnkube-script-lib\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-cni-bin\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.864072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.863986 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-systemd\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-sys\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864408 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864500 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df969df9-2c73-4d56-a77f-b1a610ef4062-konnectivity-ca\") pod \"konnectivity-agent-vxpjb\" (UID: \"df969df9-2c73-4d56-a77f-b1a610ef4062\") " pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-conf-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trjdm\" (UniqueName: \"kubernetes.io/projected/db5f757b-0173-4981-b061-0bccac8ef3e5-kube-api-access-trjdm\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-etc-selinux\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-modprobe-d\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysconfig\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-var-lib-kubelet\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864652 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-system-cni-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864792 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-modprobe-d\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864455 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864840 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysctl-conf\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-var-lib-kubelet\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864941 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-host-slash\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.865001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.864989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-etc-kubernetes\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865022 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1481c8-8059-40fe-909a-eb82c84c5277-tmp-dir\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-run\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzkk\" (UniqueName: \"kubernetes.io/projected/536265ff-3cd8-4d94-8485-20d3cd72eced-kube-api-access-4gzkk\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovn-node-metrics-cert\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-multus-certs\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865278 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/536265ff-3cd8-4d94-8485-20d3cd72eced-host\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865337 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-kubelet-config\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-slash\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-cnibin\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865442 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysconfig\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-system-cni-dir\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-run\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.865810 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865497 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysctl-d\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865499 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/536265ff-3cd8-4d94-8485-20d3cd72eced-host\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865528 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-kubelet-config\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-lib-modules\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-systemd\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-system-cni-dir\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865605 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g588g\" (UniqueName: \"kubernetes.io/projected/89fc4adf-92d6-42ae-9a49-e8641dce4259-kube-api-access-g588g\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865633 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c1481c8-8059-40fe-909a-eb82c84c5277-hosts-file\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865644 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-netns\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.865734 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865757 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-dbus\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865769 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-sysctl-d\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.865805 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:20.365781819 +0000 UTC m=+2.964422706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-device-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865872 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-lib-modules\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-os-release\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.866686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865892 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1481c8-8059-40fe-909a-eb82c84c5277-tmp-dir\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865960 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-os-release\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.865999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866060 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-kubernetes\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f773a7a-0bd9-4128-a449-2320de0fa76d-tmp\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866131 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-kubernetes\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9vnm\" (UniqueName: \"kubernetes.io/projected/3f773a7a-0bd9-4128-a449-2320de0fa76d-kube-api-access-d9vnm\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866298 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-kubelet\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b7fj\" (UniqueName: \"kubernetes.io/projected/291a6005-dc24-4df7-abb0-bd8804f470f4-kube-api-access-6b7fj\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866520 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866911 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-cni-netd\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-kubelet\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.866999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df969df9-2c73-4d56-a77f-b1a610ef4062-agent-certs\") pod \"konnectivity-agent-vxpjb\" (UID: \"df969df9-2c73-4d56-a77f-b1a610ef4062\") " pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.867586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-cnibin\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867058 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz84c\" (UniqueName: \"kubernetes.io/projected/5c1481c8-8059-40fe-909a-eb82c84c5277-kube-api-access-jz84c\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-host\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/536265ff-3cd8-4d94-8485-20d3cd72eced-serviceca\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmw2\" (UniqueName: \"kubernetes.io/projected/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-kube-api-access-zsmw2\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867196 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-iptables-alerter-script\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-etc-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867310 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/291a6005-dc24-4df7-abb0-bd8804f470f4-cnibin\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867355 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-env-overrides\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-k8s-cni-cncf-io\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867514 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f773a7a-0bd9-4128-a449-2320de0fa76d-host\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-var-lib-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-cni-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867590 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-cni-multus\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-socket-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.867658 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-sys-fs\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.868352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.868123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/536265ff-3cd8-4d94-8485-20d3cd72eced-serviceca\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.869171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.868255 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-iptables-alerter-script\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.869171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.868646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/291a6005-dc24-4df7-abb0-bd8804f470f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.869171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.868972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f773a7a-0bd9-4128-a449-2320de0fa76d-etc-tuned\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.869171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.869012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f773a7a-0bd9-4128-a449-2320de0fa76d-tmp\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.872980 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.872953 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:19.873104 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.872986 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:19.873104 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.873004 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:19.873104 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.873074 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:20.373055302 +0000 UTC m=+2.971696185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:19.874713 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.874675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwxn\" (UniqueName: \"kubernetes.io/projected/44bd5ddc-8df8-4fa7-9833-41f54c80b6cf-kube-api-access-dpwxn\") pod \"iptables-alerter-rp2gj\" (UID: \"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf\") " pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:19.875210 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.875152 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzkk\" (UniqueName: \"kubernetes.io/projected/536265ff-3cd8-4d94-8485-20d3cd72eced-kube-api-access-4gzkk\") pod \"node-ca-wsw9t\" (UID: \"536265ff-3cd8-4d94-8485-20d3cd72eced\") " pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:19.877720 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.877646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b7fj\" (UniqueName: \"kubernetes.io/projected/291a6005-dc24-4df7-abb0-bd8804f470f4-kube-api-access-6b7fj\") pod \"multus-additional-cni-plugins-zhrq2\" (UID: \"291a6005-dc24-4df7-abb0-bd8804f470f4\") " pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:19.878393 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.878344 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9vnm\" (UniqueName: \"kubernetes.io/projected/3f773a7a-0bd9-4128-a449-2320de0fa76d-kube-api-access-d9vnm\") pod \"tuned-p4n78\" (UID: \"3f773a7a-0bd9-4128-a449-2320de0fa76d\") " pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:19.879491 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.879454 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz84c\" (UniqueName: \"kubernetes.io/projected/5c1481c8-8059-40fe-909a-eb82c84c5277-kube-api-access-jz84c\") pod \"node-resolver-fx65n\" (UID: \"5c1481c8-8059-40fe-909a-eb82c84c5277\") " pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:19.945977 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.945920 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"e856a531b29482c4ea43eb88a22001bd","Type":"ContainerStarted","Data":"dac44ab9d38b54a1dc439c708a38ea6171549b0d26cae135469380fa81d6c5ca"} Jul 14 20:22:19.947935 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.947899 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" event={"ID":"0679c59103ee362599b21375dbd0b93a","Type":"ContainerStarted","Data":"d3beeadbcfa23b3d1622f231f7b5c7739dd766b88a66a65bdbfcc62a1aa9c9b5"} Jul 14 20:22:19.967952 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.967917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-os-release\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.967965 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-daemon-config\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.967988 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mg4r\" (UniqueName: \"kubernetes.io/projected/755bf49c-4f08-414a-b845-c9effa18c906-kube-api-access-6mg4r\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-node-log\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovnkube-config\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-systemd-units\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968101 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-systemd-units\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968100 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-os-release\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968104 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-node-log\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-socket-dir-parent\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-ovn\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968189 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-socket-dir-parent\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-cni-binary-copy\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968226 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-run-netns\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968234 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-ovn\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-cni-bin\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-hostroot\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-log-socket\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-registration-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968366 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-cni-bin\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968377 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovnkube-script-lib\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-cni-bin\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968445 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-run-netns\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df969df9-2c73-4d56-a77f-b1a610ef4062-konnectivity-ca\") pod \"konnectivity-agent-vxpjb\" (UID: \"df969df9-2c73-4d56-a77f-b1a610ef4062\") " pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-conf-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968507 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-registration-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.968703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trjdm\" (UniqueName: \"kubernetes.io/projected/db5f757b-0173-4981-b061-0bccac8ef3e5-kube-api-access-trjdm\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968555 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-hostroot\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-etc-selinux\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-system-cni-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-log-socket\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-etc-kubernetes\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968647 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovn-node-metrics-cert\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-daemon-config\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-multus-certs\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968727 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovnkube-config\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968784 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-conf-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968797 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968853 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-system-cni-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968907 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-multus-certs\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968916 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968954 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-etc-kubernetes\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.969636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968728 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.968998 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-slash\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-cnibin\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-systemd\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969119 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g588g\" (UniqueName: \"kubernetes.io/projected/89fc4adf-92d6-42ae-9a49-e8641dce4259-kube-api-access-g588g\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969125 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-etc-selinux\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-netns\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969163 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df969df9-2c73-4d56-a77f-b1a610ef4062-konnectivity-ca\") pod \"konnectivity-agent-vxpjb\" (UID: \"df969df9-2c73-4d56-a77f-b1a610ef4062\") " pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-device-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969220 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-device-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-kubelet\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-cni-netd\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969260 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-kubelet\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969298 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-slash\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:19.970445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df969df9-2c73-4d56-a77f-b1a610ef4062-agent-certs\") pod \"konnectivity-agent-vxpjb\" (UID: \"df969df9-2c73-4d56-a77f-b1a610ef4062\") " pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmw2\" (UniqueName: \"kubernetes.io/projected/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-kube-api-access-zsmw2\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-cnibin\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-etc-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969426 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-systemd\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969421 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-env-overrides\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969452 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovnkube-script-lib\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-k8s-cni-cncf-io\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969529 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-kubelet\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-var-lib-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.969574 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969580 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-k8s-cni-cncf-io\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969587 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-cni-bin\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969534 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-etc-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969495 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-run-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969630 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-kubelet\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969639 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-host-cni-netd\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.971314 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:19.969644 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:20.469625279 +0000 UTC m=+3.068266163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969680 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-run-netns\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969757 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89fc4adf-92d6-42ae-9a49-e8641dce4259-var-lib-openvswitch\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-cni-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-cni-multus\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-multus-cni-dir\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969974 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-host-var-lib-cni-multus\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.969994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89fc4adf-92d6-42ae-9a49-e8641dce4259-env-overrides\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.970002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-socket-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.970026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-sys-fs\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.970092 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-sys-fs\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.970158 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/755bf49c-4f08-414a-b845-c9effa18c906-socket-dir\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.972236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.970499 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-cni-binary-copy\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.975568 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.975502 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df969df9-2c73-4d56-a77f-b1a610ef4062-agent-certs\") pod \"konnectivity-agent-vxpjb\" (UID: \"df969df9-2c73-4d56-a77f-b1a610ef4062\") " pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:19.977340 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.977303 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89fc4adf-92d6-42ae-9a49-e8641dce4259-ovn-node-metrics-cert\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.978500 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.977902 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mg4r\" (UniqueName: \"kubernetes.io/projected/755bf49c-4f08-414a-b845-c9effa18c906-kube-api-access-6mg4r\") pod \"aws-ebs-csi-driver-node-wwtzp\" (UID: \"755bf49c-4f08-414a-b845-c9effa18c906\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:19.986238 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.986169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g588g\" (UniqueName: \"kubernetes.io/projected/89fc4adf-92d6-42ae-9a49-e8641dce4259-kube-api-access-g588g\") pod \"ovnkube-node-h4xvz\" (UID: \"89fc4adf-92d6-42ae-9a49-e8641dce4259\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:19.986238 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.986169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmw2\" (UniqueName: \"kubernetes.io/projected/4fc4b5b7-e034-4904-8bad-5b662e7d7ce2-kube-api-access-zsmw2\") pod \"multus-424v2\" (UID: \"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2\") " pod="openshift-multus/multus-424v2" Jul 14 20:22:19.988429 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:19.988401 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trjdm\" (UniqueName: \"kubernetes.io/projected/db5f757b-0173-4981-b061-0bccac8ef3e5-kube-api-access-trjdm\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:20.058697 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.058603 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rp2gj" Jul 14 20:22:20.068733 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.068679 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bd5ddc_8df8_4fa7_9833_41f54c80b6cf.slice/crio-d874a49db54095f67927d8a16cdfe8b852dab3c9ad562168a67f389a18fa48d1 WatchSource:0}: Error finding container d874a49db54095f67927d8a16cdfe8b852dab3c9ad562168a67f389a18fa48d1: Status 404 returned error can't find the container with id d874a49db54095f67927d8a16cdfe8b852dab3c9ad562168a67f389a18fa48d1 Jul 14 20:22:20.071567 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.071545 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" Jul 14 20:22:20.080956 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.080883 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4n78" Jul 14 20:22:20.081537 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.081506 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291a6005_dc24_4df7_abb0_bd8804f470f4.slice/crio-2c164135e4733ec04d4c586cbdfa1ceeff9ccedb9e5f100f2e46342aa12ecd2f WatchSource:0}: Error finding container 2c164135e4733ec04d4c586cbdfa1ceeff9ccedb9e5f100f2e46342aa12ecd2f: Status 404 returned error can't find the container with id 2c164135e4733ec04d4c586cbdfa1ceeff9ccedb9e5f100f2e46342aa12ecd2f Jul 14 20:22:20.087913 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.087889 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsw9t" Jul 14 20:22:20.093717 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.093695 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fx65n" Jul 14 20:22:20.094061 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.094032 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f773a7a_0bd9_4128_a449_2320de0fa76d.slice/crio-bb1364afd45504cef3bca77a03f0d853e21db6f2503bca585606494b67372c45 WatchSource:0}: Error finding container bb1364afd45504cef3bca77a03f0d853e21db6f2503bca585606494b67372c45: Status 404 returned error can't find the container with id bb1364afd45504cef3bca77a03f0d853e21db6f2503bca585606494b67372c45 Jul 14 20:22:20.099696 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.099670 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:20.107954 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.107929 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" Jul 14 20:22:20.113117 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.113070 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1481c8_8059_40fe_909a_eb82c84c5277.slice/crio-6f19f6a1245ae1e71644087ec6746e3d2e99c14d3b565eb238824114523050df WatchSource:0}: Error finding container 6f19f6a1245ae1e71644087ec6746e3d2e99c14d3b565eb238824114523050df: Status 404 returned error can't find the container with id 6f19f6a1245ae1e71644087ec6746e3d2e99c14d3b565eb238824114523050df Jul 14 20:22:20.114006 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.113970 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fc4adf_92d6_42ae_9a49_e8641dce4259.slice/crio-860652d6286efff195c39cb6d16e1e814f5715c6771005d9ef88b94dec6259d7 WatchSource:0}: Error finding container 860652d6286efff195c39cb6d16e1e814f5715c6771005d9ef88b94dec6259d7: Status 404 returned error can't find the container with id 860652d6286efff195c39cb6d16e1e814f5715c6771005d9ef88b94dec6259d7 Jul 14 20:22:20.115343 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.115175 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-424v2" Jul 14 20:22:20.122488 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.122464 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:20.126743 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.126714 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc4b5b7_e034_4904_8bad_5b662e7d7ce2.slice/crio-9793ea5855a847e593904a834b4cde2295ae04b30b9c5058e3ccb0df7dc81ece WatchSource:0}: Error finding container 9793ea5855a847e593904a834b4cde2295ae04b30b9c5058e3ccb0df7dc81ece: Status 404 returned error can't find the container with id 9793ea5855a847e593904a834b4cde2295ae04b30b9c5058e3ccb0df7dc81ece Jul 14 20:22:20.134358 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:20.134324 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf969df9_2c73_4d56_a77f_b1a610ef4062.slice/crio-2183081dcfcef60aa7e20db0980dcfb07fd03354bf7518938c441332de172d37 WatchSource:0}: Error finding container 2183081dcfcef60aa7e20db0980dcfb07fd03354bf7518938c441332de172d37: Status 404 returned error can't find the container with id 2183081dcfcef60aa7e20db0980dcfb07fd03354bf7518938c441332de172d37 Jul 14 20:22:20.376364 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.376312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:20.376364 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.376378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:20.376642 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.376525 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:20.376642 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.376535 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:20.376642 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.376558 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:20.376642 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.376570 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:20.376642 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.376610 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:21.376586889 +0000 UTC m=+3.975227773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:20.376939 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.376765 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:21.3767492 +0000 UTC m=+3.975390068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:20.477948 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.477839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:20.478156 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.477996 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:20.478156 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.478074 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:21.478050596 +0000 UTC m=+4.076691461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:20.796721 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.796650 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 20:17:20 +0000 UTC" deadline="2028-02-27 05:58:34.268521296 +0000 UTC" Jul 14 20:22:20.796721 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.796710 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14217h36m13.471816338s" Jul 14 20:22:20.937928 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.937849 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:20.938093 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:20.937982 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:20.951920 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.951884 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-424v2" event={"ID":"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2","Type":"ContainerStarted","Data":"9793ea5855a847e593904a834b4cde2295ae04b30b9c5058e3ccb0df7dc81ece"} Jul 14 20:22:20.956724 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.956691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsw9t" event={"ID":"536265ff-3cd8-4d94-8485-20d3cd72eced","Type":"ContainerStarted","Data":"194e50f83199c48b8eeeeee3f266c1749dadb2816ad4f0ca67389077d26a1812"} Jul 14 20:22:20.962277 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.962246 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerStarted","Data":"2c164135e4733ec04d4c586cbdfa1ceeff9ccedb9e5f100f2e46342aa12ecd2f"} Jul 14 20:22:20.966438 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.966408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rp2gj" event={"ID":"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf","Type":"ContainerStarted","Data":"d874a49db54095f67927d8a16cdfe8b852dab3c9ad562168a67f389a18fa48d1"} Jul 14 20:22:20.969244 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.969216 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxpjb" event={"ID":"df969df9-2c73-4d56-a77f-b1a610ef4062","Type":"ContainerStarted","Data":"2183081dcfcef60aa7e20db0980dcfb07fd03354bf7518938c441332de172d37"} Jul 14 20:22:20.972582 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.972545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" event={"ID":"755bf49c-4f08-414a-b845-c9effa18c906","Type":"ContainerStarted","Data":"6df38cd5fa720e252c462bff5d866a830b6a3735d4db5780e2360be403e404d8"} Jul 14 20:22:20.978339 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.978306 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"860652d6286efff195c39cb6d16e1e814f5715c6771005d9ef88b94dec6259d7"} Jul 14 20:22:20.980841 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.980808 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fx65n" event={"ID":"5c1481c8-8059-40fe-909a-eb82c84c5277","Type":"ContainerStarted","Data":"6f19f6a1245ae1e71644087ec6746e3d2e99c14d3b565eb238824114523050df"} Jul 14 20:22:20.988381 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:20.988351 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4n78" event={"ID":"3f773a7a-0bd9-4128-a449-2320de0fa76d","Type":"ContainerStarted","Data":"bb1364afd45504cef3bca77a03f0d853e21db6f2503bca585606494b67372c45"} Jul 14 20:22:21.377279 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.377189 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:21.388650 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.388611 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:21.388828 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.388760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:21.388950 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.388898 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:21.389098 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.388976 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:23.388953475 +0000 UTC m=+5.987594367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:21.389488 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.389445 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:21.389662 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.389644 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:21.389733 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.389670 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:21.389733 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.389726 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:23.389709315 +0000 UTC m=+5.988350198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:21.490251 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.489560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:21.490251 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.489806 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:21.490251 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.489878 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:23.48985818 +0000 UTC m=+6.088499050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:21.797411 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.797269 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 20:17:20 +0000 UTC" deadline="2028-02-18 17:37:13.349511923 +0000 UTC" Jul 14 20:22:21.797411 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.797313 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14013h14m51.55220399s" Jul 14 20:22:21.938847 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.938133 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:21.938847 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.938271 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:21.938847 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:21.938757 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:21.939148 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:21.938869 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:22.938006 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:22.937655 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:22.938453 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:22.938079 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:23.009899 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.009570 2554 generic.go:356] "Generic (PLEG): container finished" podID="e856a531b29482c4ea43eb88a22001bd" containerID="b6231e9c36509f641671bf16521558443d85d1ffeae03fccb3d4f7486c9b44f0" exitCode=0 Jul 14 20:22:23.009899 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.009746 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"e856a531b29482c4ea43eb88a22001bd","Type":"ContainerDied","Data":"b6231e9c36509f641671bf16521558443d85d1ffeae03fccb3d4f7486c9b44f0"} Jul 14 20:22:23.025575 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.025539 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" event={"ID":"0679c59103ee362599b21375dbd0b93a","Type":"ContainerStarted","Data":"4254dc2acae2fdb105e5c844269c19d71a25223c7ed145f0661aa55f1e4cb3e1"} Jul 14 20:22:23.407966 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.407840 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:23.407966 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.407891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:23.408204 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.408033 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:23.408204 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.408055 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:23.408204 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.408069 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:23.408204 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.408142 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:27.408120993 +0000 UTC m=+10.006761910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:23.408643 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.408619 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:23.408748 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.408686 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:27.408668112 +0000 UTC m=+10.007309003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:23.508984 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.508677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:23.508984 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.508876 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:23.508984 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.508946 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:27.508925773 +0000 UTC m=+10.107566658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:23.937416 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.937328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:23.937598 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.937503 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:23.938120 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:23.938093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:23.938543 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:23.938239 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:24.937120 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:24.937080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:24.937291 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:24.937230 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:25.938543 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:25.937973 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:25.938543 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:25.938027 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:25.938543 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:25.938148 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:25.938543 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:25.938270 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:26.937689 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:26.937648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:26.937860 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:26.937813 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:27.445413 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:27.445354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:27.445434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.445597 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.445605 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.445625 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.445638 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.445679 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:35.445659987 +0000 UTC m=+18.044300870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:27.445897 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.445699 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:35.445688883 +0000 UTC m=+18.044329754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:27.546102 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:27.546059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:27.546270 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.546201 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:27.546333 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.546278 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:35.546257303 +0000 UTC m=+18.144898194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:27.938829 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:27.938792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:27.938992 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.938907 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:27.939358 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:27.939328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:27.939501 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:27.939478 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:28.938068 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:28.937436 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:28.938068 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:28.937617 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:29.938130 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:29.938037 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:29.938130 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:29.938082 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:29.938867 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:29.938207 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:29.938867 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:29.938362 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:30.937969 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:30.937935 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:30.938137 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:30.938053 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:31.937128 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:31.937093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:31.937599 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:31.937237 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:31.937599 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:31.937482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:31.937715 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:31.937594 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:32.937790 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:32.937709 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:32.938290 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:32.937845 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:33.937763 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:33.937724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:33.937901 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:33.937858 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:33.938192 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:33.937918 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:33.938192 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:33.938002 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:34.937824 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:34.937791 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:34.938085 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:34.937938 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:35.513211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:35.513164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:35.513222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.513325 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.513329 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.513407 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.513415 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:51.513377324 +0000 UTC m=+34.112018190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.513423 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:35.513504 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.513477 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:51.51346181 +0000 UTC m=+34.112102674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:35.614455 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:35.614412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:35.614631 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.614594 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:35.614675 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.614670 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:51.614653512 +0000 UTC m=+34.213294396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:35.937583 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:35.937547 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:35.937766 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:35.937552 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:35.937766 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.937704 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:35.937874 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:35.937760 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:36.937848 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:36.937814 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:36.938272 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:36.937925 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:37.938068 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:37.938030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:37.938490 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:37.938212 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:37.938490 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:37.938270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:37.938490 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:37.938369 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:38.937794 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:38.937760 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:38.938022 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:38.937872 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:39.938183 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:39.938143 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:39.938760 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:39.938150 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:39.938760 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:39.938291 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:39.938760 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:39.938336 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:40.937802 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:40.937772 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:40.937914 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:40.937894 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:41.937692 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:41.937361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:41.938607 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:41.937436 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:41.938607 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:41.937771 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:41.938607 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:41.937847 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:42.080057 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.080018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"e856a531b29482c4ea43eb88a22001bd","Type":"ContainerStarted","Data":"3e17266a0c690d5b870edc024749ca2b391ca3731822a44bbce7d1094e02028f"} Jul 14 20:22:42.081913 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.081867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-424v2" event={"ID":"4fc4b5b7-e034-4904-8bad-5b662e7d7ce2","Type":"ContainerStarted","Data":"73a46ca013f02a90197ff445a10e8d41cc608a757c52409f7a8b3c261c278d55"} Jul 14 20:22:42.083456 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.083416 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsw9t" event={"ID":"536265ff-3cd8-4d94-8485-20d3cd72eced","Type":"ContainerStarted","Data":"4bb5e18ea00d41fe383da997e2a9c50e910790f800dccdc1fb6497330f5d6e45"} Jul 14 20:22:42.085193 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.085171 2554 generic.go:356] "Generic (PLEG): container finished" podID="291a6005-dc24-4df7-abb0-bd8804f470f4" containerID="f380b7fe59b11b21a022b626c69002939af035e1281a901461bbd379982d6c48" exitCode=0 Jul 14 20:22:42.085315 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.085265 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerDied","Data":"f380b7fe59b11b21a022b626c69002939af035e1281a901461bbd379982d6c48"} Jul 14 20:22:42.087477 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.087455 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxpjb" event={"ID":"df969df9-2c73-4d56-a77f-b1a610ef4062","Type":"ContainerStarted","Data":"bf794a3bfd6f5f7d25339b31d866a581d74beabee0d044ede31ce4d10b6ea977"} Jul 14 20:22:42.089670 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.089649 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" event={"ID":"755bf49c-4f08-414a-b845-c9effa18c906","Type":"ContainerStarted","Data":"999eff6deb67507e737dbd38b5346d0bdf3efb7c6d53b6e2c8320269ce9099d3"} Jul 14 20:22:42.092660 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.092643 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:22:42.093012 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.092985 2554 generic.go:356] "Generic (PLEG): container finished" podID="89fc4adf-92d6-42ae-9a49-e8641dce4259" containerID="00e627139dae8e699a8c8db0ea77c8eb00fd527d189cfd1c07a3ffeecde6dfb8" exitCode=1 Jul 14 20:22:42.093110 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.093030 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"525a1b1ecff776234b9bf983750f05809a1ad243121858ea1d06fe318c4dd32b"} Jul 14 20:22:42.093110 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.093100 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"19dfdb6ab2a8b0770dc1c5fd022cdf722b85dc423ed60c3087837b6a035d2df8"} Jul 14 20:22:42.093190 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.093138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"c8baf4fdd9df8e146740ebb8eb2c97cd8d43898618945fdeec167b753a117ba6"} Jul 14 20:22:42.093190 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.093168 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"48021c5181e9adf7727620ce14d7af5a59029345771149d023e492228fde9f16"} Jul 14 20:22:42.093265 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.093201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerDied","Data":"00e627139dae8e699a8c8db0ea77c8eb00fd527d189cfd1c07a3ffeecde6dfb8"} Jul 14 20:22:42.093265 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.093231 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"99b91a8bf819f32559612d0d71aca36364851136a95796016a60e994f9fd4660"} Jul 14 20:22:42.094667 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.094621 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" podStartSLOduration=23.094605132 podStartE2EDuration="23.094605132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.093854617 +0000 UTC m=+24.692495504" watchObservedRunningTime="2026-07-14 20:22:42.094605132 +0000 UTC m=+24.693246019" Jul 14 20:22:42.094815 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.094785 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" podStartSLOduration=23.094778132 podStartE2EDuration="23.094778132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:23.045252971 +0000 UTC m=+5.643893866" watchObservedRunningTime="2026-07-14 20:22:42.094778132 +0000 UTC m=+24.693419019" Jul 14 20:22:42.095010 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.094989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fx65n" event={"ID":"5c1481c8-8059-40fe-909a-eb82c84c5277","Type":"ContainerStarted","Data":"7e5e1dd48794dfe161d57eedd921ae2e3ca69b544eca6e094f3c9f09c0ff4da7"} Jul 14 20:22:42.096632 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.096613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4n78" event={"ID":"3f773a7a-0bd9-4128-a449-2320de0fa76d","Type":"ContainerStarted","Data":"d093433003f570ccf5804cee70106f27da052ee223681e40ebd76a67828da3eb"} Jul 14 20:22:42.131253 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.131204 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-424v2" podStartSLOduration=3.283673647 podStartE2EDuration="24.131189638s" totalImagesPullingTime="20.847515991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.130932316 +0000 UTC m=+24.729573202" watchObservedRunningTime="2026-07-14 20:22:42.131189638 +0000 UTC m=+24.729830525" Jul 14 20:22:42.144885 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.144816 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wsw9t" podStartSLOduration=3.355804562 podStartE2EDuration="24.144799317s" totalImagesPullingTime="20.788994755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.144440162 +0000 UTC m=+24.743081048" watchObservedRunningTime="2026-07-14 20:22:42.144799317 +0000 UTC m=+24.743440205" Jul 14 20:22:42.159030 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.158966 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vxpjb" podStartSLOduration=8.01295118 podStartE2EDuration="24.158948806s" totalImagesPullingTime="16.145997626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.158781473 +0000 UTC m=+24.757422360" watchObservedRunningTime="2026-07-14 20:22:42.158948806 +0000 UTC m=+24.757589694" Jul 14 20:22:42.172771 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.172718 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fx65n" podStartSLOduration=3.324179594 podStartE2EDuration="24.172703644s" totalImagesPullingTime="20.84852405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.172296089 +0000 UTC m=+24.770936979" watchObservedRunningTime="2026-07-14 20:22:42.172703644 +0000 UTC m=+24.771344531" Jul 14 20:22:42.189241 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.189151 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p4n78" podStartSLOduration=3.315944024 podStartE2EDuration="24.189136588s" totalImagesPullingTime="20.873192564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.188747043 +0000 UTC m=+24.787387930" watchObservedRunningTime="2026-07-14 20:22:42.189136588 +0000 UTC m=+24.787777507" Jul 14 20:22:42.701155 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.701128 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 20:22:42.822299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.822153 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T20:22:42.701147382Z","UUID":"29492b50-1405-4ee8-bd69-c5dda0aa4847","Handler":null,"Name":"","Endpoint":""} Jul 14 20:22:42.823845 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.823826 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 20:22:42.824011 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.823859 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 20:22:42.938054 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.938026 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:42.938500 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:42.938144 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:42.944568 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:42.944543 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:43.100984 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:43.100900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rp2gj" event={"ID":"44bd5ddc-8df8-4fa7-9833-41f54c80b6cf","Type":"ContainerStarted","Data":"ccefd8efdc49e5c23662cdb9c5bdfc06ded39f4946d872fc0355ac0391abe58d"} Jul 14 20:22:43.103057 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:43.103031 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" event={"ID":"755bf49c-4f08-414a-b845-c9effa18c906","Type":"ContainerStarted","Data":"6cd31e5f05dc428e0db078fcd36deb51c9ab3cc402ac14c5d00e1aea5911fb1d"} Jul 14 20:22:43.115237 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:43.115189 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rp2gj" podStartSLOduration=4.219355603 podStartE2EDuration="25.115174079s" totalImagesPullingTime="20.895818476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:43.114527411 +0000 UTC m=+25.713168298" watchObservedRunningTime="2026-07-14 20:22:43.115174079 +0000 UTC m=+25.713814965" Jul 14 20:22:43.937981 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:43.937772 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:43.937981 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:43.937892 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:43.938686 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:43.938670 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:43.939014 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:43.938787 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:44.108853 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.108817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" event={"ID":"755bf49c-4f08-414a-b845-c9effa18c906","Type":"ContainerStarted","Data":"10a84250947c3ccfc6f75eb0988529dcc82d7d07947a03b3901654287191b53f"} Jul 14 20:22:44.112542 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.112511 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:22:44.113004 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.112976 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"fec596d387e49f4cd42241a429650e78cef40906581f372fb76132092b337513"} Jul 14 20:22:44.130635 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.130592 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wwtzp" podStartSLOduration=2.839607316 podStartE2EDuration="26.130579801s" totalImagesPullingTime="23.290972485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:44.127410909 +0000 UTC m=+26.726051797" watchObservedRunningTime="2026-07-14 20:22:44.130579801 +0000 UTC m=+26.729220688" Jul 14 20:22:44.193348 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.193313 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:44.194354 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.194332 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:44.937657 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:44.937424 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:44.937834 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:44.937765 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:45.115570 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:45.115534 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vxpjb" Jul 14 20:22:45.937614 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:45.937583 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:45.937786 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:45.937713 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:45.937786 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:45.937763 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:45.937937 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:45.937921 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:46.937934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:46.937898 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:46.938513 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:46.938038 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:47.938561 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:47.938328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:47.939174 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:47.938415 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:47.939174 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:47.938667 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:47.939174 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:47.938578 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:48.123850 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.123821 2554 generic.go:356] "Generic (PLEG): container finished" podID="291a6005-dc24-4df7-abb0-bd8804f470f4" containerID="db30e7fed02bc5e5791a429b225c8772b858791f20e2838046c6362907e278bf" exitCode=0 Jul 14 20:22:48.124037 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.123911 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerDied","Data":"db30e7fed02bc5e5791a429b225c8772b858791f20e2838046c6362907e278bf"} Jul 14 20:22:48.127378 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.127363 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:22:48.127783 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.127760 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"43685b0490d6cb5f138844d3c1e73a7e7e68b67f07887f8b4ad1942faefabe09"} Jul 14 20:22:48.128087 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.128001 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:48.128087 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.128046 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:48.128190 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.128173 2554 scope.go:117] "RemoveContainer" containerID="00e627139dae8e699a8c8db0ea77c8eb00fd527d189cfd1c07a3ffeecde6dfb8" Jul 14 20:22:48.144299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.144258 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:48.938102 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:48.938069 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:48.938363 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:48.938188 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:49.134017 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.133998 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:22:49.134572 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.134454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" event={"ID":"89fc4adf-92d6-42ae-9a49-e8641dce4259","Type":"ContainerStarted","Data":"ba76ab4f4f90bc56f6907679a03055651a7d2b8318edfb3cfd70fd78481f2a97"} Jul 14 20:22:49.134932 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.134907 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:49.150887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.150866 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:22:49.161512 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.161306 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" podStartSLOduration=10.218459315 podStartE2EDuration="31.161291846s" totalImagesPullingTime="20.942832531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:49.160995194 +0000 UTC m=+31.759636082" watchObservedRunningTime="2026-07-14 20:22:49.161291846 +0000 UTC m=+31.759932733" Jul 14 20:22:49.339370 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.339339 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kzmh8"] Jul 14 20:22:49.339551 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.339477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:49.339596 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:49.339558 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:49.342357 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.342255 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zvrfm"] Jul 14 20:22:49.342574 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.342477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:49.342684 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:49.342584 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:49.343026 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.343004 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h97zl"] Jul 14 20:22:49.343778 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:49.343509 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:49.343778 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:49.343659 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:50.140993 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:50.140964 2554 generic.go:356] "Generic (PLEG): container finished" podID="291a6005-dc24-4df7-abb0-bd8804f470f4" containerID="e892935bb7a6d8178a3b2f55c55db9140a7673138e38845ab8aacae166fc6392" exitCode=0 Jul 14 20:22:50.141356 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:50.141051 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerDied","Data":"e892935bb7a6d8178a3b2f55c55db9140a7673138e38845ab8aacae166fc6392"} Jul 14 20:22:50.937953 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:50.937923 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:50.938106 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:50.937923 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:50.938106 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:50.938038 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:50.938106 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:50.937939 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:50.938206 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:50.938102 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:50.938206 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:50.938182 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:51.531274 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:51.531249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:51.531334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.531432 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.531455 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.531466 2554 projected.go:196] Error preparing data for projected volume kube-api-access-smbcf for pod openshift-network-diagnostics/network-check-target-kzmh8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.531432 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.531517 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf podName:be1a57f8-fcb3-45e0-922e-44d68ed476e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:23.531496641 +0000 UTC m=+66.130137506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-smbcf" (UniqueName: "kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf") pod "network-check-target-kzmh8" (UID: "be1a57f8-fcb3-45e0-922e-44d68ed476e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:51.531716 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.531546 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret podName:58868e63-1ff3-4fa3-9718-5556fcdb6ed4 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:23.531535324 +0000 UTC m=+66.130176204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret") pod "global-pull-secret-syncer-zvrfm" (UID: "58868e63-1ff3-4fa3-9718-5556fcdb6ed4") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:51.632466 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:51.632439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:51.632575 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.632549 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:51.632618 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:51.632597 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:23.632584499 +0000 UTC m=+66.231225376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:52.147044 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:52.147005 2554 generic.go:356] "Generic (PLEG): container finished" podID="291a6005-dc24-4df7-abb0-bd8804f470f4" containerID="e41e767a962b42c1a1145e192a5b40b916c9c8118646605081017b40e9fc7878" exitCode=0 Jul 14 20:22:52.147044 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:52.147048 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerDied","Data":"e41e767a962b42c1a1145e192a5b40b916c9c8118646605081017b40e9fc7878"} Jul 14 20:22:52.937318 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:52.937287 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:52.937866 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:52.937286 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:52.937866 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:52.937440 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:22:52.937866 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:52.937470 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kzmh8" podUID="be1a57f8-fcb3-45e0-922e-44d68ed476e5" Jul 14 20:22:52.937866 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:52.937287 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:52.937866 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:52.937549 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zvrfm" podUID="58868e63-1ff3-4fa3-9718-5556fcdb6ed4" Jul 14 20:22:53.704643 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.704615 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeReady" Jul 14 20:22:53.704836 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.704793 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 20:22:53.747615 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.747535 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dt9w2"] Jul 14 20:22:53.749670 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.749644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.750519 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.750491 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n9w7t"] Jul 14 20:22:53.752033 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.752012 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 20:22:53.752208 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.752024 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qv2tt\"" Jul 14 20:22:53.752511 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.752493 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 20:22:53.752855 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.752836 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.754665 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.754645 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 20:22:53.754820 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.754806 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 20:22:53.754883 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.754828 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-plh4p\"" Jul 14 20:22:53.754883 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.754860 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 20:22:53.760853 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.760805 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dt9w2"] Jul 14 20:22:53.765775 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.765741 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9w7t"] Jul 14 20:22:53.850579 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.850547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gc7t\" (UniqueName: \"kubernetes.io/projected/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-kube-api-access-8gc7t\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.850579 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.850587 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01589a17-ecf0-4d1a-9293-8e2c10d3104e-cert\") pod \"ingress-canary-n9w7t\" (UID: \"01589a17-ecf0-4d1a-9293-8e2c10d3104e\") " pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.850808 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.850609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xghq\" (UniqueName: \"kubernetes.io/projected/01589a17-ecf0-4d1a-9293-8e2c10d3104e-kube-api-access-4xghq\") pod \"ingress-canary-n9w7t\" (UID: \"01589a17-ecf0-4d1a-9293-8e2c10d3104e\") " pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.850808 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.850703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-config-volume\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.850808 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.850799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.850937 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.850827 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-tmp-dir\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.951546 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.951511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gc7t\" (UniqueName: \"kubernetes.io/projected/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-kube-api-access-8gc7t\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.951554 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01589a17-ecf0-4d1a-9293-8e2c10d3104e-cert\") pod \"ingress-canary-n9w7t\" (UID: \"01589a17-ecf0-4d1a-9293-8e2c10d3104e\") " pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.951582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xghq\" (UniqueName: \"kubernetes.io/projected/01589a17-ecf0-4d1a-9293-8e2c10d3104e-kube-api-access-4xghq\") pod \"ingress-canary-n9w7t\" (UID: \"01589a17-ecf0-4d1a-9293-8e2c10d3104e\") " pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.951619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-config-volume\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.951688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.951715 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-tmp-dir\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:53.951929 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:53.952004 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:22:54.451982749 +0000 UTC m=+37.050623632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:22:53.952112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.952086 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-tmp-dir\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.952500 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.952244 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-config-volume\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:53.956376 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.956341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01589a17-ecf0-4d1a-9293-8e2c10d3104e-cert\") pod \"ingress-canary-n9w7t\" (UID: \"01589a17-ecf0-4d1a-9293-8e2c10d3104e\") " pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.964467 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.963371 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xghq\" (UniqueName: \"kubernetes.io/projected/01589a17-ecf0-4d1a-9293-8e2c10d3104e-kube-api-access-4xghq\") pod \"ingress-canary-n9w7t\" (UID: \"01589a17-ecf0-4d1a-9293-8e2c10d3104e\") " pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:53.964467 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:53.963478 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gc7t\" (UniqueName: \"kubernetes.io/projected/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-kube-api-access-8gc7t\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:54.071426 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.071369 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9w7t" Jul 14 20:22:54.225555 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.225334 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9w7t"] Jul 14 20:22:54.229997 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:22:54.229958 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01589a17_ecf0_4d1a_9293_8e2c10d3104e.slice/crio-1ef5d17a58f708659cc064be4536019fe8d22a8c6da36a9943e55b2f617cb1f9 WatchSource:0}: Error finding container 1ef5d17a58f708659cc064be4536019fe8d22a8c6da36a9943e55b2f617cb1f9: Status 404 returned error can't find the container with id 1ef5d17a58f708659cc064be4536019fe8d22a8c6da36a9943e55b2f617cb1f9 Jul 14 20:22:54.455114 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.454991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:54.455273 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:54.455169 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:54.455273 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:54.455255 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:22:55.455231941 +0000 UTC m=+38.053872809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:22:54.937736 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.937698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:22:54.937736 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.937727 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:22:54.937997 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.937698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:22:54.940565 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.940539 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 20:22:54.940692 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.940591 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 20:22:54.940692 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.940612 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 20:22:54.940808 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.940770 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hghx\"" Jul 14 20:22:54.940862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.940820 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 20:22:54.940862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:54.940834 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rw2b\"" Jul 14 20:22:55.159598 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:55.159521 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9w7t" event={"ID":"01589a17-ecf0-4d1a-9293-8e2c10d3104e","Type":"ContainerStarted","Data":"1ef5d17a58f708659cc064be4536019fe8d22a8c6da36a9943e55b2f617cb1f9"} Jul 14 20:22:55.464623 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:55.464578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:55.464807 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:55.464753 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:55.464872 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:55.464812 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:22:57.464793787 +0000 UTC m=+40.063434659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:22:57.478724 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:57.478633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:22:57.479048 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:57.478765 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:57.479048 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:22:57.478819 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:23:01.478804607 +0000 UTC m=+44.077445471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:22:58.168774 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:58.168518 2554 generic.go:356] "Generic (PLEG): container finished" podID="291a6005-dc24-4df7-abb0-bd8804f470f4" containerID="31b01c9689ea9bd74f249e98c3dc00df42dc4ca11874c0975b6a5bd33bf15cbe" exitCode=0 Jul 14 20:22:58.168949 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:58.168592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerDied","Data":"31b01c9689ea9bd74f249e98c3dc00df42dc4ca11874c0975b6a5bd33bf15cbe"} Jul 14 20:22:58.170864 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:58.170838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9w7t" event={"ID":"01589a17-ecf0-4d1a-9293-8e2c10d3104e","Type":"ContainerStarted","Data":"562050f6ba08d2d427643c9b455450b524b182c08fc0c5df861753799d91f1a9"} Jul 14 20:22:58.207108 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:58.207061 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n9w7t" podStartSLOduration=2.345187879 podStartE2EDuration="5.207045115s" totalImagesPullingTime="2.861857236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:58.206713617 +0000 UTC m=+40.805354509" watchObservedRunningTime="2026-07-14 20:22:58.207045115 +0000 UTC m=+40.805686001" Jul 14 20:22:59.176422 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:59.176325 2554 generic.go:356] "Generic (PLEG): container finished" podID="291a6005-dc24-4df7-abb0-bd8804f470f4" containerID="14fde2b435625fea441d41361f0d1bca1b6458acac329fc155bd4cae7079393a" exitCode=0 Jul 14 20:22:59.176820 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:22:59.176414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerDied","Data":"14fde2b435625fea441d41361f0d1bca1b6458acac329fc155bd4cae7079393a"} Jul 14 20:23:00.181806 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:00.181772 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" event={"ID":"291a6005-dc24-4df7-abb0-bd8804f470f4","Type":"ContainerStarted","Data":"e73da4d58d8f9bf8578586bfa386fe9b039f89cab01bf5932e9d69a1a1fe07aa"} Jul 14 20:23:00.202707 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:00.202662 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zhrq2" podStartSLOduration=8.668985816 podStartE2EDuration="42.202648395s" totalImagesPullingTime="33.533662579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:00.202191454 +0000 UTC m=+42.800832345" watchObservedRunningTime="2026-07-14 20:23:00.202648395 +0000 UTC m=+42.801289281" Jul 14 20:23:01.507687 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:01.507644 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:23:01.508055 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:01.507804 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:01.508055 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:01.507870 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:23:09.507853494 +0000 UTC m=+52.106494362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:23:09.563980 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:09.563940 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:23:09.564497 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:09.564062 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:09.564497 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:09.564141 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:23:25.564125655 +0000 UTC m=+68.162766520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:23:16.445884 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.445849 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk"] Jul 14 20:23:16.448374 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.448353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.450772 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.450732 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 20:23:16.450772 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.450753 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 20:23:16.450772 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.450763 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 20:23:16.451016 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.450781 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 20:23:16.451016 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.450753 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 20:23:16.451016 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.450763 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 20:23:16.451259 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.451241 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 20:23:16.461685 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.461665 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk"] Jul 14 20:23:16.512699 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.512662 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6pkk\" (UniqueName: \"kubernetes.io/projected/63d2e910-1c70-4b2c-bd56-af13673156ea-kube-api-access-l6pkk\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.512699 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.512704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-hub\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.512931 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.512728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-ca\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.512931 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.512754 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.512931 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.512812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.512931 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.512845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2e910-1c70-4b2c-bd56-af13673156ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.613969 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.613932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.614153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.613973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2e910-1c70-4b2c-bd56-af13673156ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.614153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.614021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6pkk\" (UniqueName: \"kubernetes.io/projected/63d2e910-1c70-4b2c-bd56-af13673156ea-kube-api-access-l6pkk\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.614153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.614045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-hub\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.614153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.614066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-ca\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.614153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.614082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.614825 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.614795 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2e910-1c70-4b2c-bd56-af13673156ea-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.618058 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.618034 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-ca\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.618195 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.618179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.618233 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.618207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.618271 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.618241 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/63d2e910-1c70-4b2c-bd56-af13673156ea-hub\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.621584 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.621564 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6pkk\" (UniqueName: \"kubernetes.io/projected/63d2e910-1c70-4b2c-bd56-af13673156ea-kube-api-access-l6pkk\") pod \"cluster-proxy-proxy-agent-f48f846-9qlkk\" (UID: \"63d2e910-1c70-4b2c-bd56-af13673156ea\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.768583 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.768482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:23:16.895294 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:16.895256 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk"] Jul 14 20:23:16.900924 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:23:16.900897 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63d2e910_1c70_4b2c_bd56_af13673156ea.slice/crio-2317ddf33f3dffdddbd62749264dacec769a426e8b6608aac36c0e3aad86d1b9 WatchSource:0}: Error finding container 2317ddf33f3dffdddbd62749264dacec769a426e8b6608aac36c0e3aad86d1b9: Status 404 returned error can't find the container with id 2317ddf33f3dffdddbd62749264dacec769a426e8b6608aac36c0e3aad86d1b9 Jul 14 20:23:17.220785 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:17.220743 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" event={"ID":"63d2e910-1c70-4b2c-bd56-af13673156ea","Type":"ContainerStarted","Data":"2317ddf33f3dffdddbd62749264dacec769a426e8b6608aac36c0e3aad86d1b9"} Jul 14 20:23:21.154017 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:21.153988 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4xvz" Jul 14 20:23:21.234288 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:21.234251 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" event={"ID":"63d2e910-1c70-4b2c-bd56-af13673156ea","Type":"ContainerStarted","Data":"9c7c53190b5b7a2b6bbcd60f5252872150feeade090c4251194d449a238b2d0a"} Jul 14 20:23:21.234288 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:21.234293 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" event={"ID":"63d2e910-1c70-4b2c-bd56-af13673156ea","Type":"ContainerStarted","Data":"5a51d735df733c622a2197688f7318cdc4d711bc599b607f78053b622e45ade6"} Jul 14 20:23:21.234503 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:21.234305 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" event={"ID":"63d2e910-1c70-4b2c-bd56-af13673156ea","Type":"ContainerStarted","Data":"39c2b1df5bbc571f4dd5952c614ca9b46d7cbfa4b5dc0ec9dfe29893098baa94"} Jul 14 20:23:21.251811 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:21.251761 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" podStartSLOduration=1.602129594 podStartE2EDuration="5.251745727s" totalImagesPullingTime="3.649616133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:21.251073327 +0000 UTC m=+63.849714214" watchObservedRunningTime="2026-07-14 20:23:21.251745727 +0000 UTC m=+63.850386612" Jul 14 20:23:23.568553 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.568506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:23:23.568553 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.568562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:23:23.570888 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.570866 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 20:23:23.570949 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.570886 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 20:23:23.581496 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.581467 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 20:23:23.581911 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.581890 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58868e63-1ff3-4fa3-9718-5556fcdb6ed4-original-pull-secret\") pod \"global-pull-secret-syncer-zvrfm\" (UID: \"58868e63-1ff3-4fa3-9718-5556fcdb6ed4\") " pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:23:23.592562 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.592538 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smbcf\" (UniqueName: \"kubernetes.io/projected/be1a57f8-fcb3-45e0-922e-44d68ed476e5-kube-api-access-smbcf\") pod \"network-check-target-kzmh8\" (UID: \"be1a57f8-fcb3-45e0-922e-44d68ed476e5\") " pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:23:23.669636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.669596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:23:23.671899 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.671877 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 20:23:23.680530 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:23.680511 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 20:23:23.680597 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:23.680586 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:24:27.680564635 +0000 UTC m=+130.279205501 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : secret "metrics-daemon-secret" not found Jul 14 20:23:23.750442 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.750410 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zvrfm" Jul 14 20:23:23.768376 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.768345 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rw2b\"" Jul 14 20:23:23.776913 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.776882 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:23:23.903337 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.903304 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zvrfm"] Jul 14 20:23:23.907245 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:23:23.907215 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58868e63_1ff3_4fa3_9718_5556fcdb6ed4.slice/crio-224b2d5cc297e82163057cec0257a2594acc93bfd75c96782d0d08a638fbad03 WatchSource:0}: Error finding container 224b2d5cc297e82163057cec0257a2594acc93bfd75c96782d0d08a638fbad03: Status 404 returned error can't find the container with id 224b2d5cc297e82163057cec0257a2594acc93bfd75c96782d0d08a638fbad03 Jul 14 20:23:23.942117 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:23.942090 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kzmh8"] Jul 14 20:23:23.945277 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:23:23.945255 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1a57f8_fcb3_45e0_922e_44d68ed476e5.slice/crio-137b26b8b796ba402141907e97837b89492f15f5dc9607abaa61843d68ae5ee8 WatchSource:0}: Error finding container 137b26b8b796ba402141907e97837b89492f15f5dc9607abaa61843d68ae5ee8: Status 404 returned error can't find the container with id 137b26b8b796ba402141907e97837b89492f15f5dc9607abaa61843d68ae5ee8 Jul 14 20:23:24.241751 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:24.241661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kzmh8" event={"ID":"be1a57f8-fcb3-45e0-922e-44d68ed476e5","Type":"ContainerStarted","Data":"137b26b8b796ba402141907e97837b89492f15f5dc9607abaa61843d68ae5ee8"} Jul 14 20:23:24.242618 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:24.242595 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zvrfm" event={"ID":"58868e63-1ff3-4fa3-9718-5556fcdb6ed4","Type":"ContainerStarted","Data":"224b2d5cc297e82163057cec0257a2594acc93bfd75c96782d0d08a638fbad03"} Jul 14 20:23:25.584553 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:25.584515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:23:25.585046 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:25.584679 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:25.585046 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:25.584737 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:23:57.584718361 +0000 UTC m=+100.183359229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:23:27.253471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:27.253420 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kzmh8" event={"ID":"be1a57f8-fcb3-45e0-922e-44d68ed476e5","Type":"ContainerStarted","Data":"e18f855800bdb8437fd6b879e2d113bb09f789e4c2164d0d655d0f291a159fe1"} Jul 14 20:23:27.253964 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:27.253696 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:23:27.268626 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:27.268567 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kzmh8" podStartSLOduration=66.168817143 podStartE2EDuration="1m9.26854945s" totalImagesPullingTime="3.099732307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:27.267438045 +0000 UTC m=+69.866078929" watchObservedRunningTime="2026-07-14 20:23:27.26854945 +0000 UTC m=+69.867190339" Jul 14 20:23:29.260335 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:29.260291 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zvrfm" event={"ID":"58868e63-1ff3-4fa3-9718-5556fcdb6ed4","Type":"ContainerStarted","Data":"780e2652d3a0619aed35936d4ccb037926ea24adea5720ebbb4ae99a0b4983a4"} Jul 14 20:23:29.274876 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:29.274824 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zvrfm" podStartSLOduration=66.653920697 podStartE2EDuration="1m11.274807765s" totalImagesPullingTime="4.620887068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:29.273786532 +0000 UTC m=+71.872427421" watchObservedRunningTime="2026-07-14 20:23:29.274807765 +0000 UTC m=+71.873448654" Jul 14 20:23:57.613963 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:57.613823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:23:57.613963 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:57.613950 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:57.614417 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:23:57.614018 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:25:01.614003415 +0000 UTC m=+164.212644292 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:23:58.259069 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:23:58.259035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kzmh8" Jul 14 20:24:27.721283 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:24:27.721240 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:24:27.721797 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:24:27.721369 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 20:24:27.721797 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:24:27.721457 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs podName:db5f757b-0173-4981-b061-0bccac8ef3e5 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:29.721441046 +0000 UTC m=+252.320081910 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs") pod "network-metrics-daemon-h97zl" (UID: "db5f757b-0173-4981-b061-0bccac8ef3e5") : secret "metrics-daemon-secret" not found Jul 14 20:24:56.763660 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:24:56.763613 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dt9w2" podUID="b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a" Jul 14 20:24:57.508351 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:24:57.508323 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dt9w2" Jul 14 20:24:57.958232 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:24:57.958194 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h97zl" podUID="db5f757b-0173-4981-b061-0bccac8ef3e5" Jul 14 20:25:01.641826 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:25:01.641788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:25:01.642204 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:25:01.641907 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:25:01.642204 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:25:01.641961 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls podName:b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a nodeName:}" failed. No retries permitted until 2026-07-14 20:27:03.641946768 +0000 UTC m=+286.240587634 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls") pod "dns-default-dt9w2" (UID: "b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a") : secret "dns-default-metrics-tls" not found Jul 14 20:25:10.938093 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:25:10.937992 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:26:12.795135 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.795095 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b748bcb6f-xm2zd"] Jul 14 20:26:12.797079 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.797058 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.799604 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.799585 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 20:26:12.800369 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.800353 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xn5rs\"" Jul 14 20:26:12.803670 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.803652 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 20:26:12.804055 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.804034 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 20:26:12.809002 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.808980 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 20:26:12.819755 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.819726 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b748bcb6f-xm2zd"] Jul 14 20:26:12.937030 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.936988 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160522d9-ef43-413b-b81e-e8a0e83002ba-ca-trust-extracted\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937071 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937100 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-certificates\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-installation-pull-secrets\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-trusted-ca\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937372 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937225 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-bound-sa-token\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937372 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx524\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-kube-api-access-fx524\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:12.937372 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:12.937288 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-image-registry-private-configuration\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038590 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160522d9-ef43-413b-b81e-e8a0e83002ba-ca-trust-extracted\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038672 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038620 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038672 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-certificates\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038672 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-installation-pull-secrets\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038672 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-trusted-ca\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038857 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038682 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-bound-sa-token\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038857 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx524\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-kube-api-access-fx524\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038857 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.038716 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-image-registry-private-configuration\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.038857 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:13.038812 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:26:13.038857 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:13.038839 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b748bcb6f-xm2zd: secret "image-registry-tls" not found Jul 14 20:26:13.039127 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:13.038915 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls podName:160522d9-ef43-413b-b81e-e8a0e83002ba nodeName:}" failed. No retries permitted until 2026-07-14 20:26:13.538893221 +0000 UTC m=+236.137534086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls") pod "image-registry-b748bcb6f-xm2zd" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba") : secret "image-registry-tls" not found Jul 14 20:26:13.039127 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.039025 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160522d9-ef43-413b-b81e-e8a0e83002ba-ca-trust-extracted\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.039298 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.039275 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-certificates\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.039642 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.039623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-trusted-ca\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.041171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.041154 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-image-registry-private-configuration\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.041272 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.041255 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-installation-pull-secrets\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.047018 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.046963 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-bound-sa-token\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.047193 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.047177 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx524\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-kube-api-access-fx524\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.541516 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:13.541483 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:13.541694 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:13.541629 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:26:13.541694 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:13.541650 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b748bcb6f-xm2zd: secret "image-registry-tls" not found Jul 14 20:26:13.541767 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:13.541718 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls podName:160522d9-ef43-413b-b81e-e8a0e83002ba nodeName:}" failed. No retries permitted until 2026-07-14 20:26:14.541700894 +0000 UTC m=+237.140341758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls") pod "image-registry-b748bcb6f-xm2zd" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba") : secret "image-registry-tls" not found Jul 14 20:26:14.549160 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:14.549114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:14.549590 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:14.549237 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:26:14.549590 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:14.549251 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b748bcb6f-xm2zd: secret "image-registry-tls" not found Jul 14 20:26:14.549590 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:14.549306 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls podName:160522d9-ef43-413b-b81e-e8a0e83002ba nodeName:}" failed. No retries permitted until 2026-07-14 20:26:16.549291306 +0000 UTC m=+239.147932170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls") pod "image-registry-b748bcb6f-xm2zd" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba") : secret "image-registry-tls" not found Jul 14 20:26:16.563994 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:16.563942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:16.564509 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:16.564122 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:26:16.564509 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:16.564147 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b748bcb6f-xm2zd: secret "image-registry-tls" not found Jul 14 20:26:16.564509 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:16.564250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls podName:160522d9-ef43-413b-b81e-e8a0e83002ba nodeName:}" failed. No retries permitted until 2026-07-14 20:26:20.56422688 +0000 UTC m=+243.162867762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls") pod "image-registry-b748bcb6f-xm2zd" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba") : secret "image-registry-tls" not found Jul 14 20:26:18.063666 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.063631 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-brjnj"] Jul 14 20:26:18.066779 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.066759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.069879 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.069854 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 20:26:18.070019 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.069929 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 20:26:18.070326 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.070310 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 20:26:18.070481 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.070463 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 20:26:18.070924 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.070905 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lxqqx\"" Jul 14 20:26:18.075133 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.074999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.075133 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.075095 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdad253a-3df9-4462-9bca-dc4871b6ab4c-crio-socket\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.075133 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.075128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdad253a-3df9-4462-9bca-dc4871b6ab4c-data-volume\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.075349 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.075174 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn29h\" (UniqueName: \"kubernetes.io/projected/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-api-access-sn29h\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.075349 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.075257 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.079624 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.079600 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brjnj"] Jul 14 20:26:18.175580 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.175769 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdad253a-3df9-4462-9bca-dc4871b6ab4c-crio-socket\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.175769 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175673 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdad253a-3df9-4462-9bca-dc4871b6ab4c-data-volume\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.175769 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.175686 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:18.175769 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn29h\" (UniqueName: \"kubernetes.io/projected/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-api-access-sn29h\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.175769 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175723 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.175769 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.175762 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:18.675742153 +0000 UTC m=+241.274383018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : configmap "kube-rbac-proxy" not found Jul 14 20:26:18.176072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175769 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdad253a-3df9-4462-9bca-dc4871b6ab4c-crio-socket\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.176072 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.175835 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.176072 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.175891 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:18.675875546 +0000 UTC m=+241.274516425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.176072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.175992 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdad253a-3df9-4462-9bca-dc4871b6ab4c-data-volume\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.183702 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.183682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn29h\" (UniqueName: \"kubernetes.io/projected/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-api-access-sn29h\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.678554 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.678516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.678554 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:18.678561 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:18.678759 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.678642 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:18.678759 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.678677 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.678759 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.678696 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:19.67868122 +0000 UTC m=+242.277322086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : configmap "kube-rbac-proxy" not found Jul 14 20:26:18.678759 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:18.678741 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:19.67872546 +0000 UTC m=+242.277366325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:19.684643 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:19.684604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:19.685119 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:19.684655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:19.685119 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:19.684754 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:19.685119 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:19.684792 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:19.685119 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:19.684829 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:21.68481245 +0000 UTC m=+244.283453315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:19.685119 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:19.684844 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:21.684837031 +0000 UTC m=+244.283477895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : configmap "kube-rbac-proxy" not found Jul 14 20:26:20.590638 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:20.590602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:20.590803 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:20.590749 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:26:20.590803 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:20.590767 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b748bcb6f-xm2zd: secret "image-registry-tls" not found Jul 14 20:26:20.590881 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:20.590832 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls podName:160522d9-ef43-413b-b81e-e8a0e83002ba nodeName:}" failed. No retries permitted until 2026-07-14 20:26:28.590815428 +0000 UTC m=+251.189456293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls") pod "image-registry-b748bcb6f-xm2zd" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba") : secret "image-registry-tls" not found Jul 14 20:26:21.052216 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:21.052137 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fx65n_5c1481c8-8059-40fe-909a-eb82c84c5277/dns-node-resolver/0.log" Jul 14 20:26:21.699526 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:21.699484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:21.699526 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:21.699534 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:21.699787 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:21.699643 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:21.699787 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:21.699662 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:21.699787 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:21.699696 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:25.699682583 +0000 UTC m=+248.298323448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : configmap "kube-rbac-proxy" not found Jul 14 20:26:21.699787 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:21.699722 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:25.699706261 +0000 UTC m=+248.298347132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:22.051956 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:22.051876 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsw9t_536265ff-3cd8-4d94-8485-20d3cd72eced/node-ca/0.log" Jul 14 20:26:22.651659 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:22.651633 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9w7t_01589a17-ecf0-4d1a-9293-8e2c10d3104e/serve-healthcheck-canary/0.log" Jul 14 20:26:25.727893 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:25.727857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:25.727893 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:25.727900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:25.728319 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:25.727971 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:25.728319 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:25.728013 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:25.728319 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:25.728022 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:33.728009246 +0000 UTC m=+256.326650111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : configmap "kube-rbac-proxy" not found Jul 14 20:26:25.728319 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:26:25.728081 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls podName:cdad253a-3df9-4462-9bca-dc4871b6ab4c nodeName:}" failed. No retries permitted until 2026-07-14 20:26:33.728060406 +0000 UTC m=+256.326701272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brjnj" (UID: "cdad253a-3df9-4462-9bca-dc4871b6ab4c") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:28.650120 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:28.650086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:28.652787 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:28.652766 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"image-registry-b748bcb6f-xm2zd\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:28.708086 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:28.708051 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xn5rs\"" Jul 14 20:26:28.716273 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:28.716243 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:28.842109 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:28.841991 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b748bcb6f-xm2zd"] Jul 14 20:26:28.844567 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:26:28.844541 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160522d9_ef43_413b_b81e_e8a0e83002ba.slice/crio-8f19c0e09571113ed8c5fb215f43e7cedfb84653a85d863558387f330afe6096 WatchSource:0}: Error finding container 8f19c0e09571113ed8c5fb215f43e7cedfb84653a85d863558387f330afe6096: Status 404 returned error can't find the container with id 8f19c0e09571113ed8c5fb215f43e7cedfb84653a85d863558387f330afe6096 Jul 14 20:26:29.757307 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.757266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:26:29.759704 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.759675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db5f757b-0173-4981-b061-0bccac8ef3e5-metrics-certs\") pod \"network-metrics-daemon-h97zl\" (UID: \"db5f757b-0173-4981-b061-0bccac8ef3e5\") " pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:26:29.773185 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.773159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" event={"ID":"160522d9-ef43-413b-b81e-e8a0e83002ba","Type":"ContainerStarted","Data":"b91978bd4c63c1e0cc54d5681fe90cc7e24ad39ad106e331f5b562d0e28ec426"} Jul 14 20:26:29.773310 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.773201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" event={"ID":"160522d9-ef43-413b-b81e-e8a0e83002ba","Type":"ContainerStarted","Data":"8f19c0e09571113ed8c5fb215f43e7cedfb84653a85d863558387f330afe6096"} Jul 14 20:26:29.773310 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.773231 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:26:29.790887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.790835 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" podStartSLOduration=17.790819234 podStartE2EDuration="17.790819234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:29.790337921 +0000 UTC m=+252.388978844" watchObservedRunningTime="2026-07-14 20:26:29.790819234 +0000 UTC m=+252.389460098" Jul 14 20:26:29.840451 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.840422 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hghx\"" Jul 14 20:26:29.849349 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.849322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h97zl" Jul 14 20:26:29.971717 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:29.971675 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h97zl"] Jul 14 20:26:29.974574 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:26:29.974543 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5f757b_0173_4981_b061_0bccac8ef3e5.slice/crio-4ac5ceec5bedee4ad0b15b512000b2da0520b654a3b71d8f432bb622fa65aa8a WatchSource:0}: Error finding container 4ac5ceec5bedee4ad0b15b512000b2da0520b654a3b71d8f432bb622fa65aa8a: Status 404 returned error can't find the container with id 4ac5ceec5bedee4ad0b15b512000b2da0520b654a3b71d8f432bb622fa65aa8a Jul 14 20:26:30.777698 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:30.777660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h97zl" event={"ID":"db5f757b-0173-4981-b061-0bccac8ef3e5","Type":"ContainerStarted","Data":"4ac5ceec5bedee4ad0b15b512000b2da0520b654a3b71d8f432bb622fa65aa8a"} Jul 14 20:26:31.781997 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:31.781964 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h97zl" event={"ID":"db5f757b-0173-4981-b061-0bccac8ef3e5","Type":"ContainerStarted","Data":"fc064c7bf93395b72c1c03be0c2fa4634ade431dfd82bea782806e8e0cc0aff3"} Jul 14 20:26:31.782439 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:31.782059 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h97zl" event={"ID":"db5f757b-0173-4981-b061-0bccac8ef3e5","Type":"ContainerStarted","Data":"39f212cfc4c6c79c71e97f65184a216f642412a253423a6aebd00ac76a99c18c"} Jul 14 20:26:31.799425 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:31.799353 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h97zl" podStartSLOduration=252.574720244 podStartE2EDuration="4m13.799337783s" totalImagesPullingTime="1.224617539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:31.797996959 +0000 UTC m=+254.396637846" watchObservedRunningTime="2026-07-14 20:26:31.799337783 +0000 UTC m=+254.397978647" Jul 14 20:26:33.785786 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:33.785750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:33.786180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:33.785807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:33.786291 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:33.786273 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdad253a-3df9-4462-9bca-dc4871b6ab4c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:33.788221 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:33.788201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdad253a-3df9-4462-9bca-dc4871b6ab4c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brjnj\" (UID: \"cdad253a-3df9-4462-9bca-dc4871b6ab4c\") " pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:33.976250 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:33.976217 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brjnj" Jul 14 20:26:34.099521 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:34.099489 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brjnj"] Jul 14 20:26:34.102744 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:26:34.102716 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdad253a_3df9_4462_9bca_dc4871b6ab4c.slice/crio-f0935fe8bdc8cc3e4590686e1d9f58c10a5eb22794d2a898bd8d5e7ed66f93df WatchSource:0}: Error finding container f0935fe8bdc8cc3e4590686e1d9f58c10a5eb22794d2a898bd8d5e7ed66f93df: Status 404 returned error can't find the container with id f0935fe8bdc8cc3e4590686e1d9f58c10a5eb22794d2a898bd8d5e7ed66f93df Jul 14 20:26:34.796820 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:34.796778 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brjnj" event={"ID":"cdad253a-3df9-4462-9bca-dc4871b6ab4c","Type":"ContainerStarted","Data":"f0935fe8bdc8cc3e4590686e1d9f58c10a5eb22794d2a898bd8d5e7ed66f93df"} Jul 14 20:26:38.812694 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:38.812655 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brjnj" event={"ID":"cdad253a-3df9-4462-9bca-dc4871b6ab4c","Type":"ContainerStarted","Data":"e8f5daff0a4fecab7bdb4a019a0e97a307fc77fd8d17dbd08de3b4065520731b"} Jul 14 20:26:38.813056 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:38.812745 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brjnj" event={"ID":"cdad253a-3df9-4462-9bca-dc4871b6ab4c","Type":"ContainerStarted","Data":"a9d1317512e148ce7b6e50a53d04e48b0c835e289d40fa89217081584539a717"} Jul 14 20:26:41.825718 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:41.825685 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brjnj" event={"ID":"cdad253a-3df9-4462-9bca-dc4871b6ab4c","Type":"ContainerStarted","Data":"8d192e2f9456a8cf236971232b5b6f05b0ad284b5444cdc1a5f75b4ff1d5b9bd"} Jul 14 20:26:41.845219 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:41.845168 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-brjnj" podStartSLOduration=16.928063177 podStartE2EDuration="23.845151244s" totalImagesPullingTime="6.917088067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:26:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:41.843915455 +0000 UTC m=+264.442556342" watchObservedRunningTime="2026-07-14 20:26:41.845151244 +0000 UTC m=+264.443792130" Jul 14 20:26:44.692174 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.692138 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b748bcb6f-xm2zd"] Jul 14 20:26:44.696598 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.696555 2554 patch_prober.go:28] interesting pod/image-registry-b748bcb6f-xm2zd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:26:44.696733 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.696613 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:26:44.791633 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.791566 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c6d88dc5b-djzcx"] Jul 14 20:26:44.794671 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.794647 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.808229 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.808202 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6d88dc5b-djzcx"] Jul 14 20:26:44.866529 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-bound-sa-token\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866529 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889f6169-b41f-40e6-87fc-2566fb23e8ed-installation-pull-secrets\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866732 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889f6169-b41f-40e6-87fc-2566fb23e8ed-ca-trust-extracted\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866732 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889f6169-b41f-40e6-87fc-2566fb23e8ed-image-registry-private-configuration\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866732 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866691 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889f6169-b41f-40e6-87fc-2566fb23e8ed-registry-certificates\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866732 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866713 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fsk8\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-kube-api-access-4fsk8\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866874 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889f6169-b41f-40e6-87fc-2566fb23e8ed-trusted-ca\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.866874 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.866773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-registry-tls\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967680 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-bound-sa-token\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967680 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889f6169-b41f-40e6-87fc-2566fb23e8ed-installation-pull-secrets\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967680 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889f6169-b41f-40e6-87fc-2566fb23e8ed-ca-trust-extracted\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889f6169-b41f-40e6-87fc-2566fb23e8ed-image-registry-private-configuration\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889f6169-b41f-40e6-87fc-2566fb23e8ed-registry-certificates\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fsk8\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-kube-api-access-4fsk8\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889f6169-b41f-40e6-87fc-2566fb23e8ed-trusted-ca\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.967934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.967804 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-registry-tls\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.968193 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.968160 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/889f6169-b41f-40e6-87fc-2566fb23e8ed-ca-trust-extracted\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.968680 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.968659 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/889f6169-b41f-40e6-87fc-2566fb23e8ed-registry-certificates\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.968968 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.968944 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/889f6169-b41f-40e6-87fc-2566fb23e8ed-trusted-ca\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.970352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.970333 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/889f6169-b41f-40e6-87fc-2566fb23e8ed-image-registry-private-configuration\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.970791 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.970769 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-registry-tls\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.970922 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.970901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/889f6169-b41f-40e6-87fc-2566fb23e8ed-installation-pull-secrets\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.976227 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.976190 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-bound-sa-token\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:44.976676 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:44.976654 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fsk8\" (UniqueName: \"kubernetes.io/projected/889f6169-b41f-40e6-87fc-2566fb23e8ed-kube-api-access-4fsk8\") pod \"image-registry-7c6d88dc5b-djzcx\" (UID: \"889f6169-b41f-40e6-87fc-2566fb23e8ed\") " pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:45.103140 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:45.103101 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:45.231054 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:45.230968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6d88dc5b-djzcx"] Jul 14 20:26:45.234271 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:26:45.234242 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889f6169_b41f_40e6_87fc_2566fb23e8ed.slice/crio-d94d90330ac8f930b30db20f57658123e203e12b8421405eacaff47375383b98 WatchSource:0}: Error finding container d94d90330ac8f930b30db20f57658123e203e12b8421405eacaff47375383b98: Status 404 returned error can't find the container with id d94d90330ac8f930b30db20f57658123e203e12b8421405eacaff47375383b98 Jul 14 20:26:45.841078 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:45.841041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" event={"ID":"889f6169-b41f-40e6-87fc-2566fb23e8ed","Type":"ContainerStarted","Data":"84ed9318ed56a0dd65760fcb9067a6f0023024e9bc25a599e3de21b0da558f3c"} Jul 14 20:26:45.841078 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:45.841088 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" event={"ID":"889f6169-b41f-40e6-87fc-2566fb23e8ed","Type":"ContainerStarted","Data":"d94d90330ac8f930b30db20f57658123e203e12b8421405eacaff47375383b98"} Jul 14 20:26:45.841571 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:45.841183 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:26:45.861633 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:45.861585 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podStartSLOduration=1.861568928 podStartE2EDuration="1.861568928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:45.859770498 +0000 UTC m=+268.458411385" watchObservedRunningTime="2026-07-14 20:26:45.861568928 +0000 UTC m=+268.460209816" Jul 14 20:26:53.270943 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.270902 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-swbxs"] Jul 14 20:26:53.275668 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.275652 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.278177 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.278153 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 20:26:53.278789 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.278770 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 20:26:53.278929 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.278772 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 20:26:53.279131 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.279115 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 20:26:53.279231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.279132 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-62ffc\"" Jul 14 20:26:53.279231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.279164 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 20:26:53.279342 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.279288 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 20:26:53.328948 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.328916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqd5\" (UniqueName: \"kubernetes.io/projected/a3d909c0-befa-4934-af91-008492afeef8-kube-api-access-7kqd5\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329125 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.328956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329125 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3d909c0-befa-4934-af91-008492afeef8-metrics-client-ca\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329125 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329060 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-root\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329125 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-wtmp\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329312 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-textfile\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329312 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-tls\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329312 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-accelerators-collector-config\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.329312 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.329230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-sys\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430098 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430063 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-textfile\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430098 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-tls\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430360 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-accelerators-collector-config\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430360 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430228 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-sys\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430360 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqd5\" (UniqueName: \"kubernetes.io/projected/a3d909c0-befa-4934-af91-008492afeef8-kube-api-access-7kqd5\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430360 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430334 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-sys\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430432 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3d909c0-befa-4934-af91-008492afeef8-metrics-client-ca\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-root\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-wtmp\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430510 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-textfile\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430583 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-root\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430864 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430641 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-wtmp\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.430864 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430836 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-accelerators-collector-config\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.431000 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.430905 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3d909c0-befa-4934-af91-008492afeef8-metrics-client-ca\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.432729 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.432701 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-tls\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.432893 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.432847 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3d909c0-befa-4934-af91-008492afeef8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.440370 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.440346 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqd5\" (UniqueName: \"kubernetes.io/projected/a3d909c0-befa-4934-af91-008492afeef8-kube-api-access-7kqd5\") pod \"node-exporter-swbxs\" (UID: \"a3d909c0-befa-4934-af91-008492afeef8\") " pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.584694 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.584658 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-swbxs" Jul 14 20:26:53.595873 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:26:53.595844 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d909c0_befa_4934_af91_008492afeef8.slice/crio-1e13f2d6fcdd808f2da8903a4eeeb4d76596aa5d6afef39cc663a1744bfef1ea WatchSource:0}: Error finding container 1e13f2d6fcdd808f2da8903a4eeeb4d76596aa5d6afef39cc663a1744bfef1ea: Status 404 returned error can't find the container with id 1e13f2d6fcdd808f2da8903a4eeeb4d76596aa5d6afef39cc663a1744bfef1ea Jul 14 20:26:53.866654 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:53.866565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swbxs" event={"ID":"a3d909c0-befa-4934-af91-008492afeef8","Type":"ContainerStarted","Data":"1e13f2d6fcdd808f2da8903a4eeeb4d76596aa5d6afef39cc663a1744bfef1ea"} Jul 14 20:26:54.697563 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:54.697530 2554 patch_prober.go:28] interesting pod/image-registry-b748bcb6f-xm2zd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:26:54.698152 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:54.697581 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:26:54.871478 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:54.871366 2554 generic.go:356] "Generic (PLEG): container finished" podID="a3d909c0-befa-4934-af91-008492afeef8" containerID="f8957c9aaa6cc09e61146db233f70854f177161279569e82a0b498d55e2d58ab" exitCode=0 Jul 14 20:26:54.871478 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:54.871463 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swbxs" event={"ID":"a3d909c0-befa-4934-af91-008492afeef8","Type":"ContainerDied","Data":"f8957c9aaa6cc09e61146db233f70854f177161279569e82a0b498d55e2d58ab"} Jul 14 20:26:55.876515 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:55.876477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swbxs" event={"ID":"a3d909c0-befa-4934-af91-008492afeef8","Type":"ContainerStarted","Data":"b7d69b8b57ebc2b0c59dac60cfbc459ed198c16e4d8ef5375fd7b33f1df3f1e5"} Jul 14 20:26:55.876887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:55.876535 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swbxs" event={"ID":"a3d909c0-befa-4934-af91-008492afeef8","Type":"ContainerStarted","Data":"7e5da400e0757c6b202ea1c6a100d98d555a3f0079ff48159280fc012283f22d"} Jul 14 20:26:55.896178 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:55.896130 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-swbxs" podStartSLOduration=1.828774613 podStartE2EDuration="2.89611665s" totalImagesPullingTime="996.641079ms" totalInitContainerRuntime="70.700958ms" isStatefulPod=true podCreationTimestamp="2026-07-14 20:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:55.895233155 +0000 UTC m=+278.493874043" watchObservedRunningTime="2026-07-14 20:26:55.89611665 +0000 UTC m=+278.494757537" Jul 14 20:26:56.770225 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:26:56.770186 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" podUID="63d2e910-1c70-4b2c-bd56-af13673156ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 20:27:00.509666 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:27:00.509618 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dt9w2" podUID="b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a" Jul 14 20:27:00.891781 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:00.891757 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dt9w2" Jul 14 20:27:03.708643 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:03.708608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:27:03.710965 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:03.710945 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a-metrics-tls\") pod \"dns-default-dt9w2\" (UID: \"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a\") " pod="openshift-dns/dns-default-dt9w2" Jul 14 20:27:03.894245 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:03.894212 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qv2tt\"" Jul 14 20:27:03.902550 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:03.902527 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dt9w2" Jul 14 20:27:04.048750 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:04.048714 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dt9w2"] Jul 14 20:27:04.052248 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:27:04.052221 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e32190_ffd7_4c7d_a5e5_ea3a8c912e1a.slice/crio-c3c8cd7748375affb18afcce75d4c9a0747603feef6622198c63225bbc94f2de WatchSource:0}: Error finding container c3c8cd7748375affb18afcce75d4c9a0747603feef6622198c63225bbc94f2de: Status 404 returned error can't find the container with id c3c8cd7748375affb18afcce75d4c9a0747603feef6622198c63225bbc94f2de Jul 14 20:27:04.698148 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:04.698107 2554 patch_prober.go:28] interesting pod/image-registry-b748bcb6f-xm2zd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:04.698316 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:04.698168 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:04.906470 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:04.906430 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dt9w2" event={"ID":"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a","Type":"ContainerStarted","Data":"c3c8cd7748375affb18afcce75d4c9a0747603feef6622198c63225bbc94f2de"} Jul 14 20:27:05.107172 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:05.107138 2554 patch_prober.go:28] interesting pod/image-registry-7c6d88dc5b-djzcx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:05.107335 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:05.107194 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:05.913268 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:05.913225 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dt9w2" event={"ID":"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a","Type":"ContainerStarted","Data":"18339f137687947508d33db711931695146b63c99c53dbfcc9d2b6e32ca06533"} Jul 14 20:27:06.769646 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:06.769608 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" podUID="63d2e910-1c70-4b2c-bd56-af13673156ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 20:27:06.848516 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:06.848482 2554 patch_prober.go:28] interesting pod/image-registry-7c6d88dc5b-djzcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:06.848682 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:06.848536 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:06.919075 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:06.919036 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dt9w2" event={"ID":"b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a","Type":"ContainerStarted","Data":"84631943d9e57c9ef9f1a75f80e739bb4ebb0ae27d51d5d63b377032be4a10cf"} Jul 14 20:27:06.919471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:06.919142 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dt9w2" Jul 14 20:27:06.936417 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:06.936325 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dt9w2" podStartSLOduration=252.209236342 podStartE2EDuration="4m13.936306743s" totalImagesPullingTime="1.727070401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:06.934907104 +0000 UTC m=+289.533547991" watchObservedRunningTime="2026-07-14 20:27:06.936306743 +0000 UTC m=+289.534947634" Jul 14 20:27:09.714157 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:09.714120 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" containerID="cri-o://b91978bd4c63c1e0cc54d5681fe90cc7e24ad39ad106e331f5b562d0e28ec426" gracePeriod=30 Jul 14 20:27:09.931352 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:09.931313 2554 generic.go:356] "Generic (PLEG): container finished" podID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerID="b91978bd4c63c1e0cc54d5681fe90cc7e24ad39ad106e331f5b562d0e28ec426" exitCode=0 Jul 14 20:27:09.931525 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:09.931411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" event={"ID":"160522d9-ef43-413b-b81e-e8a0e83002ba","Type":"ContainerDied","Data":"b91978bd4c63c1e0cc54d5681fe90cc7e24ad39ad106e331f5b562d0e28ec426"} Jul 14 20:27:09.965173 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:09.965116 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:27:10.057120 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057091 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-certificates\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057148 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-installation-pull-secrets\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057175 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160522d9-ef43-413b-b81e-e8a0e83002ba-ca-trust-extracted\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057200 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-trusted-ca\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057226 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057252 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx524\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-kube-api-access-fx524\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057288 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-image-registry-private-configuration\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057328 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057326 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-bound-sa-token\") pod \"160522d9-ef43-413b-b81e-e8a0e83002ba\" (UID: \"160522d9-ef43-413b-b81e-e8a0e83002ba\") " Jul 14 20:27:10.057710 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.057575 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:27:10.058274 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.058197 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:27:10.059816 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.059790 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:27:10.059915 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.059857 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:27:10.059985 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.059969 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-kube-api-access-fx524" (OuterVolumeSpecName: "kube-api-access-fx524") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "kube-api-access-fx524". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:27:10.060109 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.060085 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:27:10.060219 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.060196 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:27:10.066722 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.066697 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160522d9-ef43-413b-b81e-e8a0e83002ba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "160522d9-ef43-413b-b81e-e8a0e83002ba" (UID: "160522d9-ef43-413b-b81e-e8a0e83002ba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:27:10.158378 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158341 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-installation-pull-secrets\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158378 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158368 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/160522d9-ef43-413b-b81e-e8a0e83002ba-ca-trust-extracted\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158378 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158377 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-trusted-ca\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158412 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-tls\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158424 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx524\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-kube-api-access-fx524\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158439 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/160522d9-ef43-413b-b81e-e8a0e83002ba-image-registry-private-configuration\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158449 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/160522d9-ef43-413b-b81e-e8a0e83002ba-bound-sa-token\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.158628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.158457 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/160522d9-ef43-413b-b81e-e8a0e83002ba-registry-certificates\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:27:10.935429 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.935370 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" event={"ID":"160522d9-ef43-413b-b81e-e8a0e83002ba","Type":"ContainerDied","Data":"8f19c0e09571113ed8c5fb215f43e7cedfb84653a85d863558387f330afe6096"} Jul 14 20:27:10.935429 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.935419 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b748bcb6f-xm2zd" Jul 14 20:27:10.935948 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.935467 2554 scope.go:117] "RemoveContainer" containerID="b91978bd4c63c1e0cc54d5681fe90cc7e24ad39ad106e331f5b562d0e28ec426" Jul 14 20:27:10.955808 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.955781 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b748bcb6f-xm2zd"] Jul 14 20:27:10.960888 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:10.960867 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b748bcb6f-xm2zd"] Jul 14 20:27:11.941161 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:11.941127 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" path="/var/lib/kubelet/pods/160522d9-ef43-413b-b81e-e8a0e83002ba/volumes" Jul 14 20:27:15.108374 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:15.108339 2554 patch_prober.go:28] interesting pod/image-registry-7c6d88dc5b-djzcx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:15.108869 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:15.108417 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:16.769919 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.769881 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" podUID="63d2e910-1c70-4b2c-bd56-af13673156ea" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 14 20:27:16.770309 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.769949 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" Jul 14 20:27:16.770445 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.770416 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9c7c53190b5b7a2b6bbcd60f5252872150feeade090c4251194d449a238b2d0a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 14 20:27:16.770489 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.770464 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" podUID="63d2e910-1c70-4b2c-bd56-af13673156ea" containerName="service-proxy" containerID="cri-o://9c7c53190b5b7a2b6bbcd60f5252872150feeade090c4251194d449a238b2d0a" gracePeriod=30 Jul 14 20:27:16.848503 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.848471 2554 patch_prober.go:28] interesting pod/image-registry-7c6d88dc5b-djzcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:16.848650 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.848528 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:16.925041 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.925018 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dt9w2" Jul 14 20:27:16.959503 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.959465 2554 generic.go:356] "Generic (PLEG): container finished" podID="63d2e910-1c70-4b2c-bd56-af13673156ea" containerID="9c7c53190b5b7a2b6bbcd60f5252872150feeade090c4251194d449a238b2d0a" exitCode=2 Jul 14 20:27:16.959503 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.959502 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" event={"ID":"63d2e910-1c70-4b2c-bd56-af13673156ea","Type":"ContainerDied","Data":"9c7c53190b5b7a2b6bbcd60f5252872150feeade090c4251194d449a238b2d0a"} Jul 14 20:27:16.959704 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:16.959550 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f48f846-9qlkk" event={"ID":"63d2e910-1c70-4b2c-bd56-af13673156ea","Type":"ContainerStarted","Data":"1ca1ecd0b8d11b99702d73f803b8dc54c81ac52bc9c8b5d83e4e927f3dbf96fe"} Jul 14 20:27:17.759907 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:17.759875 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:27:17.764181 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:17.764154 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:27:17.765721 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:17.765701 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 20:27:25.107251 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:25.107215 2554 patch_prober.go:28] interesting pod/image-registry-7c6d88dc5b-djzcx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:25.107730 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:25.107266 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:25.107730 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:25.107307 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:27:25.107855 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:25.107826 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"84ed9318ed56a0dd65760fcb9067a6f0023024e9bc25a599e3de21b0da558f3c"} pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" containerMessage="Container registry failed liveness probe, will be restarted" Jul 14 20:27:25.111247 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:25.111217 2554 patch_prober.go:28] interesting pod/image-registry-7c6d88dc5b-djzcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:25.111368 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:25.111264 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:35.111894 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:35.111866 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:27:47.392332 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:47.392283 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9w7t_01589a17-ecf0-4d1a-9293-8e2c10d3104e/serve-healthcheck-canary/0.log" Jul 14 20:27:50.127065 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:50.127027 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" podUID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerName="registry" containerID="cri-o://84ed9318ed56a0dd65760fcb9067a6f0023024e9bc25a599e3de21b0da558f3c" gracePeriod=30 Jul 14 20:27:52.068028 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:52.067992 2554 generic.go:356] "Generic (PLEG): container finished" podID="889f6169-b41f-40e6-87fc-2566fb23e8ed" containerID="84ed9318ed56a0dd65760fcb9067a6f0023024e9bc25a599e3de21b0da558f3c" exitCode=0 Jul 14 20:27:52.068476 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:52.068066 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" event={"ID":"889f6169-b41f-40e6-87fc-2566fb23e8ed","Type":"ContainerDied","Data":"84ed9318ed56a0dd65760fcb9067a6f0023024e9bc25a599e3de21b0da558f3c"} Jul 14 20:27:52.068476 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:52.068110 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" event={"ID":"889f6169-b41f-40e6-87fc-2566fb23e8ed","Type":"ContainerStarted","Data":"c74af5be3d523603211d636d66d56ad20a63dfd029cc81c6b250ad5aa3eade60"} Jul 14 20:27:52.068476 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:27:52.068164 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:28:13.076321 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:28:13.076243 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c6d88dc5b-djzcx" Jul 14 20:29:43.668600 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.668520 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh"] Jul 14 20:29:43.669012 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.668752 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" Jul 14 20:29:43.669012 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.668762 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" Jul 14 20:29:43.669012 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.668819 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="160522d9-ef43-413b-b81e-e8a0e83002ba" containerName="registry" Jul 14 20:29:43.671471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.671453 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.680935 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.680907 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 20:29:43.681044 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.680983 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-trxjr\"" Jul 14 20:29:43.681044 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.680921 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:29:43.701196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.701165 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh"] Jul 14 20:29:43.703149 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.703130 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99dfe21a-2e07-4f1c-83cb-65842244a5ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-smkfh\" (UID: \"99dfe21a-2e07-4f1c-83cb-65842244a5ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.703244 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.703159 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l762t\" (UniqueName: \"kubernetes.io/projected/99dfe21a-2e07-4f1c-83cb-65842244a5ee-kube-api-access-l762t\") pod \"cert-manager-operator-controller-manager-55c444bf86-smkfh\" (UID: \"99dfe21a-2e07-4f1c-83cb-65842244a5ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.804330 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.804282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99dfe21a-2e07-4f1c-83cb-65842244a5ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-smkfh\" (UID: \"99dfe21a-2e07-4f1c-83cb-65842244a5ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.804330 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.804323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l762t\" (UniqueName: \"kubernetes.io/projected/99dfe21a-2e07-4f1c-83cb-65842244a5ee-kube-api-access-l762t\") pod \"cert-manager-operator-controller-manager-55c444bf86-smkfh\" (UID: \"99dfe21a-2e07-4f1c-83cb-65842244a5ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.804682 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.804659 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99dfe21a-2e07-4f1c-83cb-65842244a5ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-smkfh\" (UID: \"99dfe21a-2e07-4f1c-83cb-65842244a5ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.817664 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.817643 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l762t\" (UniqueName: \"kubernetes.io/projected/99dfe21a-2e07-4f1c-83cb-65842244a5ee-kube-api-access-l762t\") pod \"cert-manager-operator-controller-manager-55c444bf86-smkfh\" (UID: \"99dfe21a-2e07-4f1c-83cb-65842244a5ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:43.979595 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:43.979509 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" Jul 14 20:29:44.136525 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:44.136448 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh"] Jul 14 20:29:44.141739 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:29:44.141708 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99dfe21a_2e07_4f1c_83cb_65842244a5ee.slice/crio-b7b2e5b444f0ca0ee92edbb9c38427e71b7d2016c5356815d3662fd0964f3033 WatchSource:0}: Error finding container b7b2e5b444f0ca0ee92edbb9c38427e71b7d2016c5356815d3662fd0964f3033: Status 404 returned error can't find the container with id b7b2e5b444f0ca0ee92edbb9c38427e71b7d2016c5356815d3662fd0964f3033 Jul 14 20:29:44.144376 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:44.144360 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:29:44.428043 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:44.428012 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" event={"ID":"99dfe21a-2e07-4f1c-83cb-65842244a5ee","Type":"ContainerStarted","Data":"b7b2e5b444f0ca0ee92edbb9c38427e71b7d2016c5356815d3662fd0964f3033"} Jul 14 20:29:47.442117 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:47.442077 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" event={"ID":"99dfe21a-2e07-4f1c-83cb-65842244a5ee","Type":"ContainerStarted","Data":"8884cacf5b709988a2ab5b8fbc35a6fd34db5c52f645f2cf3dd2912c48351e31"} Jul 14 20:29:47.471063 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:47.471011 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-smkfh" podStartSLOduration=1.3857466600000001 podStartE2EDuration="4.470997544s" totalImagesPullingTime="3.085250884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:47.468728456 +0000 UTC m=+450.067369342" watchObservedRunningTime="2026-07-14 20:29:47.470997544 +0000 UTC m=+450.069638432" Jul 14 20:29:48.798184 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.798145 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xlvdf"] Jul 14 20:29:48.801157 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.801140 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:48.805325 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.805303 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 20:29:48.805325 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.805320 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 20:29:48.824115 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.824088 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xlvdf"] Jul 14 20:29:48.845345 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.845314 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a228e806-9194-4162-a8b7-838ae3754b9b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xlvdf\" (UID: \"a228e806-9194-4162-a8b7-838ae3754b9b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:48.845495 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.845347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phnc5\" (UniqueName: \"kubernetes.io/projected/a228e806-9194-4162-a8b7-838ae3754b9b-kube-api-access-phnc5\") pod \"cert-manager-webhook-6486ffd997-xlvdf\" (UID: \"a228e806-9194-4162-a8b7-838ae3754b9b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:48.946522 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.946482 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a228e806-9194-4162-a8b7-838ae3754b9b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xlvdf\" (UID: \"a228e806-9194-4162-a8b7-838ae3754b9b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:48.946522 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.946527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phnc5\" (UniqueName: \"kubernetes.io/projected/a228e806-9194-4162-a8b7-838ae3754b9b-kube-api-access-phnc5\") pod \"cert-manager-webhook-6486ffd997-xlvdf\" (UID: \"a228e806-9194-4162-a8b7-838ae3754b9b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:48.977594 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.977565 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phnc5\" (UniqueName: \"kubernetes.io/projected/a228e806-9194-4162-a8b7-838ae3754b9b-kube-api-access-phnc5\") pod \"cert-manager-webhook-6486ffd997-xlvdf\" (UID: \"a228e806-9194-4162-a8b7-838ae3754b9b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:48.977748 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:48.977663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a228e806-9194-4162-a8b7-838ae3754b9b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xlvdf\" (UID: \"a228e806-9194-4162-a8b7-838ae3754b9b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:49.109771 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:49.109732 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:49.254587 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:49.254553 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xlvdf"] Jul 14 20:29:49.258330 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:29:49.258298 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda228e806_9194_4162_a8b7_838ae3754b9b.slice/crio-693015683a75235c2954b7bc25b7e22309918e83c4e28b06dcafeab533d5d0b4 WatchSource:0}: Error finding container 693015683a75235c2954b7bc25b7e22309918e83c4e28b06dcafeab533d5d0b4: Status 404 returned error can't find the container with id 693015683a75235c2954b7bc25b7e22309918e83c4e28b06dcafeab533d5d0b4 Jul 14 20:29:49.449616 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:49.449533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" event={"ID":"a228e806-9194-4162-a8b7-838ae3754b9b","Type":"ContainerStarted","Data":"693015683a75235c2954b7bc25b7e22309918e83c4e28b06dcafeab533d5d0b4"} Jul 14 20:29:53.464563 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:53.464532 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" event={"ID":"a228e806-9194-4162-a8b7-838ae3754b9b","Type":"ContainerStarted","Data":"4ec3e72b33446a397ae5d74b57c6229576e4eb12779423a6e7c5a738c12d6ac3"} Jul 14 20:29:53.464953 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:53.464675 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:29:53.486524 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:53.486476 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" podStartSLOduration=2.252924828 podStartE2EDuration="5.486462343s" totalImagesPullingTime="3.233537515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:53.485944052 +0000 UTC m=+456.084584930" watchObservedRunningTime="2026-07-14 20:29:53.486462343 +0000 UTC m=+456.085103229" Jul 14 20:29:59.470378 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:29:59.470346 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xlvdf" Jul 14 20:30:00.845842 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.845806 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4"] Jul 14 20:30:00.849081 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.849065 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:00.853999 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.853978 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:30:00.854134 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.853983 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h887k\"" Jul 14 20:30:00.854534 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.854517 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 20:30:00.874931 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.874909 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4"] Jul 14 20:30:00.936551 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.936517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhwl\" (UniqueName: \"kubernetes.io/projected/2a58af80-d4e0-4bc5-9311-393b12428fd1-kube-api-access-5mhwl\") pod \"openshift-lws-operator-fd8ccff4c-82kh4\" (UID: \"2a58af80-d4e0-4bc5-9311-393b12428fd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:00.936703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:00.936566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a58af80-d4e0-4bc5-9311-393b12428fd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-82kh4\" (UID: \"2a58af80-d4e0-4bc5-9311-393b12428fd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:01.037926 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.037889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhwl\" (UniqueName: \"kubernetes.io/projected/2a58af80-d4e0-4bc5-9311-393b12428fd1-kube-api-access-5mhwl\") pod \"openshift-lws-operator-fd8ccff4c-82kh4\" (UID: \"2a58af80-d4e0-4bc5-9311-393b12428fd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:01.038120 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.037966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a58af80-d4e0-4bc5-9311-393b12428fd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-82kh4\" (UID: \"2a58af80-d4e0-4bc5-9311-393b12428fd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:01.038373 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.038353 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a58af80-d4e0-4bc5-9311-393b12428fd1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-82kh4\" (UID: \"2a58af80-d4e0-4bc5-9311-393b12428fd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:01.059333 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.059302 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhwl\" (UniqueName: \"kubernetes.io/projected/2a58af80-d4e0-4bc5-9311-393b12428fd1-kube-api-access-5mhwl\") pod \"openshift-lws-operator-fd8ccff4c-82kh4\" (UID: \"2a58af80-d4e0-4bc5-9311-393b12428fd1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:01.157542 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.157464 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" Jul 14 20:30:01.311612 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.311554 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4"] Jul 14 20:30:01.314122 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:01.314091 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a58af80_d4e0_4bc5_9311_393b12428fd1.slice/crio-e2b4054f372d08e9fbd88a60e3b930e099d63acc0a1ac5c6c27e80e88c4cbd8e WatchSource:0}: Error finding container e2b4054f372d08e9fbd88a60e3b930e099d63acc0a1ac5c6c27e80e88c4cbd8e: Status 404 returned error can't find the container with id e2b4054f372d08e9fbd88a60e3b930e099d63acc0a1ac5c6c27e80e88c4cbd8e Jul 14 20:30:01.494528 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:01.494443 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" event={"ID":"2a58af80-d4e0-4bc5-9311-393b12428fd1","Type":"ContainerStarted","Data":"e2b4054f372d08e9fbd88a60e3b930e099d63acc0a1ac5c6c27e80e88c4cbd8e"} Jul 14 20:30:05.511786 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:05.511703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" event={"ID":"2a58af80-d4e0-4bc5-9311-393b12428fd1","Type":"ContainerStarted","Data":"27f3294c982ee136995857627085ea43bf4e12f6c5fc0e5b7e8442ddca3f3164"} Jul 14 20:30:05.552003 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:05.551949 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-82kh4" podStartSLOduration=1.6641416119999999 podStartE2EDuration="5.551928845s" totalImagesPullingTime="3.887787233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:05.549152406 +0000 UTC m=+468.147793292" watchObservedRunningTime="2026-07-14 20:30:05.551928845 +0000 UTC m=+468.150569733" Jul 14 20:30:21.655525 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.655490 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg"] Jul 14 20:30:21.714852 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.714813 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg"] Jul 14 20:30:21.715039 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.714966 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.717624 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.717597 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 20:30:21.717821 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.717679 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ptlqj\"" Jul 14 20:30:21.717982 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.717966 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 20:30:21.718032 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.718008 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 20:30:21.729620 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.729599 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 20:30:21.788603 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.788564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtdd\" (UniqueName: \"kubernetes.io/projected/c1f47b6b-cdc5-4985-98c8-4f31d822e179-kube-api-access-2dtdd\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.788603 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.788601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1f47b6b-cdc5-4985-98c8-4f31d822e179-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.788815 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.788626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1f47b6b-cdc5-4985-98c8-4f31d822e179-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.788815 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.788733 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1f47b6b-cdc5-4985-98c8-4f31d822e179-tmp\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.788815 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.788795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1f47b6b-cdc5-4985-98c8-4f31d822e179-manifests\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.890054 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.890017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1f47b6b-cdc5-4985-98c8-4f31d822e179-manifests\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.890054 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.890059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtdd\" (UniqueName: \"kubernetes.io/projected/c1f47b6b-cdc5-4985-98c8-4f31d822e179-kube-api-access-2dtdd\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.890259 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.890087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1f47b6b-cdc5-4985-98c8-4f31d822e179-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.890259 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.890117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1f47b6b-cdc5-4985-98c8-4f31d822e179-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.890259 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.890170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1f47b6b-cdc5-4985-98c8-4f31d822e179-tmp\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.890545 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.890521 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c1f47b6b-cdc5-4985-98c8-4f31d822e179-manifests\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.892667 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.892637 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1f47b6b-cdc5-4985-98c8-4f31d822e179-tmp\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.892798 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.892779 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c1f47b6b-cdc5-4985-98c8-4f31d822e179-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.892857 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.892792 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c1f47b6b-cdc5-4985-98c8-4f31d822e179-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:21.911173 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:21.911107 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtdd\" (UniqueName: \"kubernetes.io/projected/c1f47b6b-cdc5-4985-98c8-4f31d822e179-kube-api-access-2dtdd\") pod \"opendatahub-operator-controller-manager-79d49c7b87-4xhgg\" (UID: \"c1f47b6b-cdc5-4985-98c8-4f31d822e179\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:22.024867 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:22.024827 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:22.190514 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:22.190493 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg"] Jul 14 20:30:22.192988 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:22.192962 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f47b6b_cdc5_4985_98c8_4f31d822e179.slice/crio-38f5d5dd170903bb78e7f178efaaf0a9a20f7cc536f07564be399d600696089f WatchSource:0}: Error finding container 38f5d5dd170903bb78e7f178efaaf0a9a20f7cc536f07564be399d600696089f: Status 404 returned error can't find the container with id 38f5d5dd170903bb78e7f178efaaf0a9a20f7cc536f07564be399d600696089f Jul 14 20:30:22.570046 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:22.570005 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" event={"ID":"c1f47b6b-cdc5-4985-98c8-4f31d822e179","Type":"ContainerStarted","Data":"38f5d5dd170903bb78e7f178efaaf0a9a20f7cc536f07564be399d600696089f"} Jul 14 20:30:26.586588 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:26.586551 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" event={"ID":"c1f47b6b-cdc5-4985-98c8-4f31d822e179","Type":"ContainerStarted","Data":"cb729997107ccf62bb9f72357da92f825845dda44e3d3ef1e911d9fb19f24eb2"} Jul 14 20:30:27.592041 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:27.592008 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1f47b6b-cdc5-4985-98c8-4f31d822e179" containerID="cb729997107ccf62bb9f72357da92f825845dda44e3d3ef1e911d9fb19f24eb2" exitCode=0 Jul 14 20:30:27.592441 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:27.592094 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" event={"ID":"c1f47b6b-cdc5-4985-98c8-4f31d822e179","Type":"ContainerDied","Data":"cb729997107ccf62bb9f72357da92f825845dda44e3d3ef1e911d9fb19f24eb2"} Jul 14 20:30:28.597489 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:28.597454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" event={"ID":"c1f47b6b-cdc5-4985-98c8-4f31d822e179","Type":"ContainerStarted","Data":"4f6b5913d0563df04d300e80ee1a08afbdcd40a4dcc437a0bd415f18d6520bb0"} Jul 14 20:30:28.597960 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:28.597596 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:28.657210 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:28.657149 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" podStartSLOduration=2.373428325 podStartE2EDuration="7.657124268s" totalImagesPullingTime="4.203575355s" totalInitContainerRuntime="1.080120588s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:28.655075237 +0000 UTC m=+491.253716119" watchObservedRunningTime="2026-07-14 20:30:28.657124268 +0000 UTC m=+491.255765156" Jul 14 20:30:39.603488 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:39.603453 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-4xhgg" Jul 14 20:30:45.176054 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.176021 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z"] Jul 14 20:30:45.184764 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.184729 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.186849 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.186824 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 20:30:45.187428 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.187406 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 20:30:45.187539 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.187409 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 20:30:45.187539 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.187418 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nc9tl\"" Jul 14 20:30:45.187690 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.187434 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 20:30:45.196067 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.196040 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z"] Jul 14 20:30:45.367704 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.367667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8x4r\" (UniqueName: \"kubernetes.io/projected/e31e9048-74c8-4974-83b8-7c80927cbccd-kube-api-access-z8x4r\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.367874 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.367727 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31e9048-74c8-4974-83b8-7c80927cbccd-tmp\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.367874 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.367800 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31e9048-74c8-4974-83b8-7c80927cbccd-tls-certs\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.391062 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.391027 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-v54vn"] Jul 14 20:30:45.394030 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.394007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:45.396573 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.396545 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 20:30:45.396773 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.396742 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cvbsh\"" Jul 14 20:30:45.408519 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.408496 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-v54vn"] Jul 14 20:30:45.468598 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.468522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31e9048-74c8-4974-83b8-7c80927cbccd-tmp\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.468598 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.468565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31e9048-74c8-4974-83b8-7c80927cbccd-tls-certs\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.468802 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.468610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8x4r\" (UniqueName: \"kubernetes.io/projected/e31e9048-74c8-4974-83b8-7c80927cbccd-kube-api-access-z8x4r\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.471004 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.470972 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31e9048-74c8-4974-83b8-7c80927cbccd-tmp\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.471118 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.471086 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31e9048-74c8-4974-83b8-7c80927cbccd-tls-certs\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.478072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.478044 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8x4r\" (UniqueName: \"kubernetes.io/projected/e31e9048-74c8-4974-83b8-7c80927cbccd-kube-api-access-z8x4r\") pod \"kube-auth-proxy-75fb49cfc4-2rl8z\" (UID: \"e31e9048-74c8-4974-83b8-7c80927cbccd\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.495708 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.495680 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" Jul 14 20:30:45.569005 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.568977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf46b6cf-c65c-4373-af10-34325c36cd92-cert\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:45.569187 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.569044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmpr\" (UniqueName: \"kubernetes.io/projected/cf46b6cf-c65c-4373-af10-34325c36cd92-kube-api-access-dtmpr\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:45.626752 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.626573 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z"] Jul 14 20:30:45.629428 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:45.629398 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31e9048_74c8_4974_83b8_7c80927cbccd.slice/crio-4344bcd8de29603a992876b42220098953720ba5e1c2f0ec1371326c48a9a146 WatchSource:0}: Error finding container 4344bcd8de29603a992876b42220098953720ba5e1c2f0ec1371326c48a9a146: Status 404 returned error can't find the container with id 4344bcd8de29603a992876b42220098953720ba5e1c2f0ec1371326c48a9a146 Jul 14 20:30:45.666648 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.666612 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" event={"ID":"e31e9048-74c8-4974-83b8-7c80927cbccd","Type":"ContainerStarted","Data":"4344bcd8de29603a992876b42220098953720ba5e1c2f0ec1371326c48a9a146"} Jul 14 20:30:45.670109 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.670078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf46b6cf-c65c-4373-af10-34325c36cd92-cert\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:45.670249 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.670158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmpr\" (UniqueName: \"kubernetes.io/projected/cf46b6cf-c65c-4373-af10-34325c36cd92-kube-api-access-dtmpr\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:45.670249 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:30:45.670231 2554 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 20:30:45.670373 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:30:45.670300 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf46b6cf-c65c-4373-af10-34325c36cd92-cert podName:cf46b6cf-c65c-4373-af10-34325c36cd92 nodeName:}" failed. No retries permitted until 2026-07-14 20:30:46.17028022 +0000 UTC m=+508.768921085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf46b6cf-c65c-4373-af10-34325c36cd92-cert") pod "odh-model-controller-7998c67dc4-v54vn" (UID: "cf46b6cf-c65c-4373-af10-34325c36cd92") : secret "odh-model-controller-webhook-cert" not found Jul 14 20:30:45.679051 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:45.679024 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmpr\" (UniqueName: \"kubernetes.io/projected/cf46b6cf-c65c-4373-af10-34325c36cd92-kube-api-access-dtmpr\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:46.102230 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.102197 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zz56b"] Jul 14 20:30:46.106395 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.106371 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.108577 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.108553 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 20:30:46.120135 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.120107 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zz56b"] Jul 14 20:30:46.175100 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.175068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.175256 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.175105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngjr8\" (UniqueName: \"kubernetes.io/projected/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-kube-api-access-ngjr8\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.175256 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.175170 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf46b6cf-c65c-4373-af10-34325c36cd92-cert\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:46.177674 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.177658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf46b6cf-c65c-4373-af10-34325c36cd92-cert\") pod \"odh-model-controller-7998c67dc4-v54vn\" (UID: \"cf46b6cf-c65c-4373-af10-34325c36cd92\") " pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:46.275690 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.275656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.275690 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.275695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngjr8\" (UniqueName: \"kubernetes.io/projected/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-kube-api-access-ngjr8\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.275890 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:30:46.275797 2554 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 14 20:30:46.275890 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:30:46.275856 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-tls-certs podName:a76b7a6b-7fba-40f0-ac84-2cf36713d68f nodeName:}" failed. No retries permitted until 2026-07-14 20:30:46.775841841 +0000 UTC m=+509.374482707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-tls-certs") pod "model-serving-api-54d89bd5fc-zz56b" (UID: "a76b7a6b-7fba-40f0-ac84-2cf36713d68f") : secret "model-serving-api-tls" not found Jul 14 20:30:46.290365 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.290338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngjr8\" (UniqueName: \"kubernetes.io/projected/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-kube-api-access-ngjr8\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.304200 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.304178 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:46.438098 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.438070 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-v54vn"] Jul 14 20:30:46.441518 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:46.441492 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf46b6cf_c65c_4373_af10_34325c36cd92.slice/crio-91cb53c87cb42584359f7895c8a79452e549303016a7cfe56b4d816d2b47dde7 WatchSource:0}: Error finding container 91cb53c87cb42584359f7895c8a79452e549303016a7cfe56b4d816d2b47dde7: Status 404 returned error can't find the container with id 91cb53c87cb42584359f7895c8a79452e549303016a7cfe56b4d816d2b47dde7 Jul 14 20:30:46.623422 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.623317 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7"] Jul 14 20:30:46.627975 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.627952 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.630178 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.630153 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 20:30:46.630178 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.630163 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 20:30:46.630359 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.630191 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 20:30:46.630359 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.630225 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v7vb9\"" Jul 14 20:30:46.630552 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.630539 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 20:30:46.642505 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.642477 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7"] Jul 14 20:30:46.671979 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.671945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" event={"ID":"cf46b6cf-c65c-4373-af10-34325c36cd92","Type":"ContainerStarted","Data":"91cb53c87cb42584359f7895c8a79452e549303016a7cfe56b4d816d2b47dde7"} Jul 14 20:30:46.678449 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678420 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-token\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.678449 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.678601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9st\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-kube-api-access-xw9st\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.678601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.678601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54976b24-98e8-41a7-ba6d-d4e84defce18-local-certs\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.678601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678587 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.678723 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.678638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-cacerts\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.778979 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.778946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-cacerts\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.778979 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.778986 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-token\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.779231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.779231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9st\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-kube-api-access-xw9st\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.779231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.779231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54976b24-98e8-41a7-ba6d-d4e84defce18-local-certs\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.779231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.779231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.779874 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.779829 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.781720 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.781680 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54976b24-98e8-41a7-ba6d-d4e84defce18-local-certs\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.781862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.781837 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b7a6b-7fba-40f0-ac84-2cf36713d68f-tls-certs\") pod \"model-serving-api-54d89bd5fc-zz56b\" (UID: \"a76b7a6b-7fba-40f0-ac84-2cf36713d68f\") " pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:46.781862 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.781842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.782072 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.782055 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-cacerts\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.782273 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.782256 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.787080 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.787053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9st\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-kube-api-access-xw9st\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.787282 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.787254 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-token\") pod \"istiod-openshift-gateway-7574459656-xmfc7\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:46.940270 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:46.940175 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:47.018705 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:47.018668 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:47.104202 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:47.103840 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7"] Jul 14 20:30:47.108745 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:47.108707 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54976b24_98e8_41a7_ba6d_d4e84defce18.slice/crio-fdddb24625a8f050292bb0c758872f4ca99645ce23a903d5e563b9c7ff140020 WatchSource:0}: Error finding container fdddb24625a8f050292bb0c758872f4ca99645ce23a903d5e563b9c7ff140020: Status 404 returned error can't find the container with id fdddb24625a8f050292bb0c758872f4ca99645ce23a903d5e563b9c7ff140020 Jul 14 20:30:47.207893 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:47.207630 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zz56b"] Jul 14 20:30:47.212165 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:47.212120 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76b7a6b_7fba_40f0_ac84_2cf36713d68f.slice/crio-789a1e5fc62ecd4c408a2c29281898faad944ae6cfb8869b052aeefb7b0eb057 WatchSource:0}: Error finding container 789a1e5fc62ecd4c408a2c29281898faad944ae6cfb8869b052aeefb7b0eb057: Status 404 returned error can't find the container with id 789a1e5fc62ecd4c408a2c29281898faad944ae6cfb8869b052aeefb7b0eb057 Jul 14 20:30:47.681662 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:47.681616 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" event={"ID":"a76b7a6b-7fba-40f0-ac84-2cf36713d68f","Type":"ContainerStarted","Data":"789a1e5fc62ecd4c408a2c29281898faad944ae6cfb8869b052aeefb7b0eb057"} Jul 14 20:30:47.684493 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:47.684461 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" event={"ID":"54976b24-98e8-41a7-ba6d-d4e84defce18","Type":"ContainerStarted","Data":"fdddb24625a8f050292bb0c758872f4ca99645ce23a903d5e563b9c7ff140020"} Jul 14 20:30:51.911908 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:51.911853 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 20:30:51.912412 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:51.911960 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 14 20:30:52.708866 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.708828 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" event={"ID":"cf46b6cf-c65c-4373-af10-34325c36cd92","Type":"ContainerStarted","Data":"5be2b01ceedbafe6c2b00c741f88350dbe1564b8515f86c803218271b14b627f"} Jul 14 20:30:52.709067 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.708955 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:30:52.710619 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.710592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" event={"ID":"54976b24-98e8-41a7-ba6d-d4e84defce18","Type":"ContainerStarted","Data":"01904b71c7a5287895a382ba541618d548eb8f75ceb5106f642e7365d4a0d7f3"} Jul 14 20:30:52.710755 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.710712 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:52.712399 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.712303 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" event={"ID":"e31e9048-74c8-4974-83b8-7c80927cbccd","Type":"ContainerStarted","Data":"b916db09157de79cc819eb8fa6973e034678c46b2e82f84d00858b43c2c60073"} Jul 14 20:30:52.712547 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.712528 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-xmfc7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 20:30:52.712619 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.712573 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" podUID="54976b24-98e8-41a7-ba6d-d4e84defce18" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:30:52.713914 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.713890 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" event={"ID":"a76b7a6b-7fba-40f0-ac84-2cf36713d68f","Type":"ContainerStarted","Data":"49555ef10b1a0f1134fc3ea14f145c965a7a206ee6d408cd43f25f5b366035cc"} Jul 14 20:30:52.714038 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.714025 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:30:52.734765 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.734716 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" podStartSLOduration=2.259557988 podStartE2EDuration="7.734701515s" totalImagesPullingTime="5.475143527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:52.73252569 +0000 UTC m=+515.331166576" watchObservedRunningTime="2026-07-14 20:30:52.734701515 +0000 UTC m=+515.333342380" Jul 14 20:30:52.753276 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.753218 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" podStartSLOduration=2.054728198 podStartE2EDuration="6.753200745s" totalImagesPullingTime="4.698472547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:52.752699136 +0000 UTC m=+515.351340023" watchObservedRunningTime="2026-07-14 20:30:52.753200745 +0000 UTC m=+515.351841634" Jul 14 20:30:52.784035 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.783972 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-2rl8z" podStartSLOduration=1.504389137 podStartE2EDuration="7.783949874s" totalImagesPullingTime="6.279560737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:52.781834211 +0000 UTC m=+515.380475097" watchObservedRunningTime="2026-07-14 20:30:52.783949874 +0000 UTC m=+515.382590761" Jul 14 20:30:52.814340 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:52.814286 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" podStartSLOduration=2.014358815 podStartE2EDuration="6.814267807s" totalImagesPullingTime="4.799908992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:52.812780697 +0000 UTC m=+515.411421585" watchObservedRunningTime="2026-07-14 20:30:52.814267807 +0000 UTC m=+515.412908693" Jul 14 20:30:53.719785 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:53.719756 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:30:57.289796 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.289762 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g48sm"] Jul 14 20:30:57.295814 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.295788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.297939 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.297920 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 20:30:57.297939 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.297930 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rs9tp\"" Jul 14 20:30:57.301480 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.301452 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg"] Jul 14 20:30:57.304494 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.304458 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.307080 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.307055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 20:30:57.307219 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.307198 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g48sm"] Jul 14 20:30:57.307419 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.307407 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rqdqr\"" Jul 14 20:30:57.314816 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.314791 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg"] Jul 14 20:30:57.374007 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.373973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b368309-744d-4500-a717-e9dbb2a2c168-cert\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.374178 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.374022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076f86d7-b9b3-42f5-83f2-84d86fe83f81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9rtxg\" (UID: \"076f86d7-b9b3-42f5-83f2-84d86fe83f81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.374178 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.374051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcv5w\" (UniqueName: \"kubernetes.io/projected/3b368309-744d-4500-a717-e9dbb2a2c168-kube-api-access-jcv5w\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.374178 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.374116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7c64\" (UniqueName: \"kubernetes.io/projected/076f86d7-b9b3-42f5-83f2-84d86fe83f81-kube-api-access-q7c64\") pod \"llmisvc-controller-manager-777c6bd7d5-9rtxg\" (UID: \"076f86d7-b9b3-42f5-83f2-84d86fe83f81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.475471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.475433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7c64\" (UniqueName: \"kubernetes.io/projected/076f86d7-b9b3-42f5-83f2-84d86fe83f81-kube-api-access-q7c64\") pod \"llmisvc-controller-manager-777c6bd7d5-9rtxg\" (UID: \"076f86d7-b9b3-42f5-83f2-84d86fe83f81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.475662 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.475508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b368309-744d-4500-a717-e9dbb2a2c168-cert\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.475662 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.475567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076f86d7-b9b3-42f5-83f2-84d86fe83f81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9rtxg\" (UID: \"076f86d7-b9b3-42f5-83f2-84d86fe83f81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.475662 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.475594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcv5w\" (UniqueName: \"kubernetes.io/projected/3b368309-744d-4500-a717-e9dbb2a2c168-kube-api-access-jcv5w\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.475662 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:30:57.475651 2554 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 20:30:57.475866 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:30:57.475711 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b368309-744d-4500-a717-e9dbb2a2c168-cert podName:3b368309-744d-4500-a717-e9dbb2a2c168 nodeName:}" failed. No retries permitted until 2026-07-14 20:30:57.975693812 +0000 UTC m=+520.574334678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b368309-744d-4500-a717-e9dbb2a2c168-cert") pod "kserve-controller-manager-d6f4b65b8-g48sm" (UID: "3b368309-744d-4500-a717-e9dbb2a2c168") : secret "kserve-webhook-server-cert" not found Jul 14 20:30:57.478176 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.478149 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/076f86d7-b9b3-42f5-83f2-84d86fe83f81-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9rtxg\" (UID: \"076f86d7-b9b3-42f5-83f2-84d86fe83f81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.490637 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.490608 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7c64\" (UniqueName: \"kubernetes.io/projected/076f86d7-b9b3-42f5-83f2-84d86fe83f81-kube-api-access-q7c64\") pod \"llmisvc-controller-manager-777c6bd7d5-9rtxg\" (UID: \"076f86d7-b9b3-42f5-83f2-84d86fe83f81\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.491941 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.491917 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcv5w\" (UniqueName: \"kubernetes.io/projected/3b368309-744d-4500-a717-e9dbb2a2c168-kube-api-access-jcv5w\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.615084 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.615045 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:30:57.764357 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.764325 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg"] Jul 14 20:30:57.768558 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:57.768530 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod076f86d7_b9b3_42f5_83f2_84d86fe83f81.slice/crio-5fa39ea1936865f3bc7e834af49c9333d90f0b3439cd998772eca3fe47cd1f1a WatchSource:0}: Error finding container 5fa39ea1936865f3bc7e834af49c9333d90f0b3439cd998772eca3fe47cd1f1a: Status 404 returned error can't find the container with id 5fa39ea1936865f3bc7e834af49c9333d90f0b3439cd998772eca3fe47cd1f1a Jul 14 20:30:57.981560 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.981487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b368309-744d-4500-a717-e9dbb2a2c168-cert\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:57.983939 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:57.983910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b368309-744d-4500-a717-e9dbb2a2c168-cert\") pod \"kserve-controller-manager-d6f4b65b8-g48sm\" (UID: \"3b368309-744d-4500-a717-e9dbb2a2c168\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:58.206035 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:58.205996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:30:58.374822 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:58.374787 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g48sm"] Jul 14 20:30:58.378283 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:30:58.378253 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b368309_744d_4500_a717_e9dbb2a2c168.slice/crio-8c2b3be57c89002c9927494b9009065aba77652f2d91097007313113b58665c1 WatchSource:0}: Error finding container 8c2b3be57c89002c9927494b9009065aba77652f2d91097007313113b58665c1: Status 404 returned error can't find the container with id 8c2b3be57c89002c9927494b9009065aba77652f2d91097007313113b58665c1 Jul 14 20:30:58.745348 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:58.745310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" event={"ID":"076f86d7-b9b3-42f5-83f2-84d86fe83f81","Type":"ContainerStarted","Data":"5fa39ea1936865f3bc7e834af49c9333d90f0b3439cd998772eca3fe47cd1f1a"} Jul 14 20:30:58.746436 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:30:58.746411 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" event={"ID":"3b368309-744d-4500-a717-e9dbb2a2c168","Type":"ContainerStarted","Data":"8c2b3be57c89002c9927494b9009065aba77652f2d91097007313113b58665c1"} Jul 14 20:31:00.780899 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:00.780861 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7"] Jul 14 20:31:00.781254 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:00.781145 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" podUID="54976b24-98e8-41a7-ba6d-d4e84defce18" containerName="discovery" containerID="cri-o://01904b71c7a5287895a382ba541618d548eb8f75ceb5106f642e7365d4a0d7f3" gracePeriod=30 Jul 14 20:31:01.764779 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:01.764701 2554 generic.go:356] "Generic (PLEG): container finished" podID="54976b24-98e8-41a7-ba6d-d4e84defce18" containerID="01904b71c7a5287895a382ba541618d548eb8f75ceb5106f642e7365d4a0d7f3" exitCode=0 Jul 14 20:31:01.764947 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:01.764786 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" event={"ID":"54976b24-98e8-41a7-ba6d-d4e84defce18","Type":"ContainerDied","Data":"01904b71c7a5287895a382ba541618d548eb8f75ceb5106f642e7365d4a0d7f3"} Jul 14 20:31:02.031171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.031152 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:31:02.114766 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114744 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw9st\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-kube-api-access-xw9st\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.114857 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114808 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-kubeconfig\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.114857 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114828 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-ca-configmap\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.114958 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114875 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-token\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.114958 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114895 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-cacerts\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.114958 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114936 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54976b24-98e8-41a7-ba6d-d4e84defce18-local-certs\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.115108 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.114975 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-dns-cert\") pod \"54976b24-98e8-41a7-ba6d-d4e84defce18\" (UID: \"54976b24-98e8-41a7-ba6d-d4e84defce18\") " Jul 14 20:31:02.115235 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.115172 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:31:02.117736 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.117698 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:31:02.118299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.118220 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-token" (OuterVolumeSpecName: "istio-token") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:31:02.118299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.118233 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:31:02.118299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.118269 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-kube-api-access-xw9st" (OuterVolumeSpecName: "kube-api-access-xw9st") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "kube-api-access-xw9st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:31:02.118299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.118268 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-cacerts" (OuterVolumeSpecName: "cacerts") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:31:02.118730 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.118711 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54976b24-98e8-41a7-ba6d-d4e84defce18-local-certs" (OuterVolumeSpecName: "local-certs") pod "54976b24-98e8-41a7-ba6d-d4e84defce18" (UID: "54976b24-98e8-41a7-ba6d-d4e84defce18"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:31:02.216438 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216406 2554 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/54976b24-98e8-41a7-ba6d-d4e84defce18-local-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.216438 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216440 2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-dns-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.216640 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216459 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw9st\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-kube-api-access-xw9st\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.216640 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216477 2554 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-kubeconfig\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.216640 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216492 2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-csr-ca-configmap\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.216640 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216504 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54976b24-98e8-41a7-ba6d-d4e84defce18-istio-token\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.216640 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.216519 2554 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/54976b24-98e8-41a7-ba6d-d4e84defce18-cacerts\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:02.770869 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.770839 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" Jul 14 20:31:02.771073 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.770877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7" event={"ID":"54976b24-98e8-41a7-ba6d-d4e84defce18","Type":"ContainerDied","Data":"fdddb24625a8f050292bb0c758872f4ca99645ce23a903d5e563b9c7ff140020"} Jul 14 20:31:02.771073 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.770954 2554 scope.go:117] "RemoveContainer" containerID="01904b71c7a5287895a382ba541618d548eb8f75ceb5106f642e7365d4a0d7f3" Jul 14 20:31:02.778737 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.775879 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" event={"ID":"076f86d7-b9b3-42f5-83f2-84d86fe83f81","Type":"ContainerStarted","Data":"98d4131abbe7869d4606545f005ac7fb00abb3924cf9dd10913678a152226f82"} Jul 14 20:31:02.778737 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.776598 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:31:02.778737 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.778449 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" event={"ID":"3b368309-744d-4500-a717-e9dbb2a2c168","Type":"ContainerStarted","Data":"60ddfc0e632eea5e5daed0e8739554fc06a0ebf8dc347ab89c179eefd0a54b7b"} Jul 14 20:31:02.778988 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.778853 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:31:02.797294 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.797252 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" podStartSLOduration=1.490794543 podStartE2EDuration="5.797238776s" totalImagesPullingTime="4.306444233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:02.796327922 +0000 UTC m=+525.394968808" watchObservedRunningTime="2026-07-14 20:31:02.797238776 +0000 UTC m=+525.395879663" Jul 14 20:31:02.834049 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.833980 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" podStartSLOduration=2.183137524 podStartE2EDuration="5.833961936s" totalImagesPullingTime="3.650824412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:02.815986353 +0000 UTC m=+525.414627237" watchObservedRunningTime="2026-07-14 20:31:02.833961936 +0000 UTC m=+525.432602823" Jul 14 20:31:02.834938 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.834919 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7"] Jul 14 20:31:02.841024 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:02.840999 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xmfc7"] Jul 14 20:31:03.721314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:03.721285 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-v54vn" Jul 14 20:31:03.723342 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:03.723321 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zz56b" Jul 14 20:31:03.942654 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:03.942621 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54976b24-98e8-41a7-ba6d-d4e84defce18" path="/var/lib/kubelet/pods/54976b24-98e8-41a7-ba6d-d4e84defce18/volumes" Jul 14 20:31:33.785709 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:33.785679 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9rtxg" Jul 14 20:31:33.788707 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:33.788677 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g48sm" Jul 14 20:31:43.501040 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.501002 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhm86"] Jul 14 20:31:43.501480 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.501310 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54976b24-98e8-41a7-ba6d-d4e84defce18" containerName="discovery" Jul 14 20:31:43.501480 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.501321 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="54976b24-98e8-41a7-ba6d-d4e84defce18" containerName="discovery" Jul 14 20:31:43.501480 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.501367 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="54976b24-98e8-41a7-ba6d-d4e84defce18" containerName="discovery" Jul 14 20:31:43.503179 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.503156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:43.505616 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.505594 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 20:31:43.506077 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.506057 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wm9sx\"" Jul 14 20:31:43.506203 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.506091 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 20:31:43.514430 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.514373 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhm86"] Jul 14 20:31:43.539235 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.539194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2cz\" (UniqueName: \"kubernetes.io/projected/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3-kube-api-access-lj2cz\") pod \"kuadrant-operator-catalog-xhm86\" (UID: \"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3\") " pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:43.640193 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.640154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2cz\" (UniqueName: \"kubernetes.io/projected/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3-kube-api-access-lj2cz\") pod \"kuadrant-operator-catalog-xhm86\" (UID: \"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3\") " pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:43.653228 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.653193 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2cz\" (UniqueName: \"kubernetes.io/projected/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3-kube-api-access-lj2cz\") pod \"kuadrant-operator-catalog-xhm86\" (UID: \"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3\") " pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:43.812975 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.812892 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:43.868056 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.868023 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhm86"] Jul 14 20:31:43.943341 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:43.943317 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhm86"] Jul 14 20:31:43.945130 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:31:43.945106 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acbb2c2_54ff_428d_a1c7_300d5a4c9be3.slice/crio-d1fbf5f82e8259e1de17397e16c13471673da73d0b9e8a16ae0bb385a50032c6 WatchSource:0}: Error finding container d1fbf5f82e8259e1de17397e16c13471673da73d0b9e8a16ae0bb385a50032c6: Status 404 returned error can't find the container with id d1fbf5f82e8259e1de17397e16c13471673da73d0b9e8a16ae0bb385a50032c6 Jul 14 20:31:44.076874 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.076844 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qr4mw"] Jul 14 20:31:44.079747 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.079730 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:44.087337 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.087310 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qr4mw"] Jul 14 20:31:44.144149 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.144112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29w5\" (UniqueName: \"kubernetes.io/projected/71a6834f-0cce-4b0c-b177-94883344caaf-kube-api-access-g29w5\") pod \"kuadrant-operator-catalog-qr4mw\" (UID: \"71a6834f-0cce-4b0c-b177-94883344caaf\") " pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:44.244597 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.244560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29w5\" (UniqueName: \"kubernetes.io/projected/71a6834f-0cce-4b0c-b177-94883344caaf-kube-api-access-g29w5\") pod \"kuadrant-operator-catalog-qr4mw\" (UID: \"71a6834f-0cce-4b0c-b177-94883344caaf\") " pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:44.252878 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.252845 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29w5\" (UniqueName: \"kubernetes.io/projected/71a6834f-0cce-4b0c-b177-94883344caaf-kube-api-access-g29w5\") pod \"kuadrant-operator-catalog-qr4mw\" (UID: \"71a6834f-0cce-4b0c-b177-94883344caaf\") " pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:44.389689 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.389597 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:44.519886 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.519856 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qr4mw"] Jul 14 20:31:44.522932 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:31:44.522908 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a6834f_0cce_4b0c_b177_94883344caaf.slice/crio-bc87211e44714cd1c9d4725f002855e38a3479dbe40269617a1eaec8cf2cdd2a WatchSource:0}: Error finding container bc87211e44714cd1c9d4725f002855e38a3479dbe40269617a1eaec8cf2cdd2a: Status 404 returned error can't find the container with id bc87211e44714cd1c9d4725f002855e38a3479dbe40269617a1eaec8cf2cdd2a Jul 14 20:31:44.942606 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.942570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" event={"ID":"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3","Type":"ContainerStarted","Data":"d1fbf5f82e8259e1de17397e16c13471673da73d0b9e8a16ae0bb385a50032c6"} Jul 14 20:31:44.943745 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:44.943721 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" event={"ID":"71a6834f-0cce-4b0c-b177-94883344caaf","Type":"ContainerStarted","Data":"bc87211e44714cd1c9d4725f002855e38a3479dbe40269617a1eaec8cf2cdd2a"} Jul 14 20:31:46.953602 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:46.953565 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" event={"ID":"71a6834f-0cce-4b0c-b177-94883344caaf","Type":"ContainerStarted","Data":"57d1d83c2925696e4a0f28632cf8a2bc070edc14efe1994e606dee2c1543eeef"} Jul 14 20:31:46.955114 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:46.955083 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" event={"ID":"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3","Type":"ContainerStarted","Data":"f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3"} Jul 14 20:31:46.955207 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:46.955167 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" podUID="3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" containerName="registry-server" containerID="cri-o://f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3" gracePeriod=2 Jul 14 20:31:46.969509 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:46.969356 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" podStartSLOduration=1.16552124 podStartE2EDuration="2.969338269s" totalImagesPullingTime="1.803817029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:46.968950781 +0000 UTC m=+569.567591668" watchObservedRunningTime="2026-07-14 20:31:46.969338269 +0000 UTC m=+569.567979157" Jul 14 20:31:46.983169 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:46.983125 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" podStartSLOduration=1.597774 podStartE2EDuration="3.98310943s" totalImagesPullingTime="2.38533543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:46.982806912 +0000 UTC m=+569.581447801" watchObservedRunningTime="2026-07-14 20:31:46.98310943 +0000 UTC m=+569.581750316" Jul 14 20:31:47.197538 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.197513 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:47.263863 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.263772 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj2cz\" (UniqueName: \"kubernetes.io/projected/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3-kube-api-access-lj2cz\") pod \"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3\" (UID: \"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3\") " Jul 14 20:31:47.266059 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.266031 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3-kube-api-access-lj2cz" (OuterVolumeSpecName: "kube-api-access-lj2cz") pod "3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" (UID: "3acbb2c2-54ff-428d-a1c7-300d5a4c9be3"). InnerVolumeSpecName "kube-api-access-lj2cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:31:47.364698 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.364674 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj2cz\" (UniqueName: \"kubernetes.io/projected/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3-kube-api-access-lj2cz\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:31:47.960333 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.960294 2554 generic.go:356] "Generic (PLEG): container finished" podID="3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" containerID="f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3" exitCode=0 Jul 14 20:31:47.960782 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.960342 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" Jul 14 20:31:47.960782 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.960397 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" event={"ID":"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3","Type":"ContainerDied","Data":"f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3"} Jul 14 20:31:47.960782 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.960448 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xhm86" event={"ID":"3acbb2c2-54ff-428d-a1c7-300d5a4c9be3","Type":"ContainerDied","Data":"d1fbf5f82e8259e1de17397e16c13471673da73d0b9e8a16ae0bb385a50032c6"} Jul 14 20:31:47.960782 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.960469 2554 scope.go:117] "RemoveContainer" containerID="f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3" Jul 14 20:31:47.968432 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.968402 2554 scope.go:117] "RemoveContainer" containerID="f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3" Jul 14 20:31:47.968695 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:31:47.968675 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3\": container with ID starting with f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3 not found: ID does not exist" containerID="f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3" Jul 14 20:31:47.968771 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.968702 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3"} err="failed to get container status \"f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3\": rpc error: code = NotFound desc = could not find container \"f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3\": container with ID starting with f82bf292de7df21a2b241fb482d7a98100a3ec5db66c42fade976e7b414ac2e3 not found: ID does not exist" Jul 14 20:31:47.976734 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.976705 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhm86"] Jul 14 20:31:47.983061 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:47.983037 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhm86"] Jul 14 20:31:49.942497 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:49.942468 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" path="/var/lib/kubelet/pods/3acbb2c2-54ff-428d-a1c7-300d5a4c9be3/volumes" Jul 14 20:31:54.390043 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:54.389996 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:54.390517 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:54.390070 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:54.412488 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:54.412460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:31:55.011930 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:31:55.011905 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qr4mw" Jul 14 20:32:16.708524 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.708487 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w"] Jul 14 20:32:16.708989 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.708805 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" containerName="registry-server" Jul 14 20:32:16.708989 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.708817 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" containerName="registry-server" Jul 14 20:32:16.708989 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.708870 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3acbb2c2-54ff-428d-a1c7-300d5a4c9be3" containerName="registry-server" Jul 14 20:32:16.711936 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.711917 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:16.714131 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.714109 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8d4qt\"" Jul 14 20:32:16.725295 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.725269 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w"] Jul 14 20:32:16.769726 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.769689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfcdx\" (UniqueName: \"kubernetes.io/projected/be2ee2f3-1610-45fd-bde5-71917a46705a-kube-api-access-jfcdx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:16.769911 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.769766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2ee2f3-1610-45fd-bde5-71917a46705a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:16.871159 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.871121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfcdx\" (UniqueName: \"kubernetes.io/projected/be2ee2f3-1610-45fd-bde5-71917a46705a-kube-api-access-jfcdx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:16.871337 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.871192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2ee2f3-1610-45fd-bde5-71917a46705a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:16.871636 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.871612 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2ee2f3-1610-45fd-bde5-71917a46705a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:16.885180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:16.885144 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfcdx\" (UniqueName: \"kubernetes.io/projected/be2ee2f3-1610-45fd-bde5-71917a46705a-kube-api-access-jfcdx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:17.021650 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:17.021560 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:17.174484 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:32:17.174442 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2ee2f3_1610_45fd_bde5_71917a46705a.slice/crio-642fdb657d1a5e9cfd9de45a0028c5207d70271359b958882744a4fb45f6fd68 WatchSource:0}: Error finding container 642fdb657d1a5e9cfd9de45a0028c5207d70271359b958882744a4fb45f6fd68: Status 404 returned error can't find the container with id 642fdb657d1a5e9cfd9de45a0028c5207d70271359b958882744a4fb45f6fd68 Jul 14 20:32:17.185433 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:17.185408 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w"] Jul 14 20:32:17.785502 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:17.785467 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:32:17.787612 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:17.787593 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:32:18.083950 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:18.083914 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" event={"ID":"be2ee2f3-1610-45fd-bde5-71917a46705a","Type":"ContainerStarted","Data":"642fdb657d1a5e9cfd9de45a0028c5207d70271359b958882744a4fb45f6fd68"} Jul 14 20:32:19.466651 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.466616 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fggkh"] Jul 14 20:32:19.470135 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.470115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:19.472968 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.472952 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-r6khr\"" Jul 14 20:32:19.483667 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.483646 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fggkh"] Jul 14 20:32:19.493377 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.493351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gnjz\" (UniqueName: \"kubernetes.io/projected/b5c8ea1f-a553-4e1d-b17e-92d7533feefb-kube-api-access-5gnjz\") pod \"authorino-operator-75cc8d5cb7-fggkh\" (UID: \"b5c8ea1f-a553-4e1d-b17e-92d7533feefb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:19.594162 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.594124 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gnjz\" (UniqueName: \"kubernetes.io/projected/b5c8ea1f-a553-4e1d-b17e-92d7533feefb-kube-api-access-5gnjz\") pod \"authorino-operator-75cc8d5cb7-fggkh\" (UID: \"b5c8ea1f-a553-4e1d-b17e-92d7533feefb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:19.602577 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.602524 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gnjz\" (UniqueName: \"kubernetes.io/projected/b5c8ea1f-a553-4e1d-b17e-92d7533feefb-kube-api-access-5gnjz\") pod \"authorino-operator-75cc8d5cb7-fggkh\" (UID: \"b5c8ea1f-a553-4e1d-b17e-92d7533feefb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:19.780080 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.779991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:19.918319 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:19.918274 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fggkh"] Jul 14 20:32:19.921563 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:32:19.921533 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c8ea1f_a553_4e1d_b17e_92d7533feefb.slice/crio-9f7a27e57240277b4df85325de7301791b4aa277c9072e2fc6c9afd27f202b92 WatchSource:0}: Error finding container 9f7a27e57240277b4df85325de7301791b4aa277c9072e2fc6c9afd27f202b92: Status 404 returned error can't find the container with id 9f7a27e57240277b4df85325de7301791b4aa277c9072e2fc6c9afd27f202b92 Jul 14 20:32:20.095822 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:20.095785 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" event={"ID":"b5c8ea1f-a553-4e1d-b17e-92d7533feefb","Type":"ContainerStarted","Data":"9f7a27e57240277b4df85325de7301791b4aa277c9072e2fc6c9afd27f202b92"} Jul 14 20:32:21.425852 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.425814 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj"] Jul 14 20:32:21.434234 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.434210 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:21.437456 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.437423 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5pfzt\"" Jul 14 20:32:21.438180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.437895 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 20:32:21.439948 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.439924 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj"] Jul 14 20:32:21.509815 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.509782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfw4x\" (UniqueName: \"kubernetes.io/projected/e1a069cf-f96f-49f2-ae92-87cf138605c8-kube-api-access-rfw4x\") pod \"dns-operator-controller-manager-864dd78c4c-6h9sj\" (UID: \"e1a069cf-f96f-49f2-ae92-87cf138605c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:21.610333 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.610293 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfw4x\" (UniqueName: \"kubernetes.io/projected/e1a069cf-f96f-49f2-ae92-87cf138605c8-kube-api-access-rfw4x\") pod \"dns-operator-controller-manager-864dd78c4c-6h9sj\" (UID: \"e1a069cf-f96f-49f2-ae92-87cf138605c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:21.619145 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.619107 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfw4x\" (UniqueName: \"kubernetes.io/projected/e1a069cf-f96f-49f2-ae92-87cf138605c8-kube-api-access-rfw4x\") pod \"dns-operator-controller-manager-864dd78c4c-6h9sj\" (UID: \"e1a069cf-f96f-49f2-ae92-87cf138605c8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:21.746838 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:21.746759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:22.030645 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:22.030607 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj"] Jul 14 20:32:22.250616 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:32:22.250583 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a069cf_f96f_49f2_ae92_87cf138605c8.slice/crio-78616d184a8dbb990195cba29e4f3f3e17a5f77360f5b2aac1e7f55327774b62 WatchSource:0}: Error finding container 78616d184a8dbb990195cba29e4f3f3e17a5f77360f5b2aac1e7f55327774b62: Status 404 returned error can't find the container with id 78616d184a8dbb990195cba29e4f3f3e17a5f77360f5b2aac1e7f55327774b62 Jul 14 20:32:23.112128 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:23.112054 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" event={"ID":"b5c8ea1f-a553-4e1d-b17e-92d7533feefb","Type":"ContainerStarted","Data":"0f2de9d9746ec4f6e4cf7c384e205303a6c7ebc53328eeadc08cd2d461aca346"} Jul 14 20:32:23.112602 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:23.112190 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:23.113436 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:23.113413 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" event={"ID":"e1a069cf-f96f-49f2-ae92-87cf138605c8","Type":"ContainerStarted","Data":"78616d184a8dbb990195cba29e4f3f3e17a5f77360f5b2aac1e7f55327774b62"} Jul 14 20:32:23.132751 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:23.132704 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" podStartSLOduration=1.759493966 podStartE2EDuration="4.132690825s" totalImagesPullingTime="2.373196859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:23.13251789 +0000 UTC m=+605.731158778" watchObservedRunningTime="2026-07-14 20:32:23.132690825 +0000 UTC m=+605.731331713" Jul 14 20:32:24.142933 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.142903 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg"] Jul 14 20:32:24.146952 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.146930 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:24.149237 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.149205 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9qck2\"" Jul 14 20:32:24.161574 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.161549 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg"] Jul 14 20:32:24.234473 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.234430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nt5c\" (UniqueName: \"kubernetes.io/projected/f1204492-2cd8-4d04-88df-889283feea39-kube-api-access-6nt5c\") pod \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" (UID: \"f1204492-2cd8-4d04-88df-889283feea39\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:24.335347 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.335303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nt5c\" (UniqueName: \"kubernetes.io/projected/f1204492-2cd8-4d04-88df-889283feea39-kube-api-access-6nt5c\") pod \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" (UID: \"f1204492-2cd8-4d04-88df-889283feea39\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:24.344589 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.344557 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nt5c\" (UniqueName: \"kubernetes.io/projected/f1204492-2cd8-4d04-88df-889283feea39-kube-api-access-6nt5c\") pod \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" (UID: \"f1204492-2cd8-4d04-88df-889283feea39\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:24.459472 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:24.459357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:25.471883 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:25.471846 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg"] Jul 14 20:32:25.771180 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:32:25.771155 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1204492_2cd8_4d04_88df_889283feea39.slice/crio-46e163d9cd15c4b8e530b41b3d667b395b06fd1fcb4821054501ee7e3278725e WatchSource:0}: Error finding container 46e163d9cd15c4b8e530b41b3d667b395b06fd1fcb4821054501ee7e3278725e: Status 404 returned error can't find the container with id 46e163d9cd15c4b8e530b41b3d667b395b06fd1fcb4821054501ee7e3278725e Jul 14 20:32:26.128728 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.128685 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" event={"ID":"be2ee2f3-1610-45fd-bde5-71917a46705a","Type":"ContainerStarted","Data":"c61bb7db51169f2336481826d3cfd4264321ea635f4d7c0758564654045e4d09"} Jul 14 20:32:26.128907 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.128864 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:26.130229 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.130206 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" event={"ID":"e1a069cf-f96f-49f2-ae92-87cf138605c8","Type":"ContainerStarted","Data":"02ccb0331c4b1529be003a13e07f9151f847b312a20329cdbe2eb7d326d0c2e3"} Jul 14 20:32:26.130355 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.130272 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:26.131433 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.131414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" event={"ID":"f1204492-2cd8-4d04-88df-889283feea39","Type":"ContainerStarted","Data":"46e163d9cd15c4b8e530b41b3d667b395b06fd1fcb4821054501ee7e3278725e"} Jul 14 20:32:26.150207 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.150156 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" podStartSLOduration=1.557785107 podStartE2EDuration="10.150143009s" totalImagesPullingTime="8.592357902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:26.148672924 +0000 UTC m=+608.747313811" watchObservedRunningTime="2026-07-14 20:32:26.150143009 +0000 UTC m=+608.748783965" Jul 14 20:32:26.168602 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:26.168553 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" podStartSLOduration=1.6031659249999999 podStartE2EDuration="5.168534127s" totalImagesPullingTime="3.565368202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:26.166838219 +0000 UTC m=+608.765479109" watchObservedRunningTime="2026-07-14 20:32:26.168534127 +0000 UTC m=+608.767175015" Jul 14 20:32:29.149017 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:29.148974 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" event={"ID":"f1204492-2cd8-4d04-88df-889283feea39","Type":"ContainerStarted","Data":"d2c18e85f8724159ebcea65d82a78f33e148cbb0f91651d2fa1eed3d1364036c"} Jul 14 20:32:29.149455 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:29.149142 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:29.168124 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:29.168079 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" podStartSLOduration=2.629040727 podStartE2EDuration="5.168064328s" totalImagesPullingTime="2.539023601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:29.167313112 +0000 UTC m=+611.765954000" watchObservedRunningTime="2026-07-14 20:32:29.168064328 +0000 UTC m=+611.766705293" Jul 14 20:32:34.120647 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:34.120611 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fggkh" Jul 14 20:32:37.137829 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:37.137798 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:37.138201 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:37.137869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6h9sj" Jul 14 20:32:38.952449 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.952357 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w"] Jul 14 20:32:38.952840 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.952518 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" containerName="manager" containerID="cri-o://c61bb7db51169f2336481826d3cfd4264321ea635f4d7c0758564654045e4d09" gracePeriod=2 Jul 14 20:32:38.961252 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.961226 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w"] Jul 14 20:32:38.963184 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:38.963148 2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"be2ee2f3-1610-45fd-bde5-71917a46705a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-nn72w\": pods \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:38.977451 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.977425 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc"] Jul 14 20:32:38.977738 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.977725 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" containerName="manager" Jul 14 20:32:38.977800 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.977740 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" containerName="manager" Jul 14 20:32:38.977800 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.977798 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" containerName="manager" Jul 14 20:32:38.980517 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.980497 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg"] Jul 14 20:32:38.980670 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.980648 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" podUID="f1204492-2cd8-4d04-88df-889283feea39" containerName="manager" containerID="cri-o://d2c18e85f8724159ebcea65d82a78f33e148cbb0f91651d2fa1eed3d1364036c" gracePeriod=2 Jul 14 20:32:38.980757 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.980692 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:38.982663 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.982639 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:38.982766 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:38.982645 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:38.983275 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.983251 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg"] Jul 14 20:32:38.984351 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:38.984189 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="f1204492-2cd8-4d04-88df-889283feea39" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:38.985853 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:38.985822 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:38.987196 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:38.987172 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="f1204492-2cd8-4d04-88df-889283feea39" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:38.996847 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:38.996825 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc"] Jul 14 20:32:39.004211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.004183 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g"] Jul 14 20:32:39.004580 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.004565 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1204492-2cd8-4d04-88df-889283feea39" containerName="manager" Jul 14 20:32:39.004580 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.004582 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1204492-2cd8-4d04-88df-889283feea39" containerName="manager" Jul 14 20:32:39.004684 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.004651 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1204492-2cd8-4d04-88df-889283feea39" containerName="manager" Jul 14 20:32:39.007519 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.007497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:39.023777 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.023749 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g"] Jul 14 20:32:39.039641 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:39.039614 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:39.041168 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:39.041127 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="f1204492-2cd8-4d04-88df-889283feea39" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:39.057522 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.057495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzd8m\" (UniqueName: \"kubernetes.io/projected/76cd4414-6856-44da-a00b-5d11bd203114-kube-api-access-bzd8m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ccmfc\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.057662 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.057538 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76cd4414-6856-44da-a00b-5d11bd203114-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ccmfc\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.157975 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.157942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzd8m\" (UniqueName: \"kubernetes.io/projected/76cd4414-6856-44da-a00b-5d11bd203114-kube-api-access-bzd8m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ccmfc\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.158123 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.157993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76cd4414-6856-44da-a00b-5d11bd203114-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ccmfc\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.158123 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.158036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4rs\" (UniqueName: \"kubernetes.io/projected/5cf27db3-cf40-4475-9628-26bc66aaada8-kube-api-access-ps4rs\") pod \"limitador-operator-controller-manager-859d7b78bd-gh45g\" (UID: \"5cf27db3-cf40-4475-9628-26bc66aaada8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:39.158541 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.158516 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76cd4414-6856-44da-a00b-5d11bd203114-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ccmfc\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.167412 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.167317 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzd8m\" (UniqueName: \"kubernetes.io/projected/76cd4414-6856-44da-a00b-5d11bd203114-kube-api-access-bzd8m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ccmfc\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.200028 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.199756 2554 generic.go:356] "Generic (PLEG): container finished" podID="be2ee2f3-1610-45fd-bde5-71917a46705a" containerID="c61bb7db51169f2336481826d3cfd4264321ea635f4d7c0758564654045e4d09" exitCode=0 Jul 14 20:32:39.201838 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.201814 2554 generic.go:356] "Generic (PLEG): container finished" podID="f1204492-2cd8-4d04-88df-889283feea39" containerID="d2c18e85f8724159ebcea65d82a78f33e148cbb0f91651d2fa1eed3d1364036c" exitCode=0 Jul 14 20:32:39.202141 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.202119 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp"] Jul 14 20:32:39.207013 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.206962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.218314 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.218289 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp"] Jul 14 20:32:39.231536 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.231508 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:39.234786 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.234765 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:39.236496 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:39.236470 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:39.238037 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:39.238016 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="f1204492-2cd8-4d04-88df-889283feea39" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:39.239580 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:39.239560 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nn72w\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:39.240756 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:39.240731 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lbsxg\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="f1204492-2cd8-4d04-88df-889283feea39" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:39.259232 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.259209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4rs\" (UniqueName: \"kubernetes.io/projected/5cf27db3-cf40-4475-9628-26bc66aaada8-kube-api-access-ps4rs\") pod \"limitador-operator-controller-manager-859d7b78bd-gh45g\" (UID: \"5cf27db3-cf40-4475-9628-26bc66aaada8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:39.267772 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.267752 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4rs\" (UniqueName: \"kubernetes.io/projected/5cf27db3-cf40-4475-9628-26bc66aaada8-kube-api-access-ps4rs\") pod \"limitador-operator-controller-manager-859d7b78bd-gh45g\" (UID: \"5cf27db3-cf40-4475-9628-26bc66aaada8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:39.360451 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.360422 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfcdx\" (UniqueName: \"kubernetes.io/projected/be2ee2f3-1610-45fd-bde5-71917a46705a-kube-api-access-jfcdx\") pod \"be2ee2f3-1610-45fd-bde5-71917a46705a\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " Jul 14 20:32:39.360622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.360465 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2ee2f3-1610-45fd-bde5-71917a46705a-extensions-socket-volume\") pod \"be2ee2f3-1610-45fd-bde5-71917a46705a\" (UID: \"be2ee2f3-1610-45fd-bde5-71917a46705a\") " Jul 14 20:32:39.360622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.360509 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nt5c\" (UniqueName: \"kubernetes.io/projected/f1204492-2cd8-4d04-88df-889283feea39-kube-api-access-6nt5c\") pod \"f1204492-2cd8-4d04-88df-889283feea39\" (UID: \"f1204492-2cd8-4d04-88df-889283feea39\") " Jul 14 20:32:39.360622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.360601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljhgm\" (UniqueName: \"kubernetes.io/projected/294a31b4-c2e0-41dd-a19c-b310009b5542-kube-api-access-ljhgm\") pod \"kuadrant-operator-controller-manager-86878c769f-krprp\" (UID: \"294a31b4-c2e0-41dd-a19c-b310009b5542\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.360730 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.360712 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294a31b4-c2e0-41dd-a19c-b310009b5542-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-krprp\" (UID: \"294a31b4-c2e0-41dd-a19c-b310009b5542\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.360968 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.360936 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2ee2f3-1610-45fd-bde5-71917a46705a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "be2ee2f3-1610-45fd-bde5-71917a46705a" (UID: "be2ee2f3-1610-45fd-bde5-71917a46705a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:39.362702 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.362681 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1204492-2cd8-4d04-88df-889283feea39-kube-api-access-6nt5c" (OuterVolumeSpecName: "kube-api-access-6nt5c") pod "f1204492-2cd8-4d04-88df-889283feea39" (UID: "f1204492-2cd8-4d04-88df-889283feea39"). InnerVolumeSpecName "kube-api-access-6nt5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:39.362776 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.362697 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2ee2f3-1610-45fd-bde5-71917a46705a-kube-api-access-jfcdx" (OuterVolumeSpecName: "kube-api-access-jfcdx") pod "be2ee2f3-1610-45fd-bde5-71917a46705a" (UID: "be2ee2f3-1610-45fd-bde5-71917a46705a"). InnerVolumeSpecName "kube-api-access-jfcdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:39.401570 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.401526 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:39.409680 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.409658 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:39.467959 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.462677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294a31b4-c2e0-41dd-a19c-b310009b5542-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-krprp\" (UID: \"294a31b4-c2e0-41dd-a19c-b310009b5542\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.467959 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.462749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljhgm\" (UniqueName: \"kubernetes.io/projected/294a31b4-c2e0-41dd-a19c-b310009b5542-kube-api-access-ljhgm\") pod \"kuadrant-operator-controller-manager-86878c769f-krprp\" (UID: \"294a31b4-c2e0-41dd-a19c-b310009b5542\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.467959 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.462808 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be2ee2f3-1610-45fd-bde5-71917a46705a-extensions-socket-volume\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:32:39.467959 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.462823 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nt5c\" (UniqueName: \"kubernetes.io/projected/f1204492-2cd8-4d04-88df-889283feea39-kube-api-access-6nt5c\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:32:39.467959 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.462837 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfcdx\" (UniqueName: \"kubernetes.io/projected/be2ee2f3-1610-45fd-bde5-71917a46705a-kube-api-access-jfcdx\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:32:39.467959 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.463547 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294a31b4-c2e0-41dd-a19c-b310009b5542-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-krprp\" (UID: \"294a31b4-c2e0-41dd-a19c-b310009b5542\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.478299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.478212 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljhgm\" (UniqueName: \"kubernetes.io/projected/294a31b4-c2e0-41dd-a19c-b310009b5542-kube-api-access-ljhgm\") pod \"kuadrant-operator-controller-manager-86878c769f-krprp\" (UID: \"294a31b4-c2e0-41dd-a19c-b310009b5542\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.528731 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.528703 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:39.580180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.580155 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc"] Jul 14 20:32:39.584463 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:32:39.584437 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cd4414_6856_44da_a00b_5d11bd203114.slice/crio-68de86a65a72d28284aafa38da92fcd672cfba7f289319cfd802a797973f5818 WatchSource:0}: Error finding container 68de86a65a72d28284aafa38da92fcd672cfba7f289319cfd802a797973f5818: Status 404 returned error can't find the container with id 68de86a65a72d28284aafa38da92fcd672cfba7f289319cfd802a797973f5818 Jul 14 20:32:39.593374 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.593142 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g"] Jul 14 20:32:39.687128 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.687106 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp"] Jul 14 20:32:39.689566 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:32:39.689546 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294a31b4_c2e0_41dd_a19c_b310009b5542.slice/crio-293b4ebea03805930d5e1c0010600c50a11b78ad6ac450dbda74afd22c7b0858 WatchSource:0}: Error finding container 293b4ebea03805930d5e1c0010600c50a11b78ad6ac450dbda74afd22c7b0858: Status 404 returned error can't find the container with id 293b4ebea03805930d5e1c0010600c50a11b78ad6ac450dbda74afd22c7b0858 Jul 14 20:32:39.943356 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.943322 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2ee2f3-1610-45fd-bde5-71917a46705a" path="/var/lib/kubelet/pods/be2ee2f3-1610-45fd-bde5-71917a46705a/volumes" Jul 14 20:32:39.943679 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:39.943665 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1204492-2cd8-4d04-88df-889283feea39" path="/var/lib/kubelet/pods/f1204492-2cd8-4d04-88df-889283feea39/volumes" Jul 14 20:32:40.207409 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.207346 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lbsxg" Jul 14 20:32:40.207892 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.207423 2554 scope.go:117] "RemoveContainer" containerID="d2c18e85f8724159ebcea65d82a78f33e148cbb0f91651d2fa1eed3d1364036c" Jul 14 20:32:40.209488 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.209463 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nn72w" Jul 14 20:32:40.212728 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.212692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" event={"ID":"5cf27db3-cf40-4475-9628-26bc66aaada8","Type":"ContainerStarted","Data":"f51886819b21e9c5fba3dc6f6bd64671f3a0889f6ded381d449f492bbca50cf9"} Jul 14 20:32:40.212846 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.212760 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" event={"ID":"5cf27db3-cf40-4475-9628-26bc66aaada8","Type":"ContainerStarted","Data":"e2606fda710c44cacbf82f2f49efbd6a0deedba778bfe2aaa23a5ca46c56a295"} Jul 14 20:32:40.212918 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.212882 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:40.215180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.215150 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" event={"ID":"294a31b4-c2e0-41dd-a19c-b310009b5542","Type":"ContainerStarted","Data":"e23d231d9e0b2a6c3c5a3993174de6401060bb7798fc3176783f201fe484d589"} Jul 14 20:32:40.215316 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.215206 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" event={"ID":"294a31b4-c2e0-41dd-a19c-b310009b5542","Type":"ContainerStarted","Data":"293b4ebea03805930d5e1c0010600c50a11b78ad6ac450dbda74afd22c7b0858"} Jul 14 20:32:40.215316 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.215235 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:40.216985 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.216963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" event={"ID":"76cd4414-6856-44da-a00b-5d11bd203114","Type":"ContainerStarted","Data":"0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8"} Jul 14 20:32:40.217092 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.217011 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:40.217092 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.217036 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" event={"ID":"76cd4414-6856-44da-a00b-5d11bd203114","Type":"ContainerStarted","Data":"68de86a65a72d28284aafa38da92fcd672cfba7f289319cfd802a797973f5818"} Jul 14 20:32:40.221305 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.221286 2554 scope.go:117] "RemoveContainer" containerID="c61bb7db51169f2336481826d3cfd4264321ea635f4d7c0758564654045e4d09" Jul 14 20:32:40.243376 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.243309 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" podStartSLOduration=2.243295115 podStartE2EDuration="2.243295115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:40.242416685 +0000 UTC m=+622.841057575" watchObservedRunningTime="2026-07-14 20:32:40.243295115 +0000 UTC m=+622.841936002" Jul 14 20:32:40.281443 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.281360 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" podStartSLOduration=2.281342691 podStartE2EDuration="2.281342691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:40.280958833 +0000 UTC m=+622.879599720" watchObservedRunningTime="2026-07-14 20:32:40.281342691 +0000 UTC m=+622.879983579" Jul 14 20:32:40.302083 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:40.302032 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" podStartSLOduration=1.30200941 podStartE2EDuration="1.30200941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:40.301687906 +0000 UTC m=+622.900328794" watchObservedRunningTime="2026-07-14 20:32:40.30200941 +0000 UTC m=+622.900650297" Jul 14 20:32:51.231717 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.231690 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:51.232233 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.231759 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gh45g" Jul 14 20:32:51.232233 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.231792 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krprp" Jul 14 20:32:51.324312 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.324271 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc"] Jul 14 20:32:51.324597 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.324570 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" podUID="76cd4414-6856-44da-a00b-5d11bd203114" containerName="manager" containerID="cri-o://0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8" gracePeriod=10 Jul 14 20:32:51.573074 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.573052 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:51.661299 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.661268 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76cd4414-6856-44da-a00b-5d11bd203114-extensions-socket-volume\") pod \"76cd4414-6856-44da-a00b-5d11bd203114\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " Jul 14 20:32:51.661469 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.661312 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzd8m\" (UniqueName: \"kubernetes.io/projected/76cd4414-6856-44da-a00b-5d11bd203114-kube-api-access-bzd8m\") pod \"76cd4414-6856-44da-a00b-5d11bd203114\" (UID: \"76cd4414-6856-44da-a00b-5d11bd203114\") " Jul 14 20:32:51.661679 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.661652 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76cd4414-6856-44da-a00b-5d11bd203114-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "76cd4414-6856-44da-a00b-5d11bd203114" (UID: "76cd4414-6856-44da-a00b-5d11bd203114"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:51.663443 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.663417 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76cd4414-6856-44da-a00b-5d11bd203114-kube-api-access-bzd8m" (OuterVolumeSpecName: "kube-api-access-bzd8m") pod "76cd4414-6856-44da-a00b-5d11bd203114" (UID: "76cd4414-6856-44da-a00b-5d11bd203114"). InnerVolumeSpecName "kube-api-access-bzd8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:51.762563 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.762475 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76cd4414-6856-44da-a00b-5d11bd203114-extensions-socket-volume\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:32:51.762563 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:51.762512 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzd8m\" (UniqueName: \"kubernetes.io/projected/76cd4414-6856-44da-a00b-5d11bd203114-kube-api-access-bzd8m\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:32:52.284095 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.284061 2554 generic.go:356] "Generic (PLEG): container finished" podID="76cd4414-6856-44da-a00b-5d11bd203114" containerID="0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8" exitCode=0 Jul 14 20:32:52.284483 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.284115 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" Jul 14 20:32:52.284483 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.284129 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" event={"ID":"76cd4414-6856-44da-a00b-5d11bd203114","Type":"ContainerDied","Data":"0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8"} Jul 14 20:32:52.284483 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.284191 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc" event={"ID":"76cd4414-6856-44da-a00b-5d11bd203114","Type":"ContainerDied","Data":"68de86a65a72d28284aafa38da92fcd672cfba7f289319cfd802a797973f5818"} Jul 14 20:32:52.284483 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.284213 2554 scope.go:117] "RemoveContainer" containerID="0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8" Jul 14 20:32:52.292845 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.292827 2554 scope.go:117] "RemoveContainer" containerID="0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8" Jul 14 20:32:52.293080 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:32:52.293061 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8\": container with ID starting with 0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8 not found: ID does not exist" containerID="0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8" Jul 14 20:32:52.293142 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.293087 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8"} err="failed to get container status \"0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8\": rpc error: code = NotFound desc = could not find container \"0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8\": container with ID starting with 0be331fb89bf194de27896358013e8fb0da906910ea081681212a9a14f1724c8 not found: ID does not exist" Jul 14 20:32:52.302233 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.302212 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc"] Jul 14 20:32:52.309937 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:52.309917 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ccmfc"] Jul 14 20:32:53.943171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:32:53.943140 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76cd4414-6856-44da-a00b-5d11bd203114" path="/var/lib/kubelet/pods/76cd4414-6856-44da-a00b-5d11bd203114/volumes" Jul 14 20:33:10.298608 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.298575 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:10.298969 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.298874 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76cd4414-6856-44da-a00b-5d11bd203114" containerName="manager" Jul 14 20:33:10.298969 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.298885 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="76cd4414-6856-44da-a00b-5d11bd203114" containerName="manager" Jul 14 20:33:10.298969 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.298946 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="76cd4414-6856-44da-a00b-5d11bd203114" containerName="manager" Jul 14 20:33:10.300779 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.300759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.302839 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.302811 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 20:33:10.302944 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.302855 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n7vmj\"" Jul 14 20:33:10.310112 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.310091 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:10.392160 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.392111 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:10.404156 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.404128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c773553f-9e62-4e70-88df-a68bd143fb8b-config-file\") pod \"limitador-limitador-64c94fd64f-brwbp\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.404317 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.404188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdwvc\" (UniqueName: \"kubernetes.io/projected/c773553f-9e62-4e70-88df-a68bd143fb8b-kube-api-access-wdwvc\") pod \"limitador-limitador-64c94fd64f-brwbp\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.505333 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.505297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdwvc\" (UniqueName: \"kubernetes.io/projected/c773553f-9e62-4e70-88df-a68bd143fb8b-kube-api-access-wdwvc\") pod \"limitador-limitador-64c94fd64f-brwbp\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.505586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.505375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c773553f-9e62-4e70-88df-a68bd143fb8b-config-file\") pod \"limitador-limitador-64c94fd64f-brwbp\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.506143 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.506111 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c773553f-9e62-4e70-88df-a68bd143fb8b-config-file\") pod \"limitador-limitador-64c94fd64f-brwbp\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.514086 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.514060 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdwvc\" (UniqueName: \"kubernetes.io/projected/c773553f-9e62-4e70-88df-a68bd143fb8b-kube-api-access-wdwvc\") pod \"limitador-limitador-64c94fd64f-brwbp\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.611241 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.611204 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:10.753089 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:10.753062 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:10.755820 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:33:10.755783 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc773553f_9e62_4e70_88df_a68bd143fb8b.slice/crio-7f3a6b61a754e7869ecb81466fea23103a4417580669d7eb6762b2ca2731762f WatchSource:0}: Error finding container 7f3a6b61a754e7869ecb81466fea23103a4417580669d7eb6762b2ca2731762f: Status 404 returned error can't find the container with id 7f3a6b61a754e7869ecb81466fea23103a4417580669d7eb6762b2ca2731762f Jul 14 20:33:11.368654 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.368610 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" event={"ID":"c773553f-9e62-4e70-88df-a68bd143fb8b","Type":"ContainerStarted","Data":"7f3a6b61a754e7869ecb81466fea23103a4417580669d7eb6762b2ca2731762f"} Jul 14 20:33:11.398512 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.398474 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjm64"] Jul 14 20:33:11.400900 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.400877 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:11.403064 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.403038 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5w2cd\"" Jul 14 20:33:11.407817 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.407789 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjm64"] Jul 14 20:33:11.414953 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.414918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqskf\" (UniqueName: \"kubernetes.io/projected/15dfd1eb-627d-481e-9fd9-caef971def42-kube-api-access-qqskf\") pod \"authorino-75d556bd77-wjm64\" (UID: \"15dfd1eb-627d-481e-9fd9-caef971def42\") " pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:11.516546 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.516507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqskf\" (UniqueName: \"kubernetes.io/projected/15dfd1eb-627d-481e-9fd9-caef971def42-kube-api-access-qqskf\") pod \"authorino-75d556bd77-wjm64\" (UID: \"15dfd1eb-627d-481e-9fd9-caef971def42\") " pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:11.527285 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.527217 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqskf\" (UniqueName: \"kubernetes.io/projected/15dfd1eb-627d-481e-9fd9-caef971def42-kube-api-access-qqskf\") pod \"authorino-75d556bd77-wjm64\" (UID: \"15dfd1eb-627d-481e-9fd9-caef971def42\") " pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:11.711589 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.711469 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:11.872998 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:11.872929 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjm64"] Jul 14 20:33:11.876335 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:33:11.876295 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15dfd1eb_627d_481e_9fd9_caef971def42.slice/crio-900e491d72251b815a4666d2525506ad67cf8b0b84af3b279b3f0052f3b80c05 WatchSource:0}: Error finding container 900e491d72251b815a4666d2525506ad67cf8b0b84af3b279b3f0052f3b80c05: Status 404 returned error can't find the container with id 900e491d72251b815a4666d2525506ad67cf8b0b84af3b279b3f0052f3b80c05 Jul 14 20:33:12.374931 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:12.374897 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjm64" event={"ID":"15dfd1eb-627d-481e-9fd9-caef971def42","Type":"ContainerStarted","Data":"900e491d72251b815a4666d2525506ad67cf8b0b84af3b279b3f0052f3b80c05"} Jul 14 20:33:14.386890 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:14.386852 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" event={"ID":"c773553f-9e62-4e70-88df-a68bd143fb8b","Type":"ContainerStarted","Data":"c7ece0b19259b813ae342bc9e616e2c2a2408d8efda099136536eb4292f22a20"} Jul 14 20:33:14.387336 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:14.387011 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:14.403876 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:14.403826 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" podStartSLOduration=1.609479954 podStartE2EDuration="4.403806564s" totalImagesPullingTime="2.79432661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:14.402543808 +0000 UTC m=+657.001184696" watchObservedRunningTime="2026-07-14 20:33:14.403806564 +0000 UTC m=+657.002447451" Jul 14 20:33:16.398166 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:16.398134 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjm64" event={"ID":"15dfd1eb-627d-481e-9fd9-caef971def42","Type":"ContainerStarted","Data":"5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b"} Jul 14 20:33:16.413051 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:16.413000 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wjm64" podStartSLOduration=1.6294347390000001 podStartE2EDuration="5.412986773s" totalImagesPullingTime="3.783552034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:16.411457224 +0000 UTC m=+659.010098115" watchObservedRunningTime="2026-07-14 20:33:16.412986773 +0000 UTC m=+659.011627661" Jul 14 20:33:25.393287 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:25.393255 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:27.936892 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:27.936857 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:27.939211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:27.939156 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" podUID="c773553f-9e62-4e70-88df-a68bd143fb8b" containerName="limitador" containerID="cri-o://c7ece0b19259b813ae342bc9e616e2c2a2408d8efda099136536eb4292f22a20" gracePeriod=30 Jul 14 20:33:28.450180 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.450145 2554 generic.go:356] "Generic (PLEG): container finished" podID="c773553f-9e62-4e70-88df-a68bd143fb8b" containerID="c7ece0b19259b813ae342bc9e616e2c2a2408d8efda099136536eb4292f22a20" exitCode=0 Jul 14 20:33:28.450368 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.450221 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" event={"ID":"c773553f-9e62-4e70-88df-a68bd143fb8b","Type":"ContainerDied","Data":"c7ece0b19259b813ae342bc9e616e2c2a2408d8efda099136536eb4292f22a20"} Jul 14 20:33:28.497628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.497598 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:28.568311 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.568279 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c773553f-9e62-4e70-88df-a68bd143fb8b-config-file\") pod \"c773553f-9e62-4e70-88df-a68bd143fb8b\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " Jul 14 20:33:28.568514 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.568412 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdwvc\" (UniqueName: \"kubernetes.io/projected/c773553f-9e62-4e70-88df-a68bd143fb8b-kube-api-access-wdwvc\") pod \"c773553f-9e62-4e70-88df-a68bd143fb8b\" (UID: \"c773553f-9e62-4e70-88df-a68bd143fb8b\") " Jul 14 20:33:28.568685 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.568659 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c773553f-9e62-4e70-88df-a68bd143fb8b-config-file" (OuterVolumeSpecName: "config-file") pod "c773553f-9e62-4e70-88df-a68bd143fb8b" (UID: "c773553f-9e62-4e70-88df-a68bd143fb8b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:33:28.570552 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.570523 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c773553f-9e62-4e70-88df-a68bd143fb8b-kube-api-access-wdwvc" (OuterVolumeSpecName: "kube-api-access-wdwvc") pod "c773553f-9e62-4e70-88df-a68bd143fb8b" (UID: "c773553f-9e62-4e70-88df-a68bd143fb8b"). InnerVolumeSpecName "kube-api-access-wdwvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:33:28.669211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.669174 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdwvc\" (UniqueName: \"kubernetes.io/projected/c773553f-9e62-4e70-88df-a68bd143fb8b-kube-api-access-wdwvc\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:33:28.669211 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:28.669204 2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c773553f-9e62-4e70-88df-a68bd143fb8b-config-file\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:33:29.456120 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:29.456091 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" Jul 14 20:33:29.456703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:29.456115 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-brwbp" event={"ID":"c773553f-9e62-4e70-88df-a68bd143fb8b","Type":"ContainerDied","Data":"7f3a6b61a754e7869ecb81466fea23103a4417580669d7eb6762b2ca2731762f"} Jul 14 20:33:29.456703 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:29.456216 2554 scope.go:117] "RemoveContainer" containerID="c7ece0b19259b813ae342bc9e616e2c2a2408d8efda099136536eb4292f22a20" Jul 14 20:33:29.475901 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:29.475876 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:29.479453 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:29.479431 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-brwbp"] Jul 14 20:33:29.943655 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:29.943623 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c773553f-9e62-4e70-88df-a68bd143fb8b" path="/var/lib/kubelet/pods/c773553f-9e62-4e70-88df-a68bd143fb8b/volumes" Jul 14 20:33:32.026799 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.026767 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q42lh"] Jul 14 20:33:32.027237 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.027206 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c773553f-9e62-4e70-88df-a68bd143fb8b" containerName="limitador" Jul 14 20:33:32.027237 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.027223 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c773553f-9e62-4e70-88df-a68bd143fb8b" containerName="limitador" Jul 14 20:33:32.027365 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.027332 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c773553f-9e62-4e70-88df-a68bd143fb8b" containerName="limitador" Jul 14 20:33:32.031521 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.031499 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.033895 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.033878 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zm2ph\"" Jul 14 20:33:32.033995 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.033884 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 20:33:32.034444 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.034427 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 20:33:32.034580 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.034461 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 20:33:32.046009 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.045988 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q42lh"] Jul 14 20:33:32.102934 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.102891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdkv\" (UniqueName: \"kubernetes.io/projected/404ca0f5-5c01-46a1-9a15-924237e3ed71-kube-api-access-xwdkv\") pod \"postgres-69fb4594cf-q42lh\" (UID: \"404ca0f5-5c01-46a1-9a15-924237e3ed71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.103102 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.102949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/404ca0f5-5c01-46a1-9a15-924237e3ed71-data\") pod \"postgres-69fb4594cf-q42lh\" (UID: \"404ca0f5-5c01-46a1-9a15-924237e3ed71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.204132 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.204097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdkv\" (UniqueName: \"kubernetes.io/projected/404ca0f5-5c01-46a1-9a15-924237e3ed71-kube-api-access-xwdkv\") pod \"postgres-69fb4594cf-q42lh\" (UID: \"404ca0f5-5c01-46a1-9a15-924237e3ed71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.204293 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.204144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/404ca0f5-5c01-46a1-9a15-924237e3ed71-data\") pod \"postgres-69fb4594cf-q42lh\" (UID: \"404ca0f5-5c01-46a1-9a15-924237e3ed71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.204493 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.204476 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/404ca0f5-5c01-46a1-9a15-924237e3ed71-data\") pod \"postgres-69fb4594cf-q42lh\" (UID: \"404ca0f5-5c01-46a1-9a15-924237e3ed71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.212962 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.212943 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdkv\" (UniqueName: \"kubernetes.io/projected/404ca0f5-5c01-46a1-9a15-924237e3ed71-kube-api-access-xwdkv\") pod \"postgres-69fb4594cf-q42lh\" (UID: \"404ca0f5-5c01-46a1-9a15-924237e3ed71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.341489 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.341461 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:32.474875 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:32.474845 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q42lh"] Jul 14 20:33:32.478085 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:33:32.478055 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404ca0f5_5c01_46a1_9a15_924237e3ed71.slice/crio-005faf1f4ba00f955f3dac7cb75b438f94cc612df336c1f6ac9e4f51e0a08919 WatchSource:0}: Error finding container 005faf1f4ba00f955f3dac7cb75b438f94cc612df336c1f6ac9e4f51e0a08919: Status 404 returned error can't find the container with id 005faf1f4ba00f955f3dac7cb75b438f94cc612df336c1f6ac9e4f51e0a08919 Jul 14 20:33:33.477987 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:33.477950 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" event={"ID":"404ca0f5-5c01-46a1-9a15-924237e3ed71","Type":"ContainerStarted","Data":"005faf1f4ba00f955f3dac7cb75b438f94cc612df336c1f6ac9e4f51e0a08919"} Jul 14 20:33:37.499597 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:37.499512 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" event={"ID":"404ca0f5-5c01-46a1-9a15-924237e3ed71","Type":"ContainerStarted","Data":"8a9045acfe567cb3ad55f12c564398086fe70232abdbdaaf8a3c1640ff5185eb"} Jul 14 20:33:37.499597 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:37.499578 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:37.518886 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:37.518831 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" podStartSLOduration=0.828921934 podStartE2EDuration="5.518815871s" totalImagesPullingTime="4.689893937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:37.517917979 +0000 UTC m=+680.116558866" watchObservedRunningTime="2026-07-14 20:33:37.518815871 +0000 UTC m=+680.117456758" Jul 14 20:33:43.534534 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:43.534499 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q42lh" Jul 14 20:33:44.427039 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.427000 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d5b8fb479-dfphx"] Jul 14 20:33:44.435080 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.435050 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.436557 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.436531 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d5b8fb479-dfphx"] Jul 14 20:33:44.437123 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.437099 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 20:33:44.606951 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.606916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhtcn\" (UniqueName: \"kubernetes.io/projected/e0b58d52-b137-48a6-b145-2586b0c8e482-kube-api-access-vhtcn\") pod \"authorino-5d5b8fb479-dfphx\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.606951 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.606954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0b58d52-b137-48a6-b145-2586b0c8e482-tls-cert\") pod \"authorino-5d5b8fb479-dfphx\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.708500 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.708403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhtcn\" (UniqueName: \"kubernetes.io/projected/e0b58d52-b137-48a6-b145-2586b0c8e482-kube-api-access-vhtcn\") pod \"authorino-5d5b8fb479-dfphx\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.708500 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.708453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0b58d52-b137-48a6-b145-2586b0c8e482-tls-cert\") pod \"authorino-5d5b8fb479-dfphx\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.711128 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.711104 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0b58d52-b137-48a6-b145-2586b0c8e482-tls-cert\") pod \"authorino-5d5b8fb479-dfphx\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.717861 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.717842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhtcn\" (UniqueName: \"kubernetes.io/projected/e0b58d52-b137-48a6-b145-2586b0c8e482-kube-api-access-vhtcn\") pod \"authorino-5d5b8fb479-dfphx\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.745018 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.744974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:33:44.876656 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:44.876622 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d5b8fb479-dfphx"] Jul 14 20:33:44.880516 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:33:44.880482 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0b58d52_b137_48a6_b145_2586b0c8e482.slice/crio-1ed16e89ed1a05e2a6ed105265945196d14c1f4edd5cdb2982e9c5e269dea5f8 WatchSource:0}: Error finding container 1ed16e89ed1a05e2a6ed105265945196d14c1f4edd5cdb2982e9c5e269dea5f8: Status 404 returned error can't find the container with id 1ed16e89ed1a05e2a6ed105265945196d14c1f4edd5cdb2982e9c5e269dea5f8 Jul 14 20:33:45.537787 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:45.537684 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" event={"ID":"e0b58d52-b137-48a6-b145-2586b0c8e482","Type":"ContainerStarted","Data":"6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3"} Jul 14 20:33:45.537787 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:45.537733 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" event={"ID":"e0b58d52-b137-48a6-b145-2586b0c8e482","Type":"ContainerStarted","Data":"1ed16e89ed1a05e2a6ed105265945196d14c1f4edd5cdb2982e9c5e269dea5f8"} Jul 14 20:33:45.563688 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:45.563636 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" podStartSLOduration=1.237341918 podStartE2EDuration="1.563616794s" totalImagesPullingTime="326.274876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:45.562832261 +0000 UTC m=+688.161473147" watchObservedRunningTime="2026-07-14 20:33:45.563616794 +0000 UTC m=+688.162257682" Jul 14 20:33:45.605409 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:45.605349 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjm64"] Jul 14 20:33:45.605596 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:45.605550 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wjm64" podUID="15dfd1eb-627d-481e-9fd9-caef971def42" containerName="authorino" containerID="cri-o://5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b" gracePeriod=30 Jul 14 20:33:45.844725 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:45.844696 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:46.019578 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.019540 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqskf\" (UniqueName: \"kubernetes.io/projected/15dfd1eb-627d-481e-9fd9-caef971def42-kube-api-access-qqskf\") pod \"15dfd1eb-627d-481e-9fd9-caef971def42\" (UID: \"15dfd1eb-627d-481e-9fd9-caef971def42\") " Jul 14 20:33:46.021744 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.021715 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15dfd1eb-627d-481e-9fd9-caef971def42-kube-api-access-qqskf" (OuterVolumeSpecName: "kube-api-access-qqskf") pod "15dfd1eb-627d-481e-9fd9-caef971def42" (UID: "15dfd1eb-627d-481e-9fd9-caef971def42"). InnerVolumeSpecName "kube-api-access-qqskf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:33:46.120924 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.120847 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqskf\" (UniqueName: \"kubernetes.io/projected/15dfd1eb-627d-481e-9fd9-caef971def42-kube-api-access-qqskf\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:33:46.543581 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.543487 2554 generic.go:356] "Generic (PLEG): container finished" podID="15dfd1eb-627d-481e-9fd9-caef971def42" containerID="5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b" exitCode=0 Jul 14 20:33:46.543581 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.543534 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjm64" Jul 14 20:33:46.543805 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.543580 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjm64" event={"ID":"15dfd1eb-627d-481e-9fd9-caef971def42","Type":"ContainerDied","Data":"5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b"} Jul 14 20:33:46.543805 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.543624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjm64" event={"ID":"15dfd1eb-627d-481e-9fd9-caef971def42","Type":"ContainerDied","Data":"900e491d72251b815a4666d2525506ad67cf8b0b84af3b279b3f0052f3b80c05"} Jul 14 20:33:46.543805 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.543646 2554 scope.go:117] "RemoveContainer" containerID="5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b" Jul 14 20:33:46.552175 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.552160 2554 scope.go:117] "RemoveContainer" containerID="5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b" Jul 14 20:33:46.552477 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:33:46.552457 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b\": container with ID starting with 5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b not found: ID does not exist" containerID="5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b" Jul 14 20:33:46.552540 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.552486 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b"} err="failed to get container status \"5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b\": rpc error: code = NotFound desc = could not find container \"5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b\": container with ID starting with 5f5e9f33677b31d8410e54f7364b7cf44277f94607afcc9de06bf8431f9bac9b not found: ID does not exist" Jul 14 20:33:46.563902 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.563882 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjm64"] Jul 14 20:33:46.569942 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:46.569921 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjm64"] Jul 14 20:33:47.949155 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:47.949119 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15dfd1eb-627d-481e-9fd9-caef971def42" path="/var/lib/kubelet/pods/15dfd1eb-627d-481e-9fd9-caef971def42/volumes" Jul 14 20:33:50.601337 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.601297 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7664c789cd-zghsg"] Jul 14 20:33:50.601915 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.601765 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15dfd1eb-627d-481e-9fd9-caef971def42" containerName="authorino" Jul 14 20:33:50.601915 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.601781 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="15dfd1eb-627d-481e-9fd9-caef971def42" containerName="authorino" Jul 14 20:33:50.601915 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.601868 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="15dfd1eb-627d-481e-9fd9-caef971def42" containerName="authorino" Jul 14 20:33:50.606313 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.606291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:50.609798 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.609771 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 20:33:50.609946 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.609924 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 20:33:50.612153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.612134 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2zmfq\"" Jul 14 20:33:50.617691 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.617667 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7664c789cd-zghsg"] Jul 14 20:33:50.760432 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.760366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rfl\" (UniqueName: \"kubernetes.io/projected/62835d35-7a3d-40cf-942b-1a7454499b15-kube-api-access-d6rfl\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:50.760583 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.760510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:50.861541 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.861449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:50.861541 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.861503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rfl\" (UniqueName: \"kubernetes.io/projected/62835d35-7a3d-40cf-942b-1a7454499b15-kube-api-access-d6rfl\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:50.861756 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:33:50.861600 2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 14 20:33:50.861756 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:33:50.861667 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert podName:62835d35-7a3d-40cf-942b-1a7454499b15 nodeName:}" failed. No retries permitted until 2026-07-14 20:33:51.361650161 +0000 UTC m=+693.960291026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert") pod "maas-controller-7664c789cd-zghsg" (UID: "62835d35-7a3d-40cf-942b-1a7454499b15") : secret "maas-controller-webhook-cert" not found Jul 14 20:33:50.870038 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:50.870012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rfl\" (UniqueName: \"kubernetes.io/projected/62835d35-7a3d-40cf-942b-1a7454499b15-kube-api-access-d6rfl\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:51.365231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:51.365199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:51.367734 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:51.367714 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert\") pod \"maas-controller-7664c789cd-zghsg\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:51.517058 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:51.517020 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:51.651634 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:51.651545 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7664c789cd-zghsg"] Jul 14 20:33:51.654399 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:33:51.654346 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62835d35_7a3d_40cf_942b_1a7454499b15.slice/crio-01674f9c752b92c088f37f9164117e50763c0b52ecd80759c86587e96bacaca0 WatchSource:0}: Error finding container 01674f9c752b92c088f37f9164117e50763c0b52ecd80759c86587e96bacaca0: Status 404 returned error can't find the container with id 01674f9c752b92c088f37f9164117e50763c0b52ecd80759c86587e96bacaca0 Jul 14 20:33:52.574587 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:52.574550 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7664c789cd-zghsg" event={"ID":"62835d35-7a3d-40cf-942b-1a7454499b15","Type":"ContainerStarted","Data":"01674f9c752b92c088f37f9164117e50763c0b52ecd80759c86587e96bacaca0"} Jul 14 20:33:54.585769 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:54.585733 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7664c789cd-zghsg" event={"ID":"62835d35-7a3d-40cf-942b-1a7454499b15","Type":"ContainerStarted","Data":"1270556c08e2d06bfc7c4a7819866a2c4bae54755ccbaf91eb078ec0b80048da"} Jul 14 20:33:54.586222 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:54.585852 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:33:54.602522 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:33:54.602465 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7664c789cd-zghsg" podStartSLOduration=2.5547934960000003 podStartE2EDuration="4.602449034s" totalImagesPullingTime="2.047655538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:54.60167012 +0000 UTC m=+697.200311006" watchObservedRunningTime="2026-07-14 20:33:54.602449034 +0000 UTC m=+697.201089920" Jul 14 20:34:05.593697 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:05.593666 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:34:06.512742 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.512715 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7664c789cd-zghsg"] Jul 14 20:34:06.512914 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.512893 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7664c789cd-zghsg" podUID="62835d35-7a3d-40cf-942b-1a7454499b15" containerName="manager" containerID="cri-o://1270556c08e2d06bfc7c4a7819866a2c4bae54755ccbaf91eb078ec0b80048da" gracePeriod=30 Jul 14 20:34:06.640981 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.640945 2554 generic.go:356] "Generic (PLEG): container finished" podID="62835d35-7a3d-40cf-942b-1a7454499b15" containerID="1270556c08e2d06bfc7c4a7819866a2c4bae54755ccbaf91eb078ec0b80048da" exitCode=0 Jul 14 20:34:06.641309 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.641012 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7664c789cd-zghsg" event={"ID":"62835d35-7a3d-40cf-942b-1a7454499b15","Type":"ContainerDied","Data":"1270556c08e2d06bfc7c4a7819866a2c4bae54755ccbaf91eb078ec0b80048da"} Jul 14 20:34:06.807850 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.807813 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:34:06.888243 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.888210 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert\") pod \"62835d35-7a3d-40cf-942b-1a7454499b15\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " Jul 14 20:34:06.888447 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.888258 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6rfl\" (UniqueName: \"kubernetes.io/projected/62835d35-7a3d-40cf-942b-1a7454499b15-kube-api-access-d6rfl\") pod \"62835d35-7a3d-40cf-942b-1a7454499b15\" (UID: \"62835d35-7a3d-40cf-942b-1a7454499b15\") " Jul 14 20:34:06.890604 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.890557 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62835d35-7a3d-40cf-942b-1a7454499b15-kube-api-access-d6rfl" (OuterVolumeSpecName: "kube-api-access-d6rfl") pod "62835d35-7a3d-40cf-942b-1a7454499b15" (UID: "62835d35-7a3d-40cf-942b-1a7454499b15"). InnerVolumeSpecName "kube-api-access-d6rfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:34:06.890726 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.890660 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "62835d35-7a3d-40cf-942b-1a7454499b15" (UID: "62835d35-7a3d-40cf-942b-1a7454499b15"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:34:06.988965 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.988932 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62835d35-7a3d-40cf-942b-1a7454499b15-webhook-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:34:06.988965 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:06.988960 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6rfl\" (UniqueName: \"kubernetes.io/projected/62835d35-7a3d-40cf-942b-1a7454499b15-kube-api-access-d6rfl\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:34:07.646421 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:07.646365 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7664c789cd-zghsg" event={"ID":"62835d35-7a3d-40cf-942b-1a7454499b15","Type":"ContainerDied","Data":"01674f9c752b92c088f37f9164117e50763c0b52ecd80759c86587e96bacaca0"} Jul 14 20:34:07.646842 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:07.646446 2554 scope.go:117] "RemoveContainer" containerID="1270556c08e2d06bfc7c4a7819866a2c4bae54755ccbaf91eb078ec0b80048da" Jul 14 20:34:07.646842 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:07.646401 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7664c789cd-zghsg" Jul 14 20:34:07.670472 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:07.670443 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7664c789cd-zghsg"] Jul 14 20:34:07.674542 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:07.674519 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7664c789cd-zghsg"] Jul 14 20:34:07.943359 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:07.943252 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62835d35-7a3d-40cf-942b-1a7454499b15" path="/var/lib/kubelet/pods/62835d35-7a3d-40cf-942b-1a7454499b15/volumes" Jul 14 20:34:32.552962 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.552917 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6"] Jul 14 20:34:32.553455 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.553244 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62835d35-7a3d-40cf-942b-1a7454499b15" containerName="manager" Jul 14 20:34:32.553455 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.553255 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="62835d35-7a3d-40cf-942b-1a7454499b15" containerName="manager" Jul 14 20:34:32.553455 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.553329 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="62835d35-7a3d-40cf-942b-1a7454499b15" containerName="manager" Jul 14 20:34:32.557977 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.557953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.560439 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.560413 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 20:34:32.560439 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.560430 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-622ks\"" Jul 14 20:34:32.565195 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.565135 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6"] Jul 14 20:34:32.698471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.698429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d41b49-52bc-4e00-9e79-3b1faf179f74-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-4bxd6\" (UID: \"b9d41b49-52bc-4e00-9e79-3b1faf179f74\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.698471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.698474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwk55\" (UniqueName: \"kubernetes.io/projected/b9d41b49-52bc-4e00-9e79-3b1faf179f74-kube-api-access-vwk55\") pod \"payload-pre-processing-74584bb9f8-4bxd6\" (UID: \"b9d41b49-52bc-4e00-9e79-3b1faf179f74\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.799930 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.799892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d41b49-52bc-4e00-9e79-3b1faf179f74-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-4bxd6\" (UID: \"b9d41b49-52bc-4e00-9e79-3b1faf179f74\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.799930 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.799934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwk55\" (UniqueName: \"kubernetes.io/projected/b9d41b49-52bc-4e00-9e79-3b1faf179f74-kube-api-access-vwk55\") pod \"payload-pre-processing-74584bb9f8-4bxd6\" (UID: \"b9d41b49-52bc-4e00-9e79-3b1faf179f74\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.800628 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.800609 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d41b49-52bc-4e00-9e79-3b1faf179f74-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-4bxd6\" (UID: \"b9d41b49-52bc-4e00-9e79-3b1faf179f74\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.808171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.808111 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwk55\" (UniqueName: \"kubernetes.io/projected/b9d41b49-52bc-4e00-9e79-3b1faf179f74-kube-api-access-vwk55\") pod \"payload-pre-processing-74584bb9f8-4bxd6\" (UID: \"b9d41b49-52bc-4e00-9e79-3b1faf179f74\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:32.870587 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:32.870547 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:33.011716 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:33.011687 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6"] Jul 14 20:34:33.014571 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:34:33.014543 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d41b49_52bc_4e00_9e79_3b1faf179f74.slice/crio-26aff1cbb7eb3219819cac71bbf0c8e1322ed1dfdcb0a339585595abef39f34a WatchSource:0}: Error finding container 26aff1cbb7eb3219819cac71bbf0c8e1322ed1dfdcb0a339585595abef39f34a: Status 404 returned error can't find the container with id 26aff1cbb7eb3219819cac71bbf0c8e1322ed1dfdcb0a339585595abef39f34a Jul 14 20:34:33.763885 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:33.763841 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" event={"ID":"b9d41b49-52bc-4e00-9e79-3b1faf179f74","Type":"ContainerStarted","Data":"26aff1cbb7eb3219819cac71bbf0c8e1322ed1dfdcb0a339585595abef39f34a"} Jul 14 20:34:34.769694 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:34.769651 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" event={"ID":"b9d41b49-52bc-4e00-9e79-3b1faf179f74","Type":"ContainerStarted","Data":"6b6e161596046354710a364489f34d8a8d6c4595ae5f756b72ff883492ba6970"} Jul 14 20:34:34.770055 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:34.769752 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:34.786349 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:34.786294 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" podStartSLOduration=1.253764076 podStartE2EDuration="2.786276746s" totalImagesPullingTime="1.53251267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:34:34.7847442 +0000 UTC m=+737.383385087" watchObservedRunningTime="2026-07-14 20:34:34.786276746 +0000 UTC m=+737.384917632" Jul 14 20:34:45.776397 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:45.776357 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-4bxd6" Jul 14 20:34:54.109831 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.109789 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb"] Jul 14 20:34:54.113199 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.113181 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.116643 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.116617 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 20:34:54.116643 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.116637 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 20:34:54.116837 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.116770 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 20:34:54.116901 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.116876 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dmmcr\"" Jul 14 20:34:54.134257 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.134227 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb"] Jul 14 20:34:54.282403 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.282362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.282577 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.282454 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.282577 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.282485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.282577 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.282526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.282577 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.282547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.282739 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.282580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2lmw\" (UniqueName: \"kubernetes.io/projected/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-kube-api-access-g2lmw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.383819 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.383727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2lmw\" (UniqueName: \"kubernetes.io/projected/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-kube-api-access-g2lmw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.383819 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.383767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384048 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.383823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384048 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.383859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384048 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.383914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384048 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.383936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384308 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.384286 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384308 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.384301 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.384435 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.384351 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.386160 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.386144 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.386435 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.386418 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.393025 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.392977 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2lmw\" (UniqueName: \"kubernetes.io/projected/12e93538-3c1f-40dc-bfbd-7eb0fcde37b6-kube-api-access-g2lmw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb\" (UID: \"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.423593 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.423558 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:34:54.560001 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.559976 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb"] Jul 14 20:34:54.562175 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:34:54.562147 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e93538_3c1f_40dc_bfbd_7eb0fcde37b6.slice/crio-4dd1947af8ba42c86376917f471ba3b7b8539c1f618492443eb32c4dbb8dffb7 WatchSource:0}: Error finding container 4dd1947af8ba42c86376917f471ba3b7b8539c1f618492443eb32c4dbb8dffb7: Status 404 returned error can't find the container with id 4dd1947af8ba42c86376917f471ba3b7b8539c1f618492443eb32c4dbb8dffb7 Jul 14 20:34:54.563552 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.563532 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:34:54.861127 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:54.861091 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" event={"ID":"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6","Type":"ContainerStarted","Data":"4dd1947af8ba42c86376917f471ba3b7b8539c1f618492443eb32c4dbb8dffb7"} Jul 14 20:34:56.871403 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:56.871341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" event={"ID":"12e93538-3c1f-40dc-bfbd-7eb0fcde37b6","Type":"ContainerStarted","Data":"7b20c199e212b66577245c91665daf37580c0d8b58743d18b1e619bb2ba72ccf"} Jul 14 20:34:56.895715 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:34:56.895662 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" podStartSLOduration=1.5917235330000001 podStartE2EDuration="2.895646606s" totalImagesPullingTime="1.303923073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:34:56.893108226 +0000 UTC m=+759.491749114" watchObservedRunningTime="2026-07-14 20:34:56.895646606 +0000 UTC m=+759.494287493" Jul 14 20:35:04.423681 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:04.423648 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:35:04.424236 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:04.423742 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:35:04.436036 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:04.436016 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:35:04.924110 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:04.924083 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb" Jul 14 20:35:23.959430 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:23.959372 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc"] Jul 14 20:35:23.963138 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:23.963114 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:23.965537 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:23.965517 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 20:35:23.971278 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:23.971255 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc"] Jul 14 20:35:24.034068 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.034033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.034252 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.034076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.034252 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.034165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.034252 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.034194 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.034252 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.034238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e576cb91-055d-4bed-8d73-f17582b278fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.034498 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.034264 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77ct4\" (UniqueName: \"kubernetes.io/projected/e576cb91-055d-4bed-8d73-f17582b278fd-kube-api-access-77ct4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135048 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135010 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135048 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135050 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135303 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e576cb91-055d-4bed-8d73-f17582b278fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135303 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135137 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77ct4\" (UniqueName: \"kubernetes.io/projected/e576cb91-055d-4bed-8d73-f17582b278fd-kube-api-access-77ct4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135303 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135303 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135558 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135509 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135620 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135561 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.135671 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.135652 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.137655 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.137629 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e576cb91-055d-4bed-8d73-f17582b278fd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.137887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.137868 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e576cb91-055d-4bed-8d73-f17582b278fd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.144253 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.144225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77ct4\" (UniqueName: \"kubernetes.io/projected/e576cb91-055d-4bed-8d73-f17582b278fd-kube-api-access-77ct4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc\" (UID: \"e576cb91-055d-4bed-8d73-f17582b278fd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.274214 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.274119 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:24.418315 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:24.418291 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc"] Jul 14 20:35:24.420901 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:35:24.420872 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode576cb91_055d_4bed_8d73_f17582b278fd.slice/crio-9e936913d183274562d829593f9f2f6508da12f783ea683ce65fe5f3f1ff98d7 WatchSource:0}: Error finding container 9e936913d183274562d829593f9f2f6508da12f783ea683ce65fe5f3f1ff98d7: Status 404 returned error can't find the container with id 9e936913d183274562d829593f9f2f6508da12f783ea683ce65fe5f3f1ff98d7 Jul 14 20:35:25.004725 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:25.004642 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" event={"ID":"e576cb91-055d-4bed-8d73-f17582b278fd","Type":"ContainerStarted","Data":"3d362aa01bb4124bf85e8600c60a66586fa949c0f88cc0d4bbb744e6042e54d8"} Jul 14 20:35:25.004725 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:25.004696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" event={"ID":"e576cb91-055d-4bed-8d73-f17582b278fd","Type":"ContainerStarted","Data":"9e936913d183274562d829593f9f2f6508da12f783ea683ce65fe5f3f1ff98d7"} Jul 14 20:35:25.038153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:25.038099 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" podStartSLOduration=1.843219002 podStartE2EDuration="2.038077482s" totalImagesPullingTime="194.85848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:35:25.03671397 +0000 UTC m=+787.635354859" watchObservedRunningTime="2026-07-14 20:35:25.038077482 +0000 UTC m=+787.636718392" Jul 14 20:35:34.275092 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:34.275054 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:34.275542 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:34.275120 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:34.287503 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:34.287480 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:35.061241 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:35.061206 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc" Jul 14 20:35:39.058025 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.057949 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f"] Jul 14 20:35:39.063438 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.063415 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.065456 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.065434 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 20:35:39.073762 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.073741 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f"] Jul 14 20:35:39.164071 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.164042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.164266 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.164078 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.164266 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.164095 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9867eea-aeed-4291-96c9-2e04df91bc46-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.164266 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.164165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7pm\" (UniqueName: \"kubernetes.io/projected/f9867eea-aeed-4291-96c9-2e04df91bc46-kube-api-access-dc7pm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.164266 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.164216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.164266 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.164243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265080 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265041 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265080 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265320 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9867eea-aeed-4291-96c9-2e04df91bc46-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265320 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7pm\" (UniqueName: \"kubernetes.io/projected/f9867eea-aeed-4291-96c9-2e04df91bc46-kube-api-access-dc7pm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265320 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265320 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265571 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265546 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265639 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265573 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.265639 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.265620 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.267520 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.267500 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9867eea-aeed-4291-96c9-2e04df91bc46-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.267873 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.267852 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9867eea-aeed-4291-96c9-2e04df91bc46-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.273672 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.273650 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7pm\" (UniqueName: \"kubernetes.io/projected/f9867eea-aeed-4291-96c9-2e04df91bc46-kube-api-access-dc7pm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4mt6f\" (UID: \"f9867eea-aeed-4291-96c9-2e04df91bc46\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.374947 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.374910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:39.515501 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:39.515470 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f"] Jul 14 20:35:39.518348 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:35:39.518317 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9867eea_aeed_4291_96c9_2e04df91bc46.slice/crio-31906acd12eb42343d59210b79131b79f34374ee8a310545736e994e6aa38d70 WatchSource:0}: Error finding container 31906acd12eb42343d59210b79131b79f34374ee8a310545736e994e6aa38d70: Status 404 returned error can't find the container with id 31906acd12eb42343d59210b79131b79f34374ee8a310545736e994e6aa38d70 Jul 14 20:35:40.074098 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:40.074056 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" event={"ID":"f9867eea-aeed-4291-96c9-2e04df91bc46","Type":"ContainerStarted","Data":"fde096602c5f72cc8d32ad5a65dee73a5039d2e3548db2d4b6e109ef6cf5c988"} Jul 14 20:35:40.074572 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:40.074114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" event={"ID":"f9867eea-aeed-4291-96c9-2e04df91bc46","Type":"ContainerStarted","Data":"31906acd12eb42343d59210b79131b79f34374ee8a310545736e994e6aa38d70"} Jul 14 20:35:40.095079 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:40.095024 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" podStartSLOduration=0.892073199 podStartE2EDuration="1.095007991s" totalImagesPullingTime="202.934792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:35:40.093845769 +0000 UTC m=+802.692486656" watchObservedRunningTime="2026-07-14 20:35:40.095007991 +0000 UTC m=+802.693648877" Jul 14 20:35:49.375773 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:49.375731 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:49.376254 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:49.375813 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:49.388241 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:49.388216 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:50.137428 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:50.137393 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4mt6f" Jul 14 20:35:50.981465 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:50.981429 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v"] Jul 14 20:35:50.985033 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:50.985016 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:50.987502 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:50.987480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 20:35:50.993359 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:50.993333 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v"] Jul 14 20:35:51.168864 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.168831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.169023 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.168873 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9m7q\" (UniqueName: \"kubernetes.io/projected/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-kube-api-access-n9m7q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.169023 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.168957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.169023 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.168991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.169023 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.169014 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.169159 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.169053 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.270529 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.270439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.270529 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.270481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.270529 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.270517 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.270788 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.270574 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.270788 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.270634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.270788 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.270667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9m7q\" (UniqueName: \"kubernetes.io/projected/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-kube-api-access-n9m7q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.271111 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.271080 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.271444 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.271138 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.271444 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.271207 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.272943 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.272922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.273322 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.273300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.283037 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.283009 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9m7q\" (UniqueName: \"kubernetes.io/projected/fcab7186-e0e5-48f6-8ad7-8da2594bcc37-kube-api-access-n9m7q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v\" (UID: \"fcab7186-e0e5-48f6-8ad7-8da2594bcc37\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.294988 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.294961 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:35:51.438000 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:51.437969 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v"] Jul 14 20:35:51.440379 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:35:51.440355 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcab7186_e0e5_48f6_8ad7_8da2594bcc37.slice/crio-dd96d23870551b138e899cef4ca10ff277eecfdcfccd148c3d87f41478df759a WatchSource:0}: Error finding container dd96d23870551b138e899cef4ca10ff277eecfdcfccd148c3d87f41478df759a: Status 404 returned error can't find the container with id dd96d23870551b138e899cef4ca10ff277eecfdcfccd148c3d87f41478df759a Jul 14 20:35:52.136476 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:52.136442 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" event={"ID":"fcab7186-e0e5-48f6-8ad7-8da2594bcc37","Type":"ContainerStarted","Data":"7e3fdc0683a68a0fdd7fac5814215d036e2e84b2feade0e59c65c31b859fdb02"} Jul 14 20:35:52.136881 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:52.136486 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" event={"ID":"fcab7186-e0e5-48f6-8ad7-8da2594bcc37","Type":"ContainerStarted","Data":"dd96d23870551b138e899cef4ca10ff277eecfdcfccd148c3d87f41478df759a"} Jul 14 20:35:52.156086 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:35:52.156026 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" podStartSLOduration=1.9766614489999998 podStartE2EDuration="2.156009565s" totalImagesPullingTime="179.348116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:35:52.153876102 +0000 UTC m=+814.752516988" watchObservedRunningTime="2026-07-14 20:35:52.156009565 +0000 UTC m=+814.754650452" Jul 14 20:36:01.295297 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:36:01.295249 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:36:01.295297 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:36:01.295304 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:36:01.308041 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:36:01.308012 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:36:02.203103 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:36:02.203071 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v" Jul 14 20:37:02.147485 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.147442 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d5b8fb479-dfphx"] Jul 14 20:37:02.148153 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.147646 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" podUID="e0b58d52-b137-48a6-b145-2586b0c8e482" containerName="authorino" containerID="cri-o://6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3" gracePeriod=30 Jul 14 20:37:02.413188 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.413158 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:37:02.482159 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.482115 2554 generic.go:356] "Generic (PLEG): container finished" podID="e0b58d52-b137-48a6-b145-2586b0c8e482" containerID="6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3" exitCode=0 Jul 14 20:37:02.482159 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.482163 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" Jul 14 20:37:02.482457 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.482203 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" event={"ID":"e0b58d52-b137-48a6-b145-2586b0c8e482","Type":"ContainerDied","Data":"6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3"} Jul 14 20:37:02.482457 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.482253 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5b8fb479-dfphx" event={"ID":"e0b58d52-b137-48a6-b145-2586b0c8e482","Type":"ContainerDied","Data":"1ed16e89ed1a05e2a6ed105265945196d14c1f4edd5cdb2982e9c5e269dea5f8"} Jul 14 20:37:02.482457 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.482271 2554 scope.go:117] "RemoveContainer" containerID="6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3" Jul 14 20:37:02.491616 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.491593 2554 scope.go:117] "RemoveContainer" containerID="6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3" Jul 14 20:37:02.491694 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.491634 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhtcn\" (UniqueName: \"kubernetes.io/projected/e0b58d52-b137-48a6-b145-2586b0c8e482-kube-api-access-vhtcn\") pod \"e0b58d52-b137-48a6-b145-2586b0c8e482\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " Jul 14 20:37:02.491752 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.491703 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0b58d52-b137-48a6-b145-2586b0c8e482-tls-cert\") pod \"e0b58d52-b137-48a6-b145-2586b0c8e482\" (UID: \"e0b58d52-b137-48a6-b145-2586b0c8e482\") " Jul 14 20:37:02.491938 ip-10-0-142-126 kubenswrapper[2554]: E0714 20:37:02.491910 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3\": container with ID starting with 6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3 not found: ID does not exist" containerID="6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3" Jul 14 20:37:02.491996 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.491947 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3"} err="failed to get container status \"6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3\": rpc error: code = NotFound desc = could not find container \"6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3\": container with ID starting with 6564f6ace3a5de0f1a5b04326de3b7741c669308ffd62f07348c5c04b5b228c3 not found: ID does not exist" Jul 14 20:37:02.493843 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.493817 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b58d52-b137-48a6-b145-2586b0c8e482-kube-api-access-vhtcn" (OuterVolumeSpecName: "kube-api-access-vhtcn") pod "e0b58d52-b137-48a6-b145-2586b0c8e482" (UID: "e0b58d52-b137-48a6-b145-2586b0c8e482"). InnerVolumeSpecName "kube-api-access-vhtcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:37:02.502565 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.502533 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0b58d52-b137-48a6-b145-2586b0c8e482-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e0b58d52-b137-48a6-b145-2586b0c8e482" (UID: "e0b58d52-b137-48a6-b145-2586b0c8e482"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:37:02.593171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.593130 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhtcn\" (UniqueName: \"kubernetes.io/projected/e0b58d52-b137-48a6-b145-2586b0c8e482-kube-api-access-vhtcn\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:37:02.593171 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.593162 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0b58d52-b137-48a6-b145-2586b0c8e482-tls-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\"" Jul 14 20:37:02.808284 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.808251 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d5b8fb479-dfphx"] Jul 14 20:37:02.814687 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:02.814648 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d5b8fb479-dfphx"] Jul 14 20:37:03.944184 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:03.944149 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b58d52-b137-48a6-b145-2586b0c8e482" path="/var/lib/kubelet/pods/e0b58d52-b137-48a6-b145-2586b0c8e482/volumes" Jul 14 20:37:17.812515 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:17.812489 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:37:17.818984 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:37:17.818964 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:42:05.098892 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:05.098857 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g48sm_3b368309-744d-4500-a717-e9dbb2a2c168/manager/0.log" Jul 14 20:42:05.219418 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:05.219368 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9rtxg_076f86d7-b9b3-42f5-83f2-84d86fe83f81/manager/0.log" Jul 14 20:42:05.496402 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:05.496284 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zz56b_a76b7a6b-7fba-40f0-ac84-2cf36713d68f/server/0.log" Jul 14 20:42:05.620798 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:05.620753 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-v54vn_cf46b6cf-c65c-4373-af10-34325c36cd92/manager/0.log" Jul 14 20:42:05.746319 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:05.746293 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-4xhgg_c1f47b6b-cdc5-4985-98c8-4f31d822e179/copy-manifests/0.log" Jul 14 20:42:05.758936 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:05.758857 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-4xhgg_c1f47b6b-cdc5-4985-98c8-4f31d822e179/manager/0.log" Jul 14 20:42:06.508652 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:06.508611 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-q42lh_404ca0f5-5c01-46a1-9a15-924237e3ed71/postgres/0.log" Jul 14 20:42:08.023311 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:08.023274 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fggkh_b5c8ea1f-a553-4e1d-b17e-92d7533feefb/manager/0.log" Jul 14 20:42:08.152789 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:08.152761 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6h9sj_e1a069cf-f96f-49f2-ae92-87cf138605c8/manager/0.log" Jul 14 20:42:08.393197 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:08.393163 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qr4mw_71a6834f-0cce-4b0c-b177-94883344caaf/registry-server/0.log" Jul 14 20:42:08.531267 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:08.531239 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-krprp_294a31b4-c2e0-41dd-a19c-b310009b5542/manager/0.log" Jul 14 20:42:08.803028 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:08.802954 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gh45g_5cf27db3-cf40-4475-9628-26bc66aaada8/manager/0.log" Jul 14 20:42:09.411890 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:09.411856 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-2rl8z_e31e9048-74c8-4974-83b8-7c80927cbccd/kube-auth-proxy/0.log" Jul 14 20:42:09.790775 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:09.790697 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4bxd6_b9d41b49-52bc-4e00-9e79-3b1faf179f74/payload-pre-processing/0.log" Jul 14 20:42:10.401447 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:10.401414 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-l5nbb_12e93538-3c1f-40dc-bfbd-7eb0fcde37b6/main/0.log" Jul 14 20:42:10.759514 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:10.759434 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbqfjlc_e576cb91-055d-4bed-8d73-f17582b278fd/main/0.log" Jul 14 20:42:10.884330 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:10.884297 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4mt6f_f9867eea-aeed-4291-96c9-2e04df91bc46/main/0.log" Jul 14 20:42:11.001247 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:11.001221 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-4t27v_fcab7186-e0e5-48f6-8ad7-8da2594bcc37/main/0.log" Jul 14 20:42:17.840887 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:17.840861 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:42:17.843851 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:17.843829 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4xvz_89fc4adf-92d6-42ae-9a49-e8641dce4259/ovn-acl-logging/0.log" Jul 14 20:42:18.299073 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:18.299001 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zvrfm_58868e63-1ff3-4fa3-9718-5556fcdb6ed4/global-pull-secret-syncer/0.log" Jul 14 20:42:18.403121 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:18.403087 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vxpjb_df969df9-2c73-4d56-a77f-b1a610ef4062/konnectivity-agent/0.log" Jul 14 20:42:18.469575 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:18.469546 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-126.ec2.internal_0679c59103ee362599b21375dbd0b93a/haproxy/0.log" Jul 14 20:42:23.421888 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:23.421854 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fggkh_b5c8ea1f-a553-4e1d-b17e-92d7533feefb/manager/0.log" Jul 14 20:42:23.455786 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:23.455764 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6h9sj_e1a069cf-f96f-49f2-ae92-87cf138605c8/manager/0.log" Jul 14 20:42:23.525787 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:23.525760 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qr4mw_71a6834f-0cce-4b0c-b177-94883344caaf/registry-server/0.log" Jul 14 20:42:23.582607 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:23.582575 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-krprp_294a31b4-c2e0-41dd-a19c-b310009b5542/manager/0.log" Jul 14 20:42:23.688605 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:23.688525 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gh45g_5cf27db3-cf40-4475-9628-26bc66aaada8/manager/0.log" Jul 14 20:42:25.879787 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:25.879762 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-swbxs_a3d909c0-befa-4934-af91-008492afeef8/node-exporter/0.log" Jul 14 20:42:25.907471 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:25.907436 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-swbxs_a3d909c0-befa-4934-af91-008492afeef8/kube-rbac-proxy/0.log" Jul 14 20:42:25.930090 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:25.930019 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-swbxs_a3d909c0-befa-4934-af91-008492afeef8/init-textfile/0.log" Jul 14 20:42:28.845218 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.845183 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq"] Jul 14 20:42:28.845622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.845529 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b58d52-b137-48a6-b145-2586b0c8e482" containerName="authorino" Jul 14 20:42:28.845622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.845540 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b58d52-b137-48a6-b145-2586b0c8e482" containerName="authorino" Jul 14 20:42:28.845622 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.845612 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0b58d52-b137-48a6-b145-2586b0c8e482" containerName="authorino" Jul 14 20:42:28.848478 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.848458 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:28.850737 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.850713 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k7rsc\"/\"default-dockercfg-cqb4f\"" Jul 14 20:42:28.850861 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.850792 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7rsc\"/\"openshift-service-ca.crt\"" Jul 14 20:42:28.851274 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.851259 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7rsc\"/\"kube-root-ca.crt\"" Jul 14 20:42:28.864231 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.864210 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq"] Jul 14 20:42:28.946433 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.946400 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-proc\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:28.946601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.946459 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-sys\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:28.946601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.946493 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jsrk\" (UniqueName: \"kubernetes.io/projected/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-kube-api-access-4jsrk\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:28.946601 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.946526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-lib-modules\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:28.946725 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:28.946605 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-podres\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-sys\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047196 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jsrk\" (UniqueName: \"kubernetes.io/projected/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-kube-api-access-4jsrk\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047214 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-lib-modules\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047250 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-podres\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-proc\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047293 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-sys\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-proc\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047457 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-lib-modules\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.047479 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.047464 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-podres\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.055272 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.055244 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jsrk\" (UniqueName: \"kubernetes.io/projected/b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532-kube-api-access-4jsrk\") pod \"perf-node-gather-daemonset-z7zhq\" (UID: \"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.158532 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.158449 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:29.296307 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.296287 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq"] Jul 14 20:42:29.298657 ip-10-0-142-126 kubenswrapper[2554]: W0714 20:42:29.298623 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb07ccc8b_1f28_4e79_9fb5_f3bc09a1c532.slice/crio-0c5521cd80745abc8252ba4384c2c88f9da4864f581d0fc36fe12dd9a880899f WatchSource:0}: Error finding container 0c5521cd80745abc8252ba4384c2c88f9da4864f581d0fc36fe12dd9a880899f: Status 404 returned error can't find the container with id 0c5521cd80745abc8252ba4384c2c88f9da4864f581d0fc36fe12dd9a880899f Jul 14 20:42:29.989143 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.989108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" event={"ID":"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532","Type":"ContainerStarted","Data":"6bf01f65180d32024a9c6577854bb4fbcfbb86ae51d0fe82f5a38886ce1ed95e"} Jul 14 20:42:29.989558 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.989181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" event={"ID":"b07ccc8b-1f28-4e79-9fb5-f3bc09a1c532","Type":"ContainerStarted","Data":"0c5521cd80745abc8252ba4384c2c88f9da4864f581d0fc36fe12dd9a880899f"} Jul 14 20:42:29.989558 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:29.989230 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:30.006745 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:30.006699 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" podStartSLOduration=2.006684306 podStartE2EDuration="2.006684306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:42:30.00504552 +0000 UTC m=+1212.603686409" watchObservedRunningTime="2026-07-14 20:42:30.006684306 +0000 UTC m=+1212.605325193" Jul 14 20:42:30.765845 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:30.765788 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dt9w2_b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a/dns/0.log" Jul 14 20:42:30.788996 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:30.788966 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dt9w2_b3e32190-ffd7-4c7d-a5e5-ea3a8c912e1a/kube-rbac-proxy/0.log" Jul 14 20:42:30.971079 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:30.971054 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fx65n_5c1481c8-8059-40fe-909a-eb82c84c5277/dns-node-resolver/0.log" Jul 14 20:42:31.526891 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:31.526860 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c6d88dc5b-djzcx_889f6169-b41f-40e6-87fc-2566fb23e8ed/registry/0.log" Jul 14 20:42:31.530179 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:31.530159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c6d88dc5b-djzcx_889f6169-b41f-40e6-87fc-2566fb23e8ed/registry/1.log" Jul 14 20:42:31.597737 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:31.597712 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsw9t_536265ff-3cd8-4d94-8485-20d3cd72eced/node-ca/0.log" Jul 14 20:42:32.652641 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:32.652594 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-2rl8z_e31e9048-74c8-4974-83b8-7c80927cbccd/kube-auth-proxy/0.log" Jul 14 20:42:32.747363 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:32.747337 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4bxd6_b9d41b49-52bc-4e00-9e79-3b1faf179f74/payload-pre-processing/0.log" Jul 14 20:42:33.485876 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:33.485850 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9w7t_01589a17-ecf0-4d1a-9293-8e2c10d3104e/serve-healthcheck-canary/0.log" Jul 14 20:42:34.115667 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:34.115631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brjnj_cdad253a-3df9-4462-9bca-dc4871b6ab4c/kube-rbac-proxy/0.log" Jul 14 20:42:34.137905 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:34.137879 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brjnj_cdad253a-3df9-4462-9bca-dc4871b6ab4c/exporter/0.log" Jul 14 20:42:34.161819 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:34.161788 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brjnj_cdad253a-3df9-4462-9bca-dc4871b6ab4c/extractor/0.log" Jul 14 20:42:36.004026 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.004002 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-z7zhq" Jul 14 20:42:36.360253 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.360224 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g48sm_3b368309-744d-4500-a717-e9dbb2a2c168/manager/0.log" Jul 14 20:42:36.402536 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.402505 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9rtxg_076f86d7-b9b3-42f5-83f2-84d86fe83f81/manager/0.log" Jul 14 20:42:36.454065 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.454039 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zz56b_a76b7a6b-7fba-40f0-ac84-2cf36713d68f/server/0.log" Jul 14 20:42:36.501911 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.501885 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-v54vn_cf46b6cf-c65c-4373-af10-34325c36cd92/manager/0.log" Jul 14 20:42:36.545273 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.545239 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-4xhgg_c1f47b6b-cdc5-4985-98c8-4f31d822e179/manager/0.log" Jul 14 20:42:36.563786 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:36.563764 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-4xhgg_c1f47b6b-cdc5-4985-98c8-4f31d822e179/copy-manifests/0.log" Jul 14 20:42:38.030418 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:38.030378 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-82kh4_2a58af80-d4e0-4bc5-9311-393b12428fd1/openshift-lws-operator/0.log" Jul 14 20:42:38.928167 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:38.928141 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-2rl8z_e31e9048-74c8-4974-83b8-7c80927cbccd/kube-auth-proxy/0.log" Jul 14 20:42:38.996586 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:38.996555 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4bxd6_b9d41b49-52bc-4e00-9e79-3b1faf179f74/payload-pre-processing/0.log" Jul 14 20:42:40.195076 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:40.195040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-2rl8z_e31e9048-74c8-4974-83b8-7c80927cbccd/kube-auth-proxy/0.log" Jul 14 20:42:40.280463 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:40.280428 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-4bxd6_b9d41b49-52bc-4e00-9e79-3b1faf179f74/payload-pre-processing/0.log" Jul 14 20:42:44.775030 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:44.775001 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-424v2_4fc4b5b7-e034-4904-8bad-5b662e7d7ce2/kube-multus/0.log" Jul 14 20:42:45.130311 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.130282 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/kube-multus-additional-cni-plugins/0.log" Jul 14 20:42:45.151413 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.151361 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/egress-router-binary-copy/0.log" Jul 14 20:42:45.172904 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.172868 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/cni-plugins/0.log" Jul 14 20:42:45.196271 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.196241 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/bond-cni-plugin/0.log" Jul 14 20:42:45.217858 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.217825 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/routeoverride-cni/0.log" Jul 14 20:42:45.238685 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.238654 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/whereabouts-cni-bincopy/0.log" Jul 14 20:42:45.269503 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.269471 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zhrq2_291a6005-dc24-4df7-abb0-bd8804f470f4/whereabouts-cni/0.log" Jul 14 20:42:45.324500 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.324472 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h97zl_db5f757b-0173-4981-b061-0bccac8ef3e5/network-metrics-daemon/0.log" Jul 14 20:42:45.345663 ip-10-0-142-126 kubenswrapper[2554]: I0714 20:42:45.345621 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h97zl_db5f757b-0173-4981-b061-0bccac8ef3e5/kube-rbac-proxy/0.log"