Jul 08 11:13:18.954832 ip-10-0-139-193 systemd[1]: Starting Kubernetes Kubelet... Jul 08 11:13:19.328196 ip-10-0-139-193 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 11:13:19.328196 ip-10-0-139-193 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 11:13:19.328196 ip-10-0-139-193 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 11:13:19.328196 ip-10-0-139-193 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 11:13:19.328196 ip-10-0-139-193 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 11:13:19.330460 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.330371 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 11:13:19.334750 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334735 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 11:13:19.334750 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334750 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334753 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334756 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334759 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334761 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334764 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334767 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334770 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334772 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334775 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334777 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334780 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334782 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334785 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334789 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334793 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334796 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334798 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334801 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334810 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 11:13:19.334818 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334813 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334815 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334818 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334820 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334823 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334826 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334829 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334832 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334835 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334837 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334840 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334842 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334844 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334848 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334852 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334855 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334857 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334860 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334863 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334865 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 11:13:19.335295 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334868 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334870 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334873 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334876 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334880 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334884 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334886 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334889 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334892 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334894 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334897 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334899 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334901 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334904 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334907 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334910 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334913 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334915 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334918 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 11:13:19.335786 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334920 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334922 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334925 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334927 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334930 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334932 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334935 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334938 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334940 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334942 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334945 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334947 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334950 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334952 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334955 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334957 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334965 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334968 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334970 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334973 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 11:13:19.336281 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334975 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334983 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334987 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334990 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334992 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334995 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.334997 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335001 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335004 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335006 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335009 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335011 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335014 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335016 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335019 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335021 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335023 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335026 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335028 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335739 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 11:13:19.336789 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335746 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335749 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335751 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335754 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335757 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335760 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335762 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335765 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335767 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335770 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335773 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335775 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335778 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335781 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335784 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335787 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335789 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335792 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335795 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335798 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 11:13:19.337265 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335801 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335804 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335806 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335809 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335812 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335815 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335818 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335820 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335823 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335825 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335828 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335830 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335833 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335835 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335837 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335840 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335842 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335845 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335847 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335850 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 11:13:19.337767 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335852 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335855 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335858 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335860 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335864 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335868 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335871 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335875 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335878 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335880 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335883 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335888 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335890 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335893 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335897 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335901 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335903 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335906 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 11:13:19.338254 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335908 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335911 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335913 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335916 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335918 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335920 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335923 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335925 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335927 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335930 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335932 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335935 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335937 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335940 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335942 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335945 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335948 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335952 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335954 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335957 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 11:13:19.338738 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335959 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335962 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335964 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335966 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335968 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335971 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335973 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335976 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335978 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335980 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335983 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335985 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335988 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335990 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335993 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335995 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.335998 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336002 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336005 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 11:13:19.339223 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336371 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336375 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336378 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336381 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336384 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336387 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336390 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336393 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336397 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336400 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336403 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336406 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336410 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336413 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336417 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336419 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336422 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336425 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336428 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 11:13:19.339693 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336430 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336433 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336435 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336437 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336440 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336442 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336445 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336447 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336450 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336452 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336455 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336457 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336459 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336462 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336464 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336467 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336469 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336472 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336476 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336479 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 11:13:19.340136 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336481 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336484 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336486 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336491 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336494 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336496 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336498 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336501 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336503 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336524 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336528 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336532 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336536 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336540 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336543 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336546 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336548 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336551 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336553 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336556 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 11:13:19.340655 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336559 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336562 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336564 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336567 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336569 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336572 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336574 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336576 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336579 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336582 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336584 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336587 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336589 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336592 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336594 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336598 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336602 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336605 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336608 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336611 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 11:13:19.341150 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336613 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336615 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336619 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336622 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336625 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336628 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336631 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336633 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336636 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336638 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336640 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336643 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336645 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336648 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336650 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336653 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336655 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336658 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336660 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 11:13:19.341649 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.336662 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336733 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336739 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336745 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336750 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336754 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336757 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336761 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336767 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336770 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336773 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336777 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336780 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336783 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336786 2563 flags.go:64] FLAG: --cgroup-root="" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336789 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336792 2563 flags.go:64] FLAG: --client-ca-file="" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336795 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336798 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336802 2563 flags.go:64] FLAG: --cluster-domain="" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336805 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336808 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336811 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336814 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 11:13:19.342201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336817 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336820 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336823 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336826 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336829 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336832 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336835 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336838 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336841 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336845 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336847 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336850 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336855 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336858 2563 flags.go:64] FLAG: --enable-server="true" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336861 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336864 2563 flags.go:64] FLAG: --event-burst="100" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336868 2563 flags.go:64] FLAG: --event-qps="50" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336871 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336874 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336878 2563 flags.go:64] FLAG: --eviction-hard="" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336881 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336884 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336887 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336890 2563 flags.go:64] FLAG: --eviction-soft="" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336892 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 11:13:19.342783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336895 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336898 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336901 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336903 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336906 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336909 2563 flags.go:64] FLAG: --feature-gates="" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336912 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336915 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336918 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336920 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336923 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336926 2563 flags.go:64] FLAG: --help="false" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336929 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336932 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336935 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336937 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336941 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336944 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336947 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336951 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336954 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336957 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336959 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336963 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 11:13:19.343408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336965 2563 flags.go:64] FLAG: --kube-reserved="" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336968 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336971 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336974 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336977 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336980 2563 flags.go:64] FLAG: --lock-file="" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336982 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336985 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336988 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336993 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336996 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.336998 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337001 2563 flags.go:64] FLAG: --logging-format="text" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337003 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337007 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337009 2563 flags.go:64] FLAG: --manifest-url="" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337012 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337016 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337019 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337023 2563 flags.go:64] FLAG: --max-pods="110" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337025 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337028 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337031 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337034 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337036 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 11:13:19.344055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337039 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337042 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337050 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337053 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337056 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337059 2563 flags.go:64] FLAG: --pod-cidr="" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337061 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337066 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337069 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337072 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337075 2563 flags.go:64] FLAG: --port="10250" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337078 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337081 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f2caa2f9b9ab32b" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337084 2563 flags.go:64] FLAG: --qos-reserved="" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337087 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337089 2563 flags.go:64] FLAG: --register-node="true" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337092 2563 flags.go:64] FLAG: --register-with-taints="" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337096 2563 flags.go:64] FLAG: --registry-burst="10" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337099 2563 flags.go:64] FLAG: --registry-qps="5" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337102 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337104 2563 flags.go:64] FLAG: --reserved-memory="" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337107 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337110 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337113 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337116 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 11:13:19.344923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337118 2563 flags.go:64] FLAG: --runonce="false" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337121 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337124 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337127 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337130 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337132 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337135 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337139 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337141 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337146 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337149 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337152 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337154 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337158 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337160 2563 flags.go:64] FLAG: --system-cgroups="" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337163 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337168 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337170 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337173 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337178 2563 flags.go:64] FLAG: --tls-min-version="" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337180 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337183 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337186 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337189 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337191 2563 flags.go:64] FLAG: --v="2" Jul 08 11:13:19.345747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337195 2563 flags.go:64] FLAG: --version="false" Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337199 2563 flags.go:64] FLAG: --vmodule="" Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337202 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.337206 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337317 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337321 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337323 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337326 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337328 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337331 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337334 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337336 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337339 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337342 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337346 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337348 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337352 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337356 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337358 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337361 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 11:13:19.346358 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337363 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337365 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337368 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337370 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337374 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337378 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337381 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337384 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337387 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337389 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337392 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337394 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337396 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337399 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337401 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337404 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337406 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337409 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337412 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337414 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 11:13:19.346854 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337417 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337419 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337422 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337424 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337426 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337429 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337432 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337434 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337438 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337441 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337444 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337446 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337449 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337451 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337454 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337456 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337459 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337461 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337464 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 11:13:19.347340 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337467 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337471 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337474 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337477 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337480 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337483 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337485 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337488 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337490 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337492 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337495 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337497 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337500 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337502 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337520 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337522 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337525 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337527 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337530 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 11:13:19.347883 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337532 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337535 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337539 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337542 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337545 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337547 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337550 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337553 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337555 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337558 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337561 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337563 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337566 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337568 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337571 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337574 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337577 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337579 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337581 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337584 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 11:13:19.348342 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337586 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337589 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337592 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337594 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.337597 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.338704 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.346879 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.346894 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.346913 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.346919 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346975 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346979 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346983 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346987 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 11:13:19.348847 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346989 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346993 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346995 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.346998 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347003 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347006 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347009 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347012 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347015 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347017 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347020 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347022 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347025 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347027 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347030 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347032 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347035 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347038 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347045 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347048 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 11:13:19.349201 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347051 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347054 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347056 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347059 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347061 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347064 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347067 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347070 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347072 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347075 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347077 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347080 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347082 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347085 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347088 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347090 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347092 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347095 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347097 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347100 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 11:13:19.349694 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347102 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347105 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347107 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347109 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347112 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347114 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347117 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347119 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347122 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347125 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347129 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347131 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347134 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347136 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347139 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347142 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347144 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347147 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347150 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347152 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 11:13:19.350222 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347155 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347157 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347160 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347162 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347164 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347167 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347169 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347173 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347176 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347179 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347181 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347184 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347186 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347189 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347191 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347196 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347200 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347211 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347214 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 11:13:19.350716 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347216 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347219 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347222 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347224 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347227 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347229 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347232 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347234 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347236 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347239 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347242 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347244 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347247 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347249 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347251 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 11:13:19.351175 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347254 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.347259 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347388 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347394 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347397 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347400 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347403 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347406 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347409 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347411 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347414 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347417 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347419 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347422 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347426 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 11:13:19.351557 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347428 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347431 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347433 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347436 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347439 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347441 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347444 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347447 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347451 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347454 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347457 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347460 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347463 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347466 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347468 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347471 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347474 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347476 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347479 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 11:13:19.351930 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347481 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347484 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347486 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347489 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347491 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347493 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347496 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347498 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347501 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347504 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347524 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347527 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347530 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347536 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347539 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347541 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347544 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347546 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347550 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 11:13:19.352391 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347553 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347557 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347560 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347563 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347566 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347569 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347572 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347574 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347577 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347580 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347583 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347586 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347588 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347591 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347593 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347596 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347598 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347601 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347603 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347606 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 11:13:19.352863 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347608 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347610 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347613 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347615 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347618 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347621 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347623 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347626 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347629 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347632 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347634 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347636 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347639 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347641 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347644 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347647 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347650 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347652 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347655 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347657 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 11:13:19.353337 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347659 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347662 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347664 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347667 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347669 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347672 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347674 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:19.347676 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.347681 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.347783 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.349794 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.350949 2563 server.go:1019] "Starting client certificate rotation" Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.351049 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 11:13:19.353852 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.351087 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 11:13:19.354181 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.353206 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 11:13:19.354336 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.354318 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 11:13:19.365744 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.365718 2563 log.go:25] "Validated CRI v1 runtime API" Jul 08 11:13:19.367902 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.367887 2563 log.go:25] "Validated CRI v1 image API" Jul 08 11:13:19.369315 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.369293 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 11:13:19.372074 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.372048 2563 fs.go:135] Filesystem UUIDs: map[5c86e75b-1470-4a8a-b82c-e9a8d01f6e9d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ab64f51c-fa13-4e40-999f-68b0272b41fb:/dev/nvme0n1p4] Jul 08 11:13:19.372147 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.372074 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 11:13:19.379888 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.379772 2563 manager.go:216] Machine: {Timestamp:2026-07-08 11:13:19.378588057 +0000 UTC m=+0.315260618 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098090 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25befbb5266ebefdb91fe303cdc9f7 SystemUUID:ec25befb-b526-6ebe-fdb9-1fe303cdc9f7 BootID:37cb0736-746d-4905-9bf5-fa63777caa7e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:45:5d:a9:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:45:5d:a9:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:7a:7c:42:7f:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 11:13:19.379888 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.379877 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 11:13:19.380020 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.379956 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 11:13:19.381550 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.381525 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 11:13:19.381677 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.381552 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-193.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 11:13:19.382199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.382189 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 11:13:19.382229 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.382201 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 11:13:19.382229 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.382209 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 11:13:19.382774 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.382764 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 11:13:19.384042 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.384032 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 11:13:19.387009 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.386997 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 08 11:13:19.387122 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.387113 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 11:13:19.387703 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.387694 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 08 11:13:19.387742 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.387716 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 11:13:19.387742 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.387730 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 11:13:19.387742 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.387740 2563 kubelet.go:398] "Adding apiserver pod source" Jul 08 11:13:19.387861 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.387748 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 11:13:19.388105 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.388094 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 11:13:19.388144 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.388112 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 11:13:19.390329 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.390310 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 11:13:19.391911 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.391896 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 11:13:19.392075 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.392061 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 11:13:19.392116 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.392092 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 11:13:19.393384 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393371 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 11:13:19.393422 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393389 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 11:13:19.393422 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393396 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 11:13:19.393422 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393402 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 11:13:19.393422 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393410 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 11:13:19.393422 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393415 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 11:13:19.393422 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393423 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 11:13:19.393588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393429 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 11:13:19.393588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393436 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 11:13:19.393588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393442 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 11:13:19.393588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393457 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 11:13:19.393588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.393462 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 11:13:19.394058 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.394049 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 11:13:19.394058 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.394058 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 11:13:19.397081 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.397066 2563 server.go:1268] "Started kubelet" Jul 08 11:13:19.397150 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.397124 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 11:13:19.397197 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.397138 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 11:13:19.397242 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.397205 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 11:13:19.397931 ip-10-0-139-193 systemd[1]: Started Kubernetes Kubelet. Jul 08 11:13:19.398435 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.398419 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 11:13:19.399896 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.399880 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 08 11:13:19.403900 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.403865 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 11:13:19.405152 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405136 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 11:13:19.405152 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405149 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 11:13:19.405271 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.405201 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.405844 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405826 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 11:13:19.405929 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405827 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 11:13:19.405929 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405859 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 11:13:19.406025 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405939 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 08 11:13:19.406025 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.405952 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 08 11:13:19.406327 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406307 2563 factory.go:55] Registering systemd factory Jul 08 11:13:19.406327 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406327 2563 factory.go:223] Registration of the systemd container factory successfully Jul 08 11:13:19.406576 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406558 2563 factory.go:153] Registering CRI-O factory Jul 08 11:13:19.406648 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406580 2563 factory.go:223] Registration of the crio container factory successfully Jul 08 11:13:19.406648 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406635 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 11:13:19.406759 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406655 2563 factory.go:103] Registering Raw factory Jul 08 11:13:19.406759 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.406670 2563 manager.go:1196] Started watching for new ooms in manager Jul 08 11:13:19.410779 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.406877 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-193.ec2.internal.18c04c2adbb39e37 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-193.ec2.internal,UID:ip-10-0-139-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-193.ec2.internal,},FirstTimestamp:2026-07-08 11:13:19.397035575 +0000 UTC m=+0.333708136,LastTimestamp:2026-07-08 11:13:19.397035575 +0000 UTC m=+0.333708136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-193.ec2.internal,}" Jul 08 11:13:19.410906 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.410780 2563 manager.go:349] Starting recovery of all containers Jul 08 11:13:19.411122 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.410876 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 11:13:19.411229 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.411196 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 11:13:19.411287 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.411224 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 11:13:19.411378 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.411364 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-193.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 11:13:19.411576 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.411531 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 11:13:19.423583 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.423443 2563 manager.go:354] Recovery completed Jul 08 11:13:19.427481 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.427466 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.429255 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429230 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.429345 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429267 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.429345 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429277 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.429780 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429763 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 11:13:19.429780 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429776 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.429883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429779 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 11:13:19.429883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.429847 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 08 11:13:19.430433 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.430417 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.430547 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.430445 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.430547 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.430454 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.431044 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.431032 2563 policy_none.go:49] "None policy: Start" Jul 08 11:13:19.431077 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.431050 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 11:13:19.431077 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.431060 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 11:13:19.432003 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.431993 2563 policy_none.go:47] "Start" Jul 08 11:13:19.435080 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.435014 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-193.ec2.internal.18c04c2add9f3c50 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-193.ec2.internal,UID:ip-10-0-139-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-193.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-193.ec2.internal,},FirstTimestamp:2026-07-08 11:13:19.429254224 +0000 UTC m=+0.365926785,LastTimestamp:2026-07-08 11:13:19.429254224 +0000 UTC m=+0.365926785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-193.ec2.internal,}" Jul 08 11:13:19.446894 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.446807 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-193.ec2.internal.18c04c2add9f81c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-193.ec2.internal,UID:ip-10-0-139-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-193.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-193.ec2.internal,},FirstTimestamp:2026-07-08 11:13:19.429272009 +0000 UTC m=+0.365944570,LastTimestamp:2026-07-08 11:13:19.429272009 +0000 UTC m=+0.365944570,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-193.ec2.internal,}" Jul 08 11:13:19.449651 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.449635 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l9ltg" Jul 08 11:13:19.459940 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.459924 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l9ltg" Jul 08 11:13:19.460439 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.460385 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-193.ec2.internal.18c04c2add9fa429 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-193.ec2.internal,UID:ip-10-0-139-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-193.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-193.ec2.internal,},FirstTimestamp:2026-07-08 11:13:19.429280809 +0000 UTC m=+0.365953370,LastTimestamp:2026-07-08 11:13:19.429280809 +0000 UTC m=+0.365953370,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-193.ec2.internal,}" Jul 08 11:13:19.468025 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468013 2563 manager.go:337] "Starting Device Plugin manager" Jul 08 11:13:19.468115 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.468041 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 11:13:19.468115 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468050 2563 server.go:87] "Starting device plugin registration server" Jul 08 11:13:19.468262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468250 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 11:13:19.468323 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468263 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 11:13:19.468382 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468350 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 11:13:19.468434 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468417 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 11:13:19.468434 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.468425 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 11:13:19.469008 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.468986 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 11:13:19.469083 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.469034 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.567680 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.567639 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 11:13:19.568942 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.568925 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.569000 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.568974 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 11:13:19.569042 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.569008 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 11:13:19.569042 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.569033 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 11:13:19.569138 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.569070 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 11:13:19.569802 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.569784 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.569917 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.569824 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.569917 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.569840 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.569917 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.569874 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.571846 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.571827 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 11:13:19.585452 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.585406 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.585452 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.585431 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-193.ec2.internal\": node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.636885 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.636864 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.669969 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.669931 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal"] Jul 08 11:13:19.670051 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.670023 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.671712 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.671699 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.671781 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.671725 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.671781 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.671734 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.672924 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.672912 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.673049 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.673036 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.673116 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.673068 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.674588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.673932 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.674588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.673969 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.674588 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.673985 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.675258 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.674838 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.675258 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.674868 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.675258 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.674891 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.676120 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.676104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.676171 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.676133 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:19.676818 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.676802 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:19.676902 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.676832 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:19.676902 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.676845 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:19.689998 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.689981 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-193.ec2.internal\" not found" node="ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.693991 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.693975 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-193.ec2.internal\" not found" node="ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.737339 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.737317 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.806761 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.806733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e410049a395d0f9466eef04f9e3e30de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal\" (UID: \"e410049a395d0f9466eef04f9e3e30de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.806925 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.806770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e410049a395d0f9466eef04f9e3e30de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal\" (UID: \"e410049a395d0f9466eef04f9e3e30de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.806925 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.806794 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/460a8649ce7a99a2ec27bc03a529a31a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-193.ec2.internal\" (UID: \"460a8649ce7a99a2ec27bc03a529a31a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.837990 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.837922 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.907586 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.907560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e410049a395d0f9466eef04f9e3e30de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal\" (UID: \"e410049a395d0f9466eef04f9e3e30de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.907696 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.907594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e410049a395d0f9466eef04f9e3e30de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal\" (UID: \"e410049a395d0f9466eef04f9e3e30de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.907696 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.907620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/460a8649ce7a99a2ec27bc03a529a31a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-193.ec2.internal\" (UID: \"460a8649ce7a99a2ec27bc03a529a31a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.907696 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.907676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e410049a395d0f9466eef04f9e3e30de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal\" (UID: \"e410049a395d0f9466eef04f9e3e30de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.907807 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.907703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/460a8649ce7a99a2ec27bc03a529a31a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-193.ec2.internal\" (UID: \"460a8649ce7a99a2ec27bc03a529a31a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.907807 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.907677 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e410049a395d0f9466eef04f9e3e30de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal\" (UID: \"e410049a395d0f9466eef04f9e3e30de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.938757 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:19.938732 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:19.993456 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.993432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:19.997421 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:19.997270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" Jul 08 11:13:20.038970 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.038939 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.139485 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.139411 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.239982 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.239945 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.292222 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.292197 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 11:13:20.340907 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.340883 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.351059 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.351037 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 11:13:20.351211 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.351187 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 11:13:20.351249 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.351215 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 11:13:20.441259 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.441199 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.463417 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.463372 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 11:08:20 +0000 UTC" deadline="2028-02-01 11:40:52.046837719 +0000 UTC" Jul 08 11:13:20.463573 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.463420 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13752h27m31.583423291s" Jul 08 11:13:20.542095 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.542070 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.546561 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:20.546533 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460a8649ce7a99a2ec27bc03a529a31a.slice/crio-c8edec53d6bfe4bf94f78ea02c42f88aefd2b3eb8f81980e75392b3ad3c5133c WatchSource:0}: Error finding container c8edec53d6bfe4bf94f78ea02c42f88aefd2b3eb8f81980e75392b3ad3c5133c: Status 404 returned error can't find the container with id c8edec53d6bfe4bf94f78ea02c42f88aefd2b3eb8f81980e75392b3ad3c5133c Jul 08 11:13:20.546801 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:20.546782 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode410049a395d0f9466eef04f9e3e30de.slice/crio-c7a4bf6ff4dc8f5d444a7d382eb3e56ff95be6a3bad29ca5d66d2b7df1cdb600 WatchSource:0}: Error finding container c7a4bf6ff4dc8f5d444a7d382eb3e56ff95be6a3bad29ca5d66d2b7df1cdb600: Status 404 returned error can't find the container with id c7a4bf6ff4dc8f5d444a7d382eb3e56ff95be6a3bad29ca5d66d2b7df1cdb600 Jul 08 11:13:20.551457 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.551443 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 11:13:20.571871 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.571826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" event={"ID":"460a8649ce7a99a2ec27bc03a529a31a","Type":"ContainerStarted","Data":"c8edec53d6bfe4bf94f78ea02c42f88aefd2b3eb8f81980e75392b3ad3c5133c"} Jul 08 11:13:20.572905 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.572887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" event={"ID":"e410049a395d0f9466eef04f9e3e30de","Type":"ContainerStarted","Data":"c7a4bf6ff4dc8f5d444a7d382eb3e56ff95be6a3bad29ca5d66d2b7df1cdb600"} Jul 08 11:13:20.598062 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.598043 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 11:13:20.599054 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.599039 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientMemory" Jul 08 11:13:20.599118 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.599065 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 11:13:20.599118 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.599078 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeHasSufficientPID" Jul 08 11:13:20.643246 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:20.643219 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-193.ec2.internal\" not found" Jul 08 11:13:20.712675 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.712615 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 11:13:20.808628 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.808595 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" Jul 08 11:13:20.824825 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.824804 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 11:13:20.826578 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.826564 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" Jul 08 11:13:20.841912 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.841894 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 11:13:20.964272 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:20.964193 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 11:13:21.388678 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.388601 2563 apiserver.go:52] "Watching apiserver" Jul 08 11:13:21.397524 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.397481 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 11:13:21.398590 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.398558 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-x4jsp","kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal","openshift-cluster-node-tuning-operator/tuned-t2wv6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal","openshift-network-diagnostics/network-check-target-mzq7c","openshift-network-operator/iptables-alerter-2p8pf","openshift-ovn-kubernetes/ovnkube-node-qbqg6","kube-system/global-pull-secret-syncer-qd6qz","kube-system/konnectivity-agent-glbfs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr","openshift-dns/node-resolver-8xnb7","openshift-image-registry/node-ca-x7blf","openshift-multus/multus-46ptj","openshift-multus/multus-additional-cni-plugins-phc2p"] Jul 08 11:13:21.401114 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.401091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.403215 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.403196 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.403868 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.403837 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7vcqt\"" Jul 08 11:13:21.404010 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.403994 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.405404 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.405388 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.405789 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.405750 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 11:13:21.406456 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.406183 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.406557 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.406479 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.406815 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.406793 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 11:13:21.408389 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.407317 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 11:13:21.408389 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.407375 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 11:13:21.408389 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.407377 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.408389 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.407909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w6tdx\"" Jul 08 11:13:21.409732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.409398 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.409732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.409455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gp5hp\"" Jul 08 11:13:21.409732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.409530 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.411288 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.411272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.413781 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.413762 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:21.413878 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.413835 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:21.414484 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.414453 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 11:13:21.415066 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.415050 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9cpb8\"" Jul 08 11:13:21.415436 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.415416 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 11:13:21.416033 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-sys\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.416129 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416129 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-registration-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416129 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.416129 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-system-cni-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416129 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysctl-d\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxtgn\" (UniqueName: \"kubernetes.io/projected/46b5932a-877d-47ac-b245-485e5cbb9e03-kube-api-access-dxtgn\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-netns\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-system-cni-dir\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-socket-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416273 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-cni-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-os-release\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-cnibin\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-device-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-sys-fs\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhxbh\" (UniqueName: \"kubernetes.io/projected/c07160c4-2197-4b70-8dd0-78fd7563bd1d-kube-api-access-dhxbh\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-kubelet\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-conf-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-cni-multus\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-hostroot\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-etc-kubernetes\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysconfig\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416773 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-kubernetes\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysctl-conf\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.416860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-var-lib-kubelet\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-host\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-os-release\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-cni-binary-copy\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.416997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-socket-dir-parent\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-k8s-cni-cncf-io\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-daemon-config\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-modprobe-d\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-multus-certs\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2q9\" (UniqueName: \"kubernetes.io/projected/4bed9f15-a52c-4a9f-9593-98d9364645db-kube-api-access-4p2q9\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-systemd\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-lib-modules\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-tuned\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46b5932a-877d-47ac-b245-485e5cbb9e03-tmp\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654d4\" (UniqueName: \"kubernetes.io/projected/5e880141-d284-4058-9afe-9753f7c1bd37-kube-api-access-654d4\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.417549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-cnibin\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.418317 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417306 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bed9f15-a52c-4a9f-9593-98d9364645db-cni-binary-copy\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.418317 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-cni-bin\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.418317 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.417353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-run\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.418470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.418441 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.418988 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.418819 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 11:13:21.419253 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.419230 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.419253 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.419247 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6k5xg\"" Jul 08 11:13:21.419404 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.419254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.421235 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.421212 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 11:13:21.421603 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.421565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.421714 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.421696 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 11:13:21.422155 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.422137 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9c4fh\"" Jul 08 11:13:21.423912 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.423896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.424026 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.424006 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:21.425088 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.425071 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 11:13:21.425181 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.425111 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.425365 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.425347 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.425621 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.425582 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 11:13:21.425621 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.425606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kbhn4\"" Jul 08 11:13:21.426877 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.426856 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 11:13:21.427032 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.426862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 11:13:21.427032 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.427006 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:21.427154 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.427062 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:21.429430 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.429410 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.433078 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.433060 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.433157 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.433060 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.433255 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.433067 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlhc9\"" Jul 08 11:13:21.435791 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.435774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.436487 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.436467 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 11:13:21.438842 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.438818 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 11:13:21.438938 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.438862 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 11:13:21.439023 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.439004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-52tzq\"" Jul 08 11:13:21.439084 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.439074 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 11:13:21.454114 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.453524 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-46n2j" Jul 08 11:13:21.467391 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.467371 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-46n2j" Jul 08 11:13:21.507175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.507151 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 11:13:21.517773 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-cni-bin\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.517897 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-sys\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.517897 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.517897 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517839 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-cni-netd\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.517897 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.517897 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d483aa7-af97-43d8-a097-2cb920cd7ca2-iptables-alerter-script\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-registration-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysctl-d\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.517975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-run-netns\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-conf-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-run\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-netns\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-system-cni-dir\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-dbus\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-cnibin\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.518200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-device-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-kubelet\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-systemd\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhxlk\" (UniqueName: \"kubernetes.io/projected/d907dd46-36f4-4dae-90d3-33f12e7aed39-kube-api-access-bhxlk\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-kubelet-config\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-cni-multus\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-etc-kubernetes\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysconfig\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-kubernetes\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysctl-conf\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-var-lib-kubelet\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-slash\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9-konnectivity-ca\") pod \"konnectivity-agent-glbfs\" (UID: \"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9\") " pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-socket-dir-parent\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-k8s-cni-cncf-io\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-kubelet\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.518808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-systemd\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-node-log\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-cni-bin\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-env-overrides\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwzmv\" (UniqueName: \"kubernetes.io/projected/3d483aa7-af97-43d8-a097-2cb920cd7ca2-kube-api-access-gwzmv\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-ovnkube-config\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c413961-e6c3-4713-ac4a-a5328a75c434-ovn-node-metrics-cert\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518860 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-ovnkube-script-lib\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxmtn\" (UniqueName: \"kubernetes.io/projected/0c413961-e6c3-4713-ac4a-a5328a75c434-kube-api-access-rxmtn\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.518969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-system-cni-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxtgn\" (UniqueName: \"kubernetes.io/projected/46b5932a-877d-47ac-b245-485e5cbb9e03-kube-api-access-dxtgn\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-etc-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d483aa7-af97-43d8-a097-2cb920cd7ca2-host-slash\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-daemon-config\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.519683 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-systemd-units\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-socket-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-cni-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-os-release\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d907dd46-36f4-4dae-90d3-33f12e7aed39-hosts-file\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-sys-fs\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhxbh\" (UniqueName: \"kubernetes.io/projected/c07160c4-2197-4b70-8dd0-78fd7563bd1d-kube-api-access-dhxbh\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-host\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9-agent-certs\") pod \"konnectivity-agent-glbfs\" (UID: \"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9\") " pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-hostroot\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-host\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-os-release\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-cni-binary-copy\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.520470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.519636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-modprobe-d\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-host\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-cni-bin\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520196 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-sys\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-tuned\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-ovn\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-serviceca\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7hsq\" (UniqueName: \"kubernetes.io/projected/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-kube-api-access-b7hsq\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzgbq\" (UniqueName: \"kubernetes.io/projected/167945b6-9c4a-4527-86bd-976af4499b0e-kube-api-access-mzgbq\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-multus-certs\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2q9\" (UniqueName: \"kubernetes.io/projected/4bed9f15-a52c-4a9f-9593-98d9364645db-kube-api-access-4p2q9\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-lib-modules\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46b5932a-877d-47ac-b245-485e5cbb9e03-tmp\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-log-socket\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654d4\" (UniqueName: \"kubernetes.io/projected/5e880141-d284-4058-9afe-9753f7c1bd37-kube-api-access-654d4\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-cnibin\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.521307 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bed9f15-a52c-4a9f-9593-98d9364645db-cni-binary-copy\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-var-lib-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d907dd46-36f4-4dae-90d3-33f12e7aed39-tmp-dir\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-cni-binary-copy\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-registration-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520740 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-system-cni-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysctl-d\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-cni-multus\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520827 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-modprobe-d\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-etc-kubernetes\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-run\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520874 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-systemd\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-netns\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-conf-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-system-cni-dir\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-cnibin\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.520978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-device-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-var-lib-kubelet\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.522225 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysconfig\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521210 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-kubernetes\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521302 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-sysctl-conf\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-var-lib-kubelet\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46b5932a-877d-47ac-b245-485e5cbb9e03-lib-modules\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521774 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-socket-dir\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-k8s-cni-cncf-io\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-socket-dir-parent\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-cni-dir\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.521989 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4bed9f15-a52c-4a9f-9593-98d9364645db-multus-daemon-config\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-hostroot\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e880141-d284-4058-9afe-9753f7c1bd37-os-release\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-os-release\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522144 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c07160c4-2197-4b70-8dd0-78fd7563bd1d-sys-fs\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.523179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522189 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.524146 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e880141-d284-4058-9afe-9753f7c1bd37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.524146 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-cnibin\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.524146 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4bed9f15-a52c-4a9f-9593-98d9364645db-host-run-multus-certs\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.524146 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.522668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bed9f15-a52c-4a9f-9593-98d9364645db-cni-binary-copy\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.524815 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.524790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46b5932a-877d-47ac-b245-485e5cbb9e03-tmp\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.524901 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.524816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46b5932a-877d-47ac-b245-485e5cbb9e03-etc-tuned\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.538408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.538383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhxbh\" (UniqueName: \"kubernetes.io/projected/c07160c4-2197-4b70-8dd0-78fd7563bd1d-kube-api-access-dhxbh\") pod \"aws-ebs-csi-driver-node-ts2jr\" (UID: \"c07160c4-2197-4b70-8dd0-78fd7563bd1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.538911 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.538891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxtgn\" (UniqueName: \"kubernetes.io/projected/46b5932a-877d-47ac-b245-485e5cbb9e03-kube-api-access-dxtgn\") pod \"tuned-t2wv6\" (UID: \"46b5932a-877d-47ac-b245-485e5cbb9e03\") " pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.540343 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.540321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-654d4\" (UniqueName: \"kubernetes.io/projected/5e880141-d284-4058-9afe-9753f7c1bd37-kube-api-access-654d4\") pod \"multus-additional-cni-plugins-phc2p\" (UID: \"5e880141-d284-4058-9afe-9753f7c1bd37\") " pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.540616 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.540593 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2q9\" (UniqueName: \"kubernetes.io/projected/4bed9f15-a52c-4a9f-9593-98d9364645db-kube-api-access-4p2q9\") pod \"multus-46ptj\" (UID: \"4bed9f15-a52c-4a9f-9593-98d9364645db\") " pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.615296 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.615264 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 11:13:21.620799 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620772 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-var-lib-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.620936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d907dd46-36f4-4dae-90d3-33f12e7aed39-tmp-dir\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.620936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.620936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-cni-netd\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.620936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-var-lib-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.620936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-cni-netd\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.620936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.620977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d483aa7-af97-43d8-a097-2cb920cd7ca2-iptables-alerter-script\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-run-netns\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-run-netns\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.621151 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d907dd46-36f4-4dae-90d3-33f12e7aed39-tmp-dir\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.621201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-dbus\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.621237 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:22.121197446 +0000 UTC m=+3.057869996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-systemd\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-dbus\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhxlk\" (UniqueName: \"kubernetes.io/projected/d907dd46-36f4-4dae-90d3-33f12e7aed39-kube-api-access-bhxlk\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-systemd\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-kubelet-config\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-slash\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621389 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-kubelet-config\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9-konnectivity-ca\") pod \"konnectivity-agent-glbfs\" (UID: \"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9\") " pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-kubelet\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-slash\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-node-log\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-cni-bin\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-kubelet\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-env-overrides\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-node-log\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.621704 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwzmv\" (UniqueName: \"kubernetes.io/projected/3d483aa7-af97-43d8-a097-2cb920cd7ca2-kube-api-access-gwzmv\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-ovnkube-config\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-host-cni-bin\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c413961-e6c3-4713-ac4a-a5328a75c434-ovn-node-metrics-cert\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-ovnkube-script-lib\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxmtn\" (UniqueName: \"kubernetes.io/projected/0c413961-e6c3-4713-ac4a-a5328a75c434-kube-api-access-rxmtn\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-etc-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d483aa7-af97-43d8-a097-2cb920cd7ca2-host-slash\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-systemd-units\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621736 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d907dd46-36f4-4dae-90d3-33f12e7aed39-hosts-file\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621754 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d483aa7-af97-43d8-a097-2cb920cd7ca2-iptables-alerter-script\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9-agent-certs\") pod \"konnectivity-agent-glbfs\" (UID: \"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9\") " pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-host\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-systemd-units\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621875 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-etc-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.622510 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621881 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-openvswitch\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.621967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9-konnectivity-ca\") pod \"konnectivity-agent-glbfs\" (UID: \"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9\") " pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d907dd46-36f4-4dae-90d3-33f12e7aed39-hosts-file\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d483aa7-af97-43d8-a097-2cb920cd7ca2-host-slash\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-ovn\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-serviceca\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7hsq\" (UniqueName: \"kubernetes.io/projected/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-kube-api-access-b7hsq\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-host\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzgbq\" (UniqueName: \"kubernetes.io/projected/167945b6-9c4a-4527-86bd-976af4499b0e-kube-api-access-mzgbq\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-log-socket\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.622122 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.622186 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:22.122169474 +0000 UTC m=+3.058842043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-run-ovn\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622437 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c413961-e6c3-4713-ac4a-a5328a75c434-log-socket\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-env-overrides\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-serviceca\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.623085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.622914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-ovnkube-config\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.623580 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.623112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c413961-e6c3-4713-ac4a-a5328a75c434-ovnkube-script-lib\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.624414 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.624387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9-agent-certs\") pod \"konnectivity-agent-glbfs\" (UID: \"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9\") " pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.624509 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.624491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c413961-e6c3-4713-ac4a-a5328a75c434-ovn-node-metrics-cert\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.650146 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.650056 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:21.650146 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.650082 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:21.650146 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.650112 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:21.650408 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:21.650172 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:22.150157014 +0000 UTC m=+3.086829567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:21.652867 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.652834 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwzmv\" (UniqueName: \"kubernetes.io/projected/3d483aa7-af97-43d8-a097-2cb920cd7ca2-kube-api-access-gwzmv\") pod \"iptables-alerter-2p8pf\" (UID: \"3d483aa7-af97-43d8-a097-2cb920cd7ca2\") " pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.652968 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.652942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzgbq\" (UniqueName: \"kubernetes.io/projected/167945b6-9c4a-4527-86bd-976af4499b0e-kube-api-access-mzgbq\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:21.654155 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.654132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxmtn\" (UniqueName: \"kubernetes.io/projected/0c413961-e6c3-4713-ac4a-a5328a75c434-kube-api-access-rxmtn\") pod \"ovnkube-node-qbqg6\" (UID: \"0c413961-e6c3-4713-ac4a-a5328a75c434\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.657342 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.657320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhxlk\" (UniqueName: \"kubernetes.io/projected/d907dd46-36f4-4dae-90d3-33f12e7aed39-kube-api-access-bhxlk\") pod \"node-resolver-8xnb7\" (UID: \"d907dd46-36f4-4dae-90d3-33f12e7aed39\") " pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.660375 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.660353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7hsq\" (UniqueName: \"kubernetes.io/projected/0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb-kube-api-access-b7hsq\") pod \"node-ca-x7blf\" (UID: \"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb\") " pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:21.716085 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.716056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" Jul 08 11:13:21.724036 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.724010 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-46ptj" Jul 08 11:13:21.734554 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.734531 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" Jul 08 11:13:21.745806 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.745786 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phc2p" Jul 08 11:13:21.753673 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.753650 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2p8pf" Jul 08 11:13:21.761138 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.761118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:21.771694 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.771668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:21.780613 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.780590 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8xnb7" Jul 08 11:13:21.789825 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:21.789808 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x7blf" Jul 08 11:13:22.125492 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:22.125406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:22.125492 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:22.125460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:22.125707 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.125603 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:22.125707 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.125672 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:23.125656348 +0000 UTC m=+4.062328903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:22.125707 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.125696 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:22.125852 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.125750 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:23.125732999 +0000 UTC m=+4.062405550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:22.226203 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:22.226158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:22.226412 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.226358 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:22.226412 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.226390 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:22.226412 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.226403 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:22.226602 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:22.226466 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:23.226444983 +0000 UTC m=+4.163117549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:22.356987 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:22.356957 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 11:13:22.471566 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:22.471444 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 11:08:22 +0000 UTC" deadline="2028-04-11 21:05:30.014122086 +0000 UTC" Jul 08 11:13:22.471566 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:22.471514 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15441h52m7.542610918s" Jul 08 11:13:22.743491 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.743464 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d483aa7_af97_43d8_a097_2cb920cd7ca2.slice/crio-bfc606661ae275f4c4eb5c0c67f712fa93bd6a46269092c8ac743330d23712b5 WatchSource:0}: Error finding container bfc606661ae275f4c4eb5c0c67f712fa93bd6a46269092c8ac743330d23712b5: Status 404 returned error can't find the container with id bfc606661ae275f4c4eb5c0c67f712fa93bd6a46269092c8ac743330d23712b5 Jul 08 11:13:22.746322 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.746138 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07160c4_2197_4b70_8dd0_78fd7563bd1d.slice/crio-ce3dade4cff074ab4db81572dc8a9b6de9572c26ab8275b5457f9279a652a63d WatchSource:0}: Error finding container ce3dade4cff074ab4db81572dc8a9b6de9572c26ab8275b5457f9279a652a63d: Status 404 returned error can't find the container with id ce3dade4cff074ab4db81572dc8a9b6de9572c26ab8275b5457f9279a652a63d Jul 08 11:13:22.749717 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.749690 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c413961_e6c3_4713_ac4a_a5328a75c434.slice/crio-bf83ec369e3c53d8f84ca244785a8c7f1dbfd5851fffdc29a31b640de73d64c5 WatchSource:0}: Error finding container bf83ec369e3c53d8f84ca244785a8c7f1dbfd5851fffdc29a31b640de73d64c5: Status 404 returned error can't find the container with id bf83ec369e3c53d8f84ca244785a8c7f1dbfd5851fffdc29a31b640de73d64c5 Jul 08 11:13:22.750462 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.750442 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b5932a_877d_47ac_b245_485e5cbb9e03.slice/crio-3cd798b197eb3a627eae7b54ab719cb1d5961dbcfa3c7c048071cda07528c221 WatchSource:0}: Error finding container 3cd798b197eb3a627eae7b54ab719cb1d5961dbcfa3c7c048071cda07528c221: Status 404 returned error can't find the container with id 3cd798b197eb3a627eae7b54ab719cb1d5961dbcfa3c7c048071cda07528c221 Jul 08 11:13:22.752828 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.751686 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd907dd46_36f4_4dae_90d3_33f12e7aed39.slice/crio-32faba7ade3cca47bf912f99a61cd453094e9869ee1dd783928fed38a86402a7 WatchSource:0}: Error finding container 32faba7ade3cca47bf912f99a61cd453094e9869ee1dd783928fed38a86402a7: Status 404 returned error can't find the container with id 32faba7ade3cca47bf912f99a61cd453094e9869ee1dd783928fed38a86402a7 Jul 08 11:13:22.754989 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.754894 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e880141_d284_4058_9afe_9753f7c1bd37.slice/crio-c12a2bb327791a453f0d1ab54708898560c760d5f78a192f18411153d119f634 WatchSource:0}: Error finding container c12a2bb327791a453f0d1ab54708898560c760d5f78a192f18411153d119f634: Status 404 returned error can't find the container with id c12a2bb327791a453f0d1ab54708898560c760d5f78a192f18411153d119f634 Jul 08 11:13:22.755503 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.755458 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bed9f15_a52c_4a9f_9593_98d9364645db.slice/crio-879742223e4b7139b1536f18a208dfb3b548565697b52d34af624ef67496edd9 WatchSource:0}: Error finding container 879742223e4b7139b1536f18a208dfb3b548565697b52d34af624ef67496edd9: Status 404 returned error can't find the container with id 879742223e4b7139b1536f18a208dfb3b548565697b52d34af624ef67496edd9 Jul 08 11:13:22.757383 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:22.757341 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfd1065_2cf4_424c_8ec3_c0a680bbb1bb.slice/crio-50125fc75b79961260b5543e5c872e11f81217469339f72dd9859af2e0270c0c WatchSource:0}: Error finding container 50125fc75b79961260b5543e5c872e11f81217469339f72dd9859af2e0270c0c: Status 404 returned error can't find the container with id 50125fc75b79961260b5543e5c872e11f81217469339f72dd9859af2e0270c0c Jul 08 11:13:23.134190 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.133920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:23.134373 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.134254 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:23.134373 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.134082 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:23.134373 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.134347 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:25.134327641 +0000 UTC m=+6.071000206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:23.134373 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.134368 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:23.134624 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.134423 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:25.13440733 +0000 UTC m=+6.071079903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:23.235614 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.235578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:23.235778 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.235760 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:23.235835 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.235779 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:23.235835 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.235790 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:23.235920 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.235850 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:25.235829417 +0000 UTC m=+6.172501970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:23.471822 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.471697 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 11:08:22 +0000 UTC" deadline="2028-02-20 00:32:20.980270041 +0000 UTC" Jul 08 11:13:23.471822 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.471772 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14197h18m57.508502783s" Jul 08 11:13:23.572293 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.572262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:23.572453 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.572403 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:23.572867 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.572844 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:23.572980 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.572957 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:23.573062 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.573041 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:23.573153 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:23.573133 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:23.587729 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.587638 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-glbfs" event={"ID":"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9","Type":"ContainerStarted","Data":"13f51000777605a44c8d8c1263208560e630dd79abf0bc03a8599631b96ffa91"} Jul 08 11:13:23.591305 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.591237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" event={"ID":"46b5932a-877d-47ac-b245-485e5cbb9e03","Type":"ContainerStarted","Data":"3cd798b197eb3a627eae7b54ab719cb1d5961dbcfa3c7c048071cda07528c221"} Jul 08 11:13:23.594822 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.594707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"bf83ec369e3c53d8f84ca244785a8c7f1dbfd5851fffdc29a31b640de73d64c5"} Jul 08 11:13:23.602631 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.602540 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2p8pf" event={"ID":"3d483aa7-af97-43d8-a097-2cb920cd7ca2","Type":"ContainerStarted","Data":"bfc606661ae275f4c4eb5c0c67f712fa93bd6a46269092c8ac743330d23712b5"} Jul 08 11:13:23.613629 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.613601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" event={"ID":"460a8649ce7a99a2ec27bc03a529a31a","Type":"ContainerStarted","Data":"1d8c5f23338e23fb092087c1e8f816c08474eac3e18e2fe0abb8cb661848363d"} Jul 08 11:13:23.620414 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.619808 2563 generic.go:356] "Generic (PLEG): container finished" podID="e410049a395d0f9466eef04f9e3e30de" containerID="dd04e91de9f8d613f0d224e811d4dd776ca81fdc14a747aede27cabfae69bd70" exitCode=0 Jul 08 11:13:23.620414 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.619898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" event={"ID":"e410049a395d0f9466eef04f9e3e30de","Type":"ContainerDied","Data":"dd04e91de9f8d613f0d224e811d4dd776ca81fdc14a747aede27cabfae69bd70"} Jul 08 11:13:23.632861 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.632830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-46ptj" event={"ID":"4bed9f15-a52c-4a9f-9593-98d9364645db","Type":"ContainerStarted","Data":"879742223e4b7139b1536f18a208dfb3b548565697b52d34af624ef67496edd9"} Jul 08 11:13:23.647040 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.646937 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8xnb7" event={"ID":"d907dd46-36f4-4dae-90d3-33f12e7aed39","Type":"ContainerStarted","Data":"32faba7ade3cca47bf912f99a61cd453094e9869ee1dd783928fed38a86402a7"} Jul 08 11:13:23.662754 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.662723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" event={"ID":"c07160c4-2197-4b70-8dd0-78fd7563bd1d","Type":"ContainerStarted","Data":"ce3dade4cff074ab4db81572dc8a9b6de9572c26ab8275b5457f9279a652a63d"} Jul 08 11:13:23.669566 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.669535 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x7blf" event={"ID":"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb","Type":"ContainerStarted","Data":"50125fc75b79961260b5543e5c872e11f81217469339f72dd9859af2e0270c0c"} Jul 08 11:13:23.672500 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.672470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerStarted","Data":"c12a2bb327791a453f0d1ab54708898560c760d5f78a192f18411153d119f634"} Jul 08 11:13:23.688980 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:23.688924 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-193.ec2.internal" podStartSLOduration=2.688906195 podStartE2EDuration="2.688906195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:23.651401256 +0000 UTC m=+4.588073855" watchObservedRunningTime="2026-07-08 11:13:23.688906195 +0000 UTC m=+4.625578770" Jul 08 11:13:24.690280 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:24.690203 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" event={"ID":"e410049a395d0f9466eef04f9e3e30de","Type":"ContainerStarted","Data":"58e4a6a17a544e9796ad146eae5c987a3e0fcfece26b90ecf2c7aa2ee3751483"} Jul 08 11:13:25.153571 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:25.152688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:25.153571 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:25.152790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:25.153571 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.152928 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:25.153571 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.152995 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:29.152975795 +0000 UTC m=+10.089648363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:25.153571 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.153426 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:25.153571 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.153475 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:29.153460566 +0000 UTC m=+10.090133134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:25.254169 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:25.253422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:25.254169 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.253652 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:25.254169 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.253678 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:25.254169 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.253693 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:25.254169 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.253757 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:29.253736174 +0000 UTC m=+10.190408737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:25.573103 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:25.573019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:25.573276 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.573180 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:25.573638 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:25.573616 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:25.573751 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.573721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:25.573818 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:25.573797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:25.573943 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:25.573885 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:27.573410 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:27.572327 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:27.573410 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:27.572457 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:27.573410 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:27.572852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:27.573410 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:27.572955 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:27.573410 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:27.573011 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:27.573410 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:27.573096 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:29.186963 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:29.186926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:29.187419 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:29.186988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:29.187419 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.187091 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:29.187419 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.187113 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:29.187419 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.187147 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:37.187133137 +0000 UTC m=+18.123805700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:29.187419 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.187182 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:37.187163587 +0000 UTC m=+18.123836155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:29.287636 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:29.287569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:29.287834 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.287771 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:29.287834 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.287791 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:29.287834 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.287801 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:29.287965 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.287857 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:37.287842244 +0000 UTC m=+18.224514797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:29.570178 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:29.570085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:29.570350 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.570190 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:29.570781 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:29.570617 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:29.570781 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.570721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:29.571174 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:29.571032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:29.571174 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:29.571141 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:31.570341 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:31.570256 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:31.570802 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:31.570408 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:31.570924 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:31.570533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:31.571061 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:31.571021 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:31.571134 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:31.571101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:31.571212 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:31.571191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:33.570473 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:33.569887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:33.570473 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:33.570026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:33.570473 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:33.570366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:33.570473 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:33.570431 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:33.571079 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:33.570583 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:33.571482 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:33.571434 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:35.569270 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:35.569232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:35.569714 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:35.569232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:35.569714 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:35.569366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:35.569714 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:35.569360 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:35.569714 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:35.569441 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:35.569714 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:35.569555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:37.251034 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:37.251001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:37.251491 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:37.251054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:37.251491 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.251151 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:37.251491 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.251179 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:37.251491 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.251204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:53.251188549 +0000 UTC m=+34.187861097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:37.251491 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.251227 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:13:53.251211065 +0000 UTC m=+34.187883627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:37.351717 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:37.351684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:37.351900 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.351822 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:37.351900 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.351844 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:37.351900 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.351859 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:37.352049 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.351909 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:53.351891365 +0000 UTC m=+34.288563926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:37.569587 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:37.569493 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:37.569587 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:37.569554 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:37.569792 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:37.569633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:37.569792 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.569656 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:37.569792 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.569723 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:37.569945 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:37.569797 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:39.572241 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:39.572177 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:39.572241 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:39.572212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:39.572772 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:39.572312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:39.572772 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:39.572309 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:39.572772 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:39.572407 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:39.572772 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:39.572503 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:41.570360 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:41.570321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:41.570360 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:41.570361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:41.570860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:41.570320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:41.570860 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:41.570468 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:41.570860 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:41.570561 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:41.570860 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:41.570640 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:42.731249 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.730874 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"7e20d430fd6ec706a27ec01c85bcae66f081e839d0b9732609e853aa823d1817"} Jul 08 11:13:42.732125 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.731333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"05fc9dac1b1493db6b25e566372516f9a4911e2424ad127c28f2bbb5e5a718b3"} Jul 08 11:13:42.732125 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.731389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"81f9f4d63b429eb0b8cd1c6364731070648e8527798531d5d48ec177aa1d4449"} Jul 08 11:13:42.732573 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.732549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-46ptj" event={"ID":"4bed9f15-a52c-4a9f-9593-98d9364645db","Type":"ContainerStarted","Data":"aac41d9ad163b6c3cfd43009674b018cdcc1f621db564247647d17ae4285852f"} Jul 08 11:13:42.734222 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.734199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8xnb7" event={"ID":"d907dd46-36f4-4dae-90d3-33f12e7aed39","Type":"ContainerStarted","Data":"b871dd992ce479b97b5a7a1261220cdcbc59862ca72896dd718f30b1f913d649"} Jul 08 11:13:42.735853 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.735818 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" event={"ID":"c07160c4-2197-4b70-8dd0-78fd7563bd1d","Type":"ContainerStarted","Data":"96e52fafd694668e93f899d3442ca6162a308db8c73bd91104fc05d455448c93"} Jul 08 11:13:42.737497 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.737471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x7blf" event={"ID":"0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb","Type":"ContainerStarted","Data":"5bb657af7f54e51b9d3ba300ba08d247ac3a2605296d198f5c68ab6e8a59bd64"} Jul 08 11:13:42.739175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.739150 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e880141-d284-4058-9afe-9753f7c1bd37" containerID="b238d5460758b27a9fc1945913ab38aa02804171bf10d363fdd7b897e80b0ab9" exitCode=0 Jul 08 11:13:42.739254 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.739236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerDied","Data":"b238d5460758b27a9fc1945913ab38aa02804171bf10d363fdd7b897e80b0ab9"} Jul 08 11:13:42.740811 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.740789 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-glbfs" event={"ID":"d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9","Type":"ContainerStarted","Data":"200b75baf16540049dac44b05cbfca5988e691479c47917211f96768a23b1ef2"} Jul 08 11:13:42.742462 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.742346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" event={"ID":"46b5932a-877d-47ac-b245-485e5cbb9e03","Type":"ContainerStarted","Data":"f0bd1e39510fd2825e83c4daac19b363cabfbb4134da1f6dd9196231fe509dfc"} Jul 08 11:13:42.761745 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.759557 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-46ptj" podStartSLOduration=3.105274102 podStartE2EDuration="22.759504821s" totalImagesPullingTime="19.654230719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:42.758404889 +0000 UTC m=+23.695077458" watchObservedRunningTime="2026-07-08 11:13:42.759504821 +0000 UTC m=+23.696177393" Jul 08 11:13:42.761745 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.760194 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-193.ec2.internal" podStartSLOduration=21.760180443 podStartE2EDuration="21.760180443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:24.715789261 +0000 UTC m=+5.652461839" watchObservedRunningTime="2026-07-08 11:13:42.760180443 +0000 UTC m=+23.696853023" Jul 08 11:13:42.793288 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.793236 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8xnb7" podStartSLOduration=3.180473508 podStartE2EDuration="22.793215297s" totalImagesPullingTime="19.612741789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:42.793187934 +0000 UTC m=+23.729860503" watchObservedRunningTime="2026-07-08 11:13:42.793215297 +0000 UTC m=+23.729887868" Jul 08 11:13:42.847080 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.847056 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:42.870217 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.870121 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t2wv6" podStartSLOduration=3.232825593 podStartE2EDuration="22.87010454s" totalImagesPullingTime="19.637278947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:42.828188963 +0000 UTC m=+23.764861533" watchObservedRunningTime="2026-07-08 11:13:42.87010454 +0000 UTC m=+23.806777141" Jul 08 11:13:42.914718 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.914680 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-glbfs" podStartSLOduration=3.3078115869999998 podStartE2EDuration="22.914663802s" totalImagesPullingTime="19.606852215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:42.914366993 +0000 UTC m=+23.851039563" watchObservedRunningTime="2026-07-08 11:13:42.914663802 +0000 UTC m=+23.851336371" Jul 08 11:13:42.947298 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:42.947258 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x7blf" podStartSLOduration=3.341776993 podStartE2EDuration="22.947245108s" totalImagesPullingTime="19.605468115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:42.947128284 +0000 UTC m=+23.883800857" watchObservedRunningTime="2026-07-08 11:13:42.947245108 +0000 UTC m=+23.883917678" Jul 08 11:13:43.572346 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.572318 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:43.572561 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.572318 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:43.572561 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:43.572429 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:43.572561 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.572328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:43.572561 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:43.572537 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:43.572784 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:43.572606 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:43.748504 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.748468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"47e5e8622ce9e0a2a951a643353743b02bf89c7c7722afe86a32b1faa723d463"} Jul 08 11:13:43.748953 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.748573 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"896504f6db58d30387889a18e45d11c6a38038c4b91963e49ece3d5422071028"} Jul 08 11:13:43.748953 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.748625 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"af3cef882bacb65b0e76c706f036a7af832b9fa73174ea01483feb30ee970d8e"} Jul 08 11:13:43.750052 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:43.750018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2p8pf" event={"ID":"3d483aa7-af97-43d8-a097-2cb920cd7ca2","Type":"ContainerStarted","Data":"89d669e53dc94c60eaa009a6e202efaba0f65024c9e57f57d4a8549a88cdc2f3"} Jul 08 11:13:44.076389 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:44.076363 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 11:13:44.480538 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:44.480422 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T11:13:44.076381835Z","UUID":"27f7cd6f-f555-47b1-b656-e6c70d95d650","Handler":null,"Name":"","Endpoint":""} Jul 08 11:13:44.482492 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:44.482470 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 11:13:44.482644 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:44.482558 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 11:13:44.755660 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:44.755570 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" event={"ID":"c07160c4-2197-4b70-8dd0-78fd7563bd1d","Type":"ContainerStarted","Data":"4c10b33f93e30101b82ea58a023ee050180970b8e9f23030f1230f02c0d79890"} Jul 08 11:13:45.120579 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.120553 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:45.121108 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.121092 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:45.145556 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.145488 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2p8pf" podStartSLOduration=5.494796093 podStartE2EDuration="25.14546713s" totalImagesPullingTime="19.650671037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:43.780947943 +0000 UTC m=+24.717620512" watchObservedRunningTime="2026-07-08 11:13:45.14546713 +0000 UTC m=+26.082139701" Jul 08 11:13:45.569614 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.569576 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:45.569794 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:45.569707 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:45.569794 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.569582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:45.569912 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:45.569795 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:45.569912 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.569576 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:45.569912 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:45.569881 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:45.760949 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.760766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" event={"ID":"c07160c4-2197-4b70-8dd0-78fd7563bd1d","Type":"ContainerStarted","Data":"dc5be49c1f364c0299f684420d9c60b7288142c3635b45f0b969271a9aaaccdc"} Jul 08 11:13:45.764582 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.764548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"0190e9e176c1b2356dbfe98927bc4d1b7fa94b28cfe897b662936f71321b1573"} Jul 08 11:13:45.765177 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.765149 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-glbfs" Jul 08 11:13:45.789791 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:45.789745 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ts2jr" podStartSLOduration=3.788328678 podStartE2EDuration="25.789725326s" totalImagesPullingTime="22.001396648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:45.789331263 +0000 UTC m=+26.726003850" watchObservedRunningTime="2026-07-08 11:13:45.789725326 +0000 UTC m=+26.726397900" Jul 08 11:13:47.570262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:47.570029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:47.570734 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:47.570094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:47.570734 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:47.570353 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:47.570734 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:47.570426 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:47.570734 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:47.570156 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:47.570734 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:47.570520 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:48.773830 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.773612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" event={"ID":"0c413961-e6c3-4713-ac4a-a5328a75c434","Type":"ContainerStarted","Data":"8e012a1f822353545c122a5792a7c6fd54cdb900d2910a977d2b151ad484d5a4"} Jul 08 11:13:48.774721 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.773937 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:48.774721 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.773985 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:48.775558 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.775505 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e880141-d284-4058-9afe-9753f7c1bd37" containerID="223184ea0b4139422399bed5f92e454c5a9185c5096e4ff0856d648e765c24bd" exitCode=0 Jul 08 11:13:48.775558 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.775546 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerDied","Data":"223184ea0b4139422399bed5f92e454c5a9185c5096e4ff0856d648e765c24bd"} Jul 08 11:13:48.790302 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.790278 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:48.793910 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.793890 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:48.825393 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:48.825336 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" podStartSLOduration=9.118030834 podStartE2EDuration="28.82532186s" totalImagesPullingTime="19.707291026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:13:48.824880432 +0000 UTC m=+29.761553021" watchObservedRunningTime="2026-07-08 11:13:48.82532186 +0000 UTC m=+29.761994430" Jul 08 11:13:49.570212 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:49.570179 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:49.570529 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:49.570258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:49.570529 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:49.570295 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:49.570529 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:49.570303 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:49.570529 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:49.570371 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:49.570529 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:49.570424 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:49.777674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:49.777645 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:13:50.783237 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.783200 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e880141-d284-4058-9afe-9753f7c1bd37" containerID="e14162a3bad7d56302a4b5ea9ebd4d7730fe62decf1d07d714e959bf7895d8de" exitCode=0 Jul 08 11:13:50.783815 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.783293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerDied","Data":"e14162a3bad7d56302a4b5ea9ebd4d7730fe62decf1d07d714e959bf7895d8de"} Jul 08 11:13:50.812517 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.812491 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qd6qz"] Jul 08 11:13:50.812637 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.812593 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:50.812706 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:50.812673 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:50.827019 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.826967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mzq7c"] Jul 08 11:13:50.827100 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.827035 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:50.827143 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:50.827098 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:50.838873 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.838851 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4jsp"] Jul 08 11:13:50.838968 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:50.838922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:50.839013 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:50.838999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:52.569488 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:52.569460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:52.569835 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:52.569498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:52.569835 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:52.569498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:52.569835 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:52.569592 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:52.569835 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:52.569660 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:52.569835 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:52.569726 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:52.703108 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:52.703082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8xnb7_d907dd46-36f4-4dae-90d3-33f12e7aed39/dns-node-resolver/0.log" Jul 08 11:13:52.790265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:52.790226 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e880141-d284-4058-9afe-9753f7c1bd37" containerID="7d077aeef30eb8855dc71ff682faaff7207df7bc64ea3643cb476cae97acd4a4" exitCode=0 Jul 08 11:13:52.790415 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:52.790272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerDied","Data":"7d077aeef30eb8855dc71ff682faaff7207df7bc64ea3643cb476cae97acd4a4"} Jul 08 11:13:53.267269 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:53.267077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:53.267437 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:53.267303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:53.267437 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.267230 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:53.267437 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.267399 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:53.267437 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.267408 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret podName:62f21c1b-f7db-4fd1-8500-6d2046c94e7e nodeName:}" failed. No retries permitted until 2026-07-08 11:14:25.267385907 +0000 UTC m=+66.204058456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret") pod "global-pull-secret-syncer-qd6qz" (UID: "62f21c1b-f7db-4fd1-8500-6d2046c94e7e") : object "kube-system"/"original-pull-secret" not registered Jul 08 11:13:53.267674 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.267442 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs podName:167945b6-9c4a-4527-86bd-976af4499b0e nodeName:}" failed. No retries permitted until 2026-07-08 11:14:25.26743038 +0000 UTC m=+66.204102932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs") pod "network-metrics-daemon-x4jsp" (UID: "167945b6-9c4a-4527-86bd-976af4499b0e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 11:13:53.368283 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:53.368246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:53.368443 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.368390 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 11:13:53.368443 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.368409 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 11:13:53.368443 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.368421 2563 projected.go:196] Error preparing data for projected volume kube-api-access-rh68j for pod openshift-network-diagnostics/network-check-target-mzq7c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:53.368624 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:53.368482 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j podName:437d253d-82a8-42a4-a231-67934d477857 nodeName:}" failed. No retries permitted until 2026-07-08 11:14:25.368462705 +0000 UTC m=+66.305135253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rh68j" (UniqueName: "kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j") pod "network-check-target-mzq7c" (UID: "437d253d-82a8-42a4-a231-67934d477857") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 11:13:53.856919 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:53.856888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x7blf_0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb/node-ca/0.log" Jul 08 11:13:54.569413 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:54.569381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:54.569597 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:54.569395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:54.569597 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:54.569525 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:54.569597 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:54.569534 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4jsp" podUID="167945b6-9c4a-4527-86bd-976af4499b0e" Jul 08 11:13:54.569597 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:54.569589 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzq7c" podUID="437d253d-82a8-42a4-a231-67934d477857" Jul 08 11:13:54.569788 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:54.569688 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qd6qz" podUID="62f21c1b-f7db-4fd1-8500-6d2046c94e7e" Jul 08 11:13:55.361368 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.361340 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-193.ec2.internal" event="NodeReady" Jul 08 11:13:55.361741 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.361482 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 11:13:55.427962 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.427923 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57996cdb88-55tq5"] Jul 08 11:13:55.431214 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.431192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.443883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.443864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4bbvl\"" Jul 08 11:13:55.445095 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.445080 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 11:13:55.446480 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.446462 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 11:13:55.446480 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.446482 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 11:13:55.450620 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.450602 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 11:13:55.475335 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.475306 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dl2q"] Jul 08 11:13:55.479239 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.479224 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dfd2q"] Jul 08 11:13:55.479379 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.479361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.482775 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.482757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.487774 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.487424 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 11:13:55.487774 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.487411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 11:13:55.487774 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.487643 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 11:13:55.487774 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.487682 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cp6jk\"" Jul 08 11:13:55.488031 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.487783 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 11:13:55.488178 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.488158 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 11:13:55.488264 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.488201 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkr92\"" Jul 08 11:13:55.504179 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.504160 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dl2q"] Jul 08 11:13:55.528356 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.528297 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57996cdb88-55tq5"] Jul 08 11:13:55.557955 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.557928 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dfd2q"] Jul 08 11:13:55.584732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-config-volume\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.584884 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584738 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-trusted-ca\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.584884 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-certificates\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.584884 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-ca-trust-extracted\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.584884 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.584884 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-tmp-dir\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.584884 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-image-registry-private-configuration\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-bound-sa-token\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-installation-pull-secrets\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9f4b79d-8eb7-48f2-a66f-001e388e189e-cert\") pod \"ingress-canary-dfd2q\" (UID: \"f9f4b79d-8eb7-48f2-a66f-001e388e189e\") " pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.584996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxbc8\" (UniqueName: \"kubernetes.io/projected/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-kube-api-access-mxbc8\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.585034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krk6g\" (UniqueName: \"kubernetes.io/projected/f9f4b79d-8eb7-48f2-a66f-001e388e189e-kube-api-access-krk6g\") pod \"ingress-canary-dfd2q\" (UID: \"f9f4b79d-8eb7-48f2-a66f-001e388e189e\") " pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.585113 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.585077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvc22\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-kube-api-access-fvc22\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.685981 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.685901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxbc8\" (UniqueName: \"kubernetes.io/projected/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-kube-api-access-mxbc8\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.685981 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.685965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krk6g\" (UniqueName: \"kubernetes.io/projected/f9f4b79d-8eb7-48f2-a66f-001e388e189e-kube-api-access-krk6g\") pod \"ingress-canary-dfd2q\" (UID: \"f9f4b79d-8eb7-48f2-a66f-001e388e189e\") " pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.685990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvc22\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-kube-api-access-fvc22\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-config-volume\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-trusted-ca\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-certificates\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686105 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-ca-trust-extracted\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.686175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-tmp-dir\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.686820 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-image-registry-private-configuration\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686820 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-bound-sa-token\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686820 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686820 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-installation-pull-secrets\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.686820 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.686307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9f4b79d-8eb7-48f2-a66f-001e388e189e-cert\") pod \"ingress-canary-dfd2q\" (UID: \"f9f4b79d-8eb7-48f2-a66f-001e388e189e\") " pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.687272 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.687239 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-trusted-ca\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.687352 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.687337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-tmp-dir\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.687418 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:55.687406 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 11:13:55.687462 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:55.687449 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls podName:e6eb3240-0c29-4d1b-8a3d-e814e4ce5012 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:56.187435135 +0000 UTC m=+37.124107682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls") pod "dns-default-4dl2q" (UID: "e6eb3240-0c29-4d1b-8a3d-e814e4ce5012") : secret "dns-default-metrics-tls" not found Jul 08 11:13:55.687602 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.687569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-ca-trust-extracted\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.687725 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.687713 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-config-volume\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.687813 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:55.687794 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 11:13:55.687813 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:55.687807 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57996cdb88-55tq5: secret "image-registry-tls" not found Jul 08 11:13:55.687934 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:55.687858 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls podName:cdc4680a-0cfe-4cf8-a5ce-59a51132fcda nodeName:}" failed. No retries permitted until 2026-07-08 11:13:56.187844794 +0000 UTC m=+37.124517355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls") pod "image-registry-57996cdb88-55tq5" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda") : secret "image-registry-tls" not found Jul 08 11:13:55.688091 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.688041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-certificates\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.691107 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.691085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-image-registry-private-configuration\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.691185 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.691128 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-installation-pull-secrets\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.691185 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.691165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9f4b79d-8eb7-48f2-a66f-001e388e189e-cert\") pod \"ingress-canary-dfd2q\" (UID: \"f9f4b79d-8eb7-48f2-a66f-001e388e189e\") " pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.698262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.698244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxbc8\" (UniqueName: \"kubernetes.io/projected/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-kube-api-access-mxbc8\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:55.699562 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.699539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvc22\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-kube-api-access-fvc22\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.699655 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.699585 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krk6g\" (UniqueName: \"kubernetes.io/projected/f9f4b79d-8eb7-48f2-a66f-001e388e189e-kube-api-access-krk6g\") pod \"ingress-canary-dfd2q\" (UID: \"f9f4b79d-8eb7-48f2-a66f-001e388e189e\") " pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.699859 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.699833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-bound-sa-token\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:55.795804 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.795769 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dfd2q" Jul 08 11:13:55.959736 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:55.959648 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dfd2q"] Jul 08 11:13:55.963840 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:13:55.963807 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f4b79d_8eb7_48f2_a66f_001e388e189e.slice/crio-50b719e47f4d97fa189e31bc05f1ce4c6b29956d73933703f5182c9554db2cff WatchSource:0}: Error finding container 50b719e47f4d97fa189e31bc05f1ce4c6b29956d73933703f5182c9554db2cff: Status 404 returned error can't find the container with id 50b719e47f4d97fa189e31bc05f1ce4c6b29956d73933703f5182c9554db2cff Jul 08 11:13:56.191310 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.191271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:56.191500 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.191323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:56.191500 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:56.191451 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 11:13:56.191500 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:56.191463 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57996cdb88-55tq5: secret "image-registry-tls" not found Jul 08 11:13:56.191682 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:56.191529 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls podName:cdc4680a-0cfe-4cf8-a5ce-59a51132fcda nodeName:}" failed. No retries permitted until 2026-07-08 11:13:57.191500473 +0000 UTC m=+38.128173038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls") pod "image-registry-57996cdb88-55tq5" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda") : secret "image-registry-tls" not found Jul 08 11:13:56.191682 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:56.191614 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 11:13:56.191682 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:56.191664 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls podName:e6eb3240-0c29-4d1b-8a3d-e814e4ce5012 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:57.191649827 +0000 UTC m=+38.128322382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls") pod "dns-default-4dl2q" (UID: "e6eb3240-0c29-4d1b-8a3d-e814e4ce5012") : secret "dns-default-metrics-tls" not found Jul 08 11:13:56.569283 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.569245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:13:56.570069 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.569362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:13:56.570069 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.569395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:13:56.574250 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.574167 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 11:13:56.574250 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.574170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 11:13:56.575051 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.575029 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wnzzp\"" Jul 08 11:13:56.575159 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.575036 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 11:13:56.575502 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.575485 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-469dh\"" Jul 08 11:13:56.575596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.575546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 11:13:56.800949 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:56.800721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dfd2q" event={"ID":"f9f4b79d-8eb7-48f2-a66f-001e388e189e","Type":"ContainerStarted","Data":"50b719e47f4d97fa189e31bc05f1ce4c6b29956d73933703f5182c9554db2cff"} Jul 08 11:13:57.200021 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:57.199986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:57.200192 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:57.200030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:57.200192 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:57.200157 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 11:13:57.200192 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:57.200163 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 11:13:57.200357 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:57.200238 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls podName:e6eb3240-0c29-4d1b-8a3d-e814e4ce5012 nodeName:}" failed. No retries permitted until 2026-07-08 11:13:59.200218222 +0000 UTC m=+40.136890774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls") pod "dns-default-4dl2q" (UID: "e6eb3240-0c29-4d1b-8a3d-e814e4ce5012") : secret "dns-default-metrics-tls" not found Jul 08 11:13:57.200357 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:57.200172 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57996cdb88-55tq5: secret "image-registry-tls" not found Jul 08 11:13:57.200357 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:57.200331 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls podName:cdc4680a-0cfe-4cf8-a5ce-59a51132fcda nodeName:}" failed. No retries permitted until 2026-07-08 11:13:59.200311341 +0000 UTC m=+40.136983908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls") pod "image-registry-57996cdb88-55tq5" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda") : secret "image-registry-tls" not found Jul 08 11:13:58.808763 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:58.808728 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e880141-d284-4058-9afe-9753f7c1bd37" containerID="d6b1516064152a33c2a440be93be20afd58a542f9b582409306f745116e650c4" exitCode=0 Jul 08 11:13:58.809152 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:58.808791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerDied","Data":"d6b1516064152a33c2a440be93be20afd58a542f9b582409306f745116e650c4"} Jul 08 11:13:59.216258 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:59.216182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:13:59.216258 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:59.216217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:13:59.216436 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:59.216331 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 11:13:59.216436 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:59.216341 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 11:13:59.216436 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:59.216397 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls podName:e6eb3240-0c29-4d1b-8a3d-e814e4ce5012 nodeName:}" failed. No retries permitted until 2026-07-08 11:14:03.216381603 +0000 UTC m=+44.153054151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls") pod "dns-default-4dl2q" (UID: "e6eb3240-0c29-4d1b-8a3d-e814e4ce5012") : secret "dns-default-metrics-tls" not found Jul 08 11:13:59.216436 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:59.216345 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57996cdb88-55tq5: secret "image-registry-tls" not found Jul 08 11:13:59.216436 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:13:59.216432 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls podName:cdc4680a-0cfe-4cf8-a5ce-59a51132fcda nodeName:}" failed. No retries permitted until 2026-07-08 11:14:03.216425739 +0000 UTC m=+44.153098287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls") pod "image-registry-57996cdb88-55tq5" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda") : secret "image-registry-tls" not found Jul 08 11:13:59.815267 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:59.815229 2563 generic.go:356] "Generic (PLEG): container finished" podID="5e880141-d284-4058-9afe-9753f7c1bd37" containerID="06a41386630825ae3e17991c6e0c05132702b95ff9877f50883d428e714ee307" exitCode=0 Jul 08 11:13:59.815714 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:13:59.815301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerDied","Data":"06a41386630825ae3e17991c6e0c05132702b95ff9877f50883d428e714ee307"} Jul 08 11:14:00.821052 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:00.820852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phc2p" event={"ID":"5e880141-d284-4058-9afe-9753f7c1bd37","Type":"ContainerStarted","Data":"f3df767b5afe59dadc2cdac59dd7888fc0988b524bdcaedcc208da2de51a7cbc"} Jul 08 11:14:00.822164 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:00.822141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dfd2q" event={"ID":"f9f4b79d-8eb7-48f2-a66f-001e388e189e","Type":"ContainerStarted","Data":"bb68f0c69c775383ae7bab759a7488a94f8f0a758278daef5358e9f796cb27ee"} Jul 08 11:14:00.850965 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:00.850893 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-phc2p" podStartSLOduration=8.672399855 podStartE2EDuration="40.850881153s" totalImagesPullingTime="32.178481298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:00.849388581 +0000 UTC m=+41.786061152" watchObservedRunningTime="2026-07-08 11:14:00.850881153 +0000 UTC m=+41.787553723" Jul 08 11:14:00.873292 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:00.873241 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dfd2q" podStartSLOduration=1.41527291 podStartE2EDuration="5.873225359s" totalImagesPullingTime="4.457952449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:00.872740227 +0000 UTC m=+41.809412797" watchObservedRunningTime="2026-07-08 11:14:00.873225359 +0000 UTC m=+41.809897911" Jul 08 11:14:03.246347 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.246300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:14:03.246347 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.246346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:14:03.250353 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.250327 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6eb3240-0c29-4d1b-8a3d-e814e4ce5012-metrics-tls\") pod \"dns-default-4dl2q\" (UID: \"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012\") " pod="openshift-dns/dns-default-4dl2q" Jul 08 11:14:03.250353 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.250340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"image-registry-57996cdb88-55tq5\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:14:03.289449 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.289413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dl2q" Jul 08 11:14:03.457883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.457840 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dl2q"] Jul 08 11:14:03.462227 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:03.462187 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6eb3240_0c29_4d1b_8a3d_e814e4ce5012.slice/crio-144d4bfd5b020ccddf40e8a993e74cd897622de4ec05e86a9d6a66a85950e15f WatchSource:0}: Error finding container 144d4bfd5b020ccddf40e8a993e74cd897622de4ec05e86a9d6a66a85950e15f: Status 404 returned error can't find the container with id 144d4bfd5b020ccddf40e8a993e74cd897622de4ec05e86a9d6a66a85950e15f Jul 08 11:14:03.540318 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.540222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:14:03.699471 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.699439 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57996cdb88-55tq5"] Jul 08 11:14:03.702320 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:03.702299 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc4680a_0cfe_4cf8_a5ce_59a51132fcda.slice/crio-1c104548e5c4bf0401ff777822e381c92ade2e74a63e1959acf0570ca7f59c59 WatchSource:0}: Error finding container 1c104548e5c4bf0401ff777822e381c92ade2e74a63e1959acf0570ca7f59c59: Status 404 returned error can't find the container with id 1c104548e5c4bf0401ff777822e381c92ade2e74a63e1959acf0570ca7f59c59 Jul 08 11:14:03.830420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.830393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" event={"ID":"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda","Type":"ContainerStarted","Data":"a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502"} Jul 08 11:14:03.830561 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.830449 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" event={"ID":"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda","Type":"ContainerStarted","Data":"1c104548e5c4bf0401ff777822e381c92ade2e74a63e1959acf0570ca7f59c59"} Jul 08 11:14:03.831368 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:03.831350 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dl2q" event={"ID":"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012","Type":"ContainerStarted","Data":"144d4bfd5b020ccddf40e8a993e74cd897622de4ec05e86a9d6a66a85950e15f"} Jul 08 11:14:04.833916 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:04.833887 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:14:06.840278 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:06.840248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dl2q" event={"ID":"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012","Type":"ContainerStarted","Data":"823da923565071884fe644c19cbb764b84e799a122fa1e4f406e0582b3e9cbff"} Jul 08 11:14:06.840669 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:06.840298 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dl2q" event={"ID":"e6eb3240-0c29-4d1b-8a3d-e814e4ce5012","Type":"ContainerStarted","Data":"d4cc0d3026b4a4d277fe74b0853f1ee0641bdb68455ac8ae0fbca8881fc2dc96"} Jul 08 11:14:06.840669 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:06.840328 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dl2q" Jul 08 11:14:06.877905 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:06.877854 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podStartSLOduration=53.877838314 podStartE2EDuration="53.877838314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:04.862979572 +0000 UTC m=+45.799652154" watchObservedRunningTime="2026-07-08 11:14:06.877838314 +0000 UTC m=+47.814510861" Jul 08 11:14:06.878237 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:06.878216 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4dl2q" podStartSLOduration=9.103448897 podStartE2EDuration="11.878210168s" totalImagesPullingTime="2.774761271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:06.877682982 +0000 UTC m=+47.814355552" watchObservedRunningTime="2026-07-08 11:14:06.878210168 +0000 UTC m=+47.814882738" Jul 08 11:14:16.845530 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:16.845483 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dl2q" Jul 08 11:14:20.800541 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:20.800497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqg6" Jul 08 11:14:23.545020 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:23.544982 2563 patch_prober.go:28] interesting pod/image-registry-57996cdb88-55tq5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 11:14:23.545407 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:23.545031 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 11:14:25.293251 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.293213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:14:25.293710 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.293264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:14:25.297232 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.297214 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 11:14:25.298449 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.298428 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 11:14:25.306093 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.306068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f21c1b-f7db-4fd1-8500-6d2046c94e7e-original-pull-secret\") pod \"global-pull-secret-syncer-qd6qz\" (UID: \"62f21c1b-f7db-4fd1-8500-6d2046c94e7e\") " pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:14:25.306093 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.306092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/167945b6-9c4a-4527-86bd-976af4499b0e-metrics-certs\") pod \"network-metrics-daemon-x4jsp\" (UID: \"167945b6-9c4a-4527-86bd-976af4499b0e\") " pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:14:25.381490 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.381455 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qd6qz" Jul 08 11:14:25.392917 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.392896 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wnzzp\"" Jul 08 11:14:25.394125 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.394101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:14:25.399164 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.399144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 11:14:25.400138 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.400118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4jsp" Jul 08 11:14:25.410002 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.409969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 11:14:25.418566 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.418536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh68j\" (UniqueName: \"kubernetes.io/projected/437d253d-82a8-42a4-a231-67934d477857-kube-api-access-rh68j\") pod \"network-check-target-mzq7c\" (UID: \"437d253d-82a8-42a4-a231-67934d477857\") " pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:14:25.529671 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.529644 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qd6qz"] Jul 08 11:14:25.532743 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:25.532718 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f21c1b_f7db_4fd1_8500_6d2046c94e7e.slice/crio-161093f0cc3a56c18c75a3553438cc7bd077b6d829fe351f81d9970664a8a60e WatchSource:0}: Error finding container 161093f0cc3a56c18c75a3553438cc7bd077b6d829fe351f81d9970664a8a60e: Status 404 returned error can't find the container with id 161093f0cc3a56c18c75a3553438cc7bd077b6d829fe351f81d9970664a8a60e Jul 08 11:14:25.541271 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.541247 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4jsp"] Jul 08 11:14:25.543466 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:25.543420 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167945b6_9c4a_4527_86bd_976af4499b0e.slice/crio-b0773e9d85e92d8667eaba26ce76ae38688cb4a950a2384a20e796fa6f2059cd WatchSource:0}: Error finding container b0773e9d85e92d8667eaba26ce76ae38688cb4a950a2384a20e796fa6f2059cd: Status 404 returned error can't find the container with id b0773e9d85e92d8667eaba26ce76ae38688cb4a950a2384a20e796fa6f2059cd Jul 08 11:14:25.699480 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.699450 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-469dh\"" Jul 08 11:14:25.707066 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.707050 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:14:25.840666 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.840636 2563 patch_prober.go:28] interesting pod/image-registry-57996cdb88-55tq5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 11:14:25.840854 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.840689 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 11:14:25.841152 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.841131 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mzq7c"] Jul 08 11:14:25.845456 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:25.845430 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437d253d_82a8_42a4_a231_67934d477857.slice/crio-680243a6421d23516b51dabdffdc98e5e516023d823395c7fd0cd528ac6fc836 WatchSource:0}: Error finding container 680243a6421d23516b51dabdffdc98e5e516023d823395c7fd0cd528ac6fc836: Status 404 returned error can't find the container with id 680243a6421d23516b51dabdffdc98e5e516023d823395c7fd0cd528ac6fc836 Jul 08 11:14:25.886726 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.886701 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qd6qz" event={"ID":"62f21c1b-f7db-4fd1-8500-6d2046c94e7e","Type":"ContainerStarted","Data":"161093f0cc3a56c18c75a3553438cc7bd077b6d829fe351f81d9970664a8a60e"} Jul 08 11:14:25.887723 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.887692 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4jsp" event={"ID":"167945b6-9c4a-4527-86bd-976af4499b0e","Type":"ContainerStarted","Data":"b0773e9d85e92d8667eaba26ce76ae38688cb4a950a2384a20e796fa6f2059cd"} Jul 08 11:14:25.888646 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:25.888627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mzq7c" event={"ID":"437d253d-82a8-42a4-a231-67934d477857","Type":"ContainerStarted","Data":"680243a6421d23516b51dabdffdc98e5e516023d823395c7fd0cd528ac6fc836"} Jul 08 11:14:27.900827 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:27.900786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4jsp" event={"ID":"167945b6-9c4a-4527-86bd-976af4499b0e","Type":"ContainerStarted","Data":"8e77cfcb5da8ad22e0e4b1f07ec2945eaf7e41b9dd5df6e491e09e63e0551777"} Jul 08 11:14:27.901297 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:27.900882 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4jsp" event={"ID":"167945b6-9c4a-4527-86bd-976af4499b0e","Type":"ContainerStarted","Data":"283d0c073e6a9502cdd6d9f7970d9f040985b07f52eea9d02e3c132e32051f1d"} Jul 08 11:14:30.912169 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:30.912068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mzq7c" event={"ID":"437d253d-82a8-42a4-a231-67934d477857","Type":"ContainerStarted","Data":"86f80eba88674b45ca0119549bbe11abdde960f8a661830b21bfdc133df5be0c"} Jul 08 11:14:30.912169 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:30.912158 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:14:30.913611 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:30.913582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qd6qz" event={"ID":"62f21c1b-f7db-4fd1-8500-6d2046c94e7e","Type":"ContainerStarted","Data":"e1a2313f1da356ebd1ad7eb69bd1b317aaad6b70230d1476c1922430970caf30"} Jul 08 11:14:30.947856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:30.947812 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x4jsp" podStartSLOduration=69.549976453 podStartE2EDuration="1m10.947798615s" totalImagesPullingTime="1.397822162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:27.930073503 +0000 UTC m=+68.866746092" watchObservedRunningTime="2026-07-08 11:14:30.947798615 +0000 UTC m=+71.884471185" Jul 08 11:14:30.986298 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:30.986250 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qd6qz" podStartSLOduration=65.936313258 podStartE2EDuration="1m10.98622965s" totalImagesPullingTime="5.049916392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:30.986121086 +0000 UTC m=+71.922793656" watchObservedRunningTime="2026-07-08 11:14:30.98622965 +0000 UTC m=+71.922902220" Jul 08 11:14:30.986576 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:30.986555 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mzq7c" podStartSLOduration=66.250595427 podStartE2EDuration="1m10.986548148s" totalImagesPullingTime="4.735952721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:30.947894122 +0000 UTC m=+71.884566670" watchObservedRunningTime="2026-07-08 11:14:30.986548148 +0000 UTC m=+71.923220717" Jul 08 11:14:33.545265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:33.545230 2563 patch_prober.go:28] interesting pod/image-registry-57996cdb88-55tq5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 11:14:33.545663 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:33.545283 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 11:14:35.839903 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:35.839855 2563 patch_prober.go:28] interesting pod/image-registry-57996cdb88-55tq5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 11:14:35.840332 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:35.839920 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 11:14:39.996752 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:39.996718 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57996cdb88-55tq5"] Jul 08 11:14:40.001206 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.001175 2563 patch_prober.go:28] interesting pod/image-registry-57996cdb88-55tq5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 11:14:40.001382 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.001230 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 11:14:40.062091 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.062055 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79b5fc7878-5pdgl"] Jul 08 11:14:40.065439 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.065424 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089810 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f11149d0-8210-422a-9d69-babccfe6d9bf-registry-certificates\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089810 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f11149d0-8210-422a-9d69-babccfe6d9bf-installation-pull-secrets\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089956 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f11149d0-8210-422a-9d69-babccfe6d9bf-trusted-ca\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089956 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-registry-tls\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089956 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-bound-sa-token\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089956 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f11149d0-8210-422a-9d69-babccfe6d9bf-image-registry-private-configuration\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.089956 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f11149d0-8210-422a-9d69-babccfe6d9bf-ca-trust-extracted\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.090115 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.089971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8vdb\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-kube-api-access-j8vdb\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.095479 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.095454 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79b5fc7878-5pdgl"] Jul 08 11:14:40.146860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.146825 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-pplp7"] Jul 08 11:14:40.150975 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.150955 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-52qtb"] Jul 08 11:14:40.151093 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.151078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:14:40.154153 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.154135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5czk4\"" Jul 08 11:14:40.154262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.154203 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 11:14:40.154262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.154254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 11:14:40.154647 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.154630 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g"] Jul 08 11:14:40.154763 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.154742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.158154 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.158138 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:40.160407 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.160388 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 11:14:40.160627 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.160607 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 11:14:40.160720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.160648 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 11:14:40.160779 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.160722 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 11:14:40.160905 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.160884 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-spk7g\"" Jul 08 11:14:40.161002 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.160985 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 11:14:40.161746 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.161730 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5prrl\"" Jul 08 11:14:40.167070 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.167049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g"] Jul 08 11:14:40.170561 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.170545 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-52qtb"] Jul 08 11:14:40.173173 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.173146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-pplp7"] Jul 08 11:14:40.190807 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.190775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fsw2g\" (UID: \"b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:40.190807 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.190810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f11149d0-8210-422a-9d69-babccfe6d9bf-image-registry-private-configuration\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.190950 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.190842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93051d59-67e7-4ca6-a396-12324852cf62-data-volume\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.190950 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.190868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8vdb\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-kube-api-access-j8vdb\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191013 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.190958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5dcq\" (UniqueName: \"kubernetes.io/projected/93051d59-67e7-4ca6-a396-12324852cf62-kube-api-access-l5dcq\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.191013 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.190996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93051d59-67e7-4ca6-a396-12324852cf62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.191102 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdj8\" (UniqueName: \"kubernetes.io/projected/30160d1d-928f-4336-8dcc-eb67e3a19449-kube-api-access-hsdj8\") pod \"downloads-685bfb5f64-pplp7\" (UID: \"30160d1d-928f-4336-8dcc-eb67e3a19449\") " pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:14:40.191102 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f11149d0-8210-422a-9d69-babccfe6d9bf-trusted-ca\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191204 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-registry-tls\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191204 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-bound-sa-token\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191204 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f11149d0-8210-422a-9d69-babccfe6d9bf-ca-trust-extracted\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191338 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93051d59-67e7-4ca6-a396-12324852cf62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.191338 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f11149d0-8210-422a-9d69-babccfe6d9bf-registry-certificates\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191432 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f11149d0-8210-422a-9d69-babccfe6d9bf-installation-pull-secrets\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.191432 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93051d59-67e7-4ca6-a396-12324852cf62-crio-socket\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.191710 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.191688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f11149d0-8210-422a-9d69-babccfe6d9bf-ca-trust-extracted\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.192106 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.192086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f11149d0-8210-422a-9d69-babccfe6d9bf-registry-certificates\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.192616 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.192590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f11149d0-8210-422a-9d69-babccfe6d9bf-trusted-ca\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.193773 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.193751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f11149d0-8210-422a-9d69-babccfe6d9bf-image-registry-private-configuration\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.193880 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.193864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-registry-tls\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.194144 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.194126 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f11149d0-8210-422a-9d69-babccfe6d9bf-installation-pull-secrets\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.200747 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.200728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-bound-sa-token\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.203165 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.203146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8vdb\" (UniqueName: \"kubernetes.io/projected/f11149d0-8210-422a-9d69-babccfe6d9bf-kube-api-access-j8vdb\") pod \"image-registry-79b5fc7878-5pdgl\" (UID: \"f11149d0-8210-422a-9d69-babccfe6d9bf\") " pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.292380 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93051d59-67e7-4ca6-a396-12324852cf62-crio-socket\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.292380 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fsw2g\" (UID: \"b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:40.292380 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93051d59-67e7-4ca6-a396-12324852cf62-data-volume\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.292380 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5dcq\" (UniqueName: \"kubernetes.io/projected/93051d59-67e7-4ca6-a396-12324852cf62-kube-api-access-l5dcq\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.292380 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292368 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93051d59-67e7-4ca6-a396-12324852cf62-crio-socket\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.292780 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93051d59-67e7-4ca6-a396-12324852cf62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.292916 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdj8\" (UniqueName: \"kubernetes.io/projected/30160d1d-928f-4336-8dcc-eb67e3a19449-kube-api-access-hsdj8\") pod \"downloads-685bfb5f64-pplp7\" (UID: \"30160d1d-928f-4336-8dcc-eb67e3a19449\") " pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:14:40.293000 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.292969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93051d59-67e7-4ca6-a396-12324852cf62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.293105 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.293082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93051d59-67e7-4ca6-a396-12324852cf62-data-volume\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.293583 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.293557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93051d59-67e7-4ca6-a396-12324852cf62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.296702 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.296312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fsw2g\" (UID: \"b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:40.297657 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.297627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93051d59-67e7-4ca6-a396-12324852cf62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.313461 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.313431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdj8\" (UniqueName: \"kubernetes.io/projected/30160d1d-928f-4336-8dcc-eb67e3a19449-kube-api-access-hsdj8\") pod \"downloads-685bfb5f64-pplp7\" (UID: \"30160d1d-928f-4336-8dcc-eb67e3a19449\") " pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:14:40.313587 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.313564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5dcq\" (UniqueName: \"kubernetes.io/projected/93051d59-67e7-4ca6-a396-12324852cf62-kube-api-access-l5dcq\") pod \"insights-runtime-extractor-52qtb\" (UID: \"93051d59-67e7-4ca6-a396-12324852cf62\") " pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.373807 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.373778 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.460827 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.460796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:14:40.466606 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.466575 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-52qtb" Jul 08 11:14:40.473490 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.473465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:40.526013 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.523494 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79b5fc7878-5pdgl"] Jul 08 11:14:40.636285 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.636247 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-pplp7"] Jul 08 11:14:40.640213 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:40.640188 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30160d1d_928f_4336_8dcc_eb67e3a19449.slice/crio-08eb2713158947b23b3fbb47d3bc1b023d2c47c07985cb66a11385796a7dd46b WatchSource:0}: Error finding container 08eb2713158947b23b3fbb47d3bc1b023d2c47c07985cb66a11385796a7dd46b: Status 404 returned error can't find the container with id 08eb2713158947b23b3fbb47d3bc1b023d2c47c07985cb66a11385796a7dd46b Jul 08 11:14:40.677156 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.677120 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g"] Jul 08 11:14:40.686293 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:40.686258 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fa5f61_3f9a_4d89_a6ea_6b7c51eef4c0.slice/crio-4d9b397624beeb8de7558fd4d61dbee330ece34ba8cb2c3fe95b3970637e3a99 WatchSource:0}: Error finding container 4d9b397624beeb8de7558fd4d61dbee330ece34ba8cb2c3fe95b3970637e3a99: Status 404 returned error can't find the container with id 4d9b397624beeb8de7558fd4d61dbee330ece34ba8cb2c3fe95b3970637e3a99 Jul 08 11:14:40.854352 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.854330 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-52qtb"] Jul 08 11:14:40.856556 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:40.856528 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93051d59_67e7_4ca6_a396_12324852cf62.slice/crio-a2476f312679b692688531103a70d0148e94b6b708ea7358b2cc5e9a3a5fe4c8 WatchSource:0}: Error finding container a2476f312679b692688531103a70d0148e94b6b708ea7358b2cc5e9a3a5fe4c8: Status 404 returned error can't find the container with id a2476f312679b692688531103a70d0148e94b6b708ea7358b2cc5e9a3a5fe4c8 Jul 08 11:14:40.947676 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.947640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52qtb" event={"ID":"93051d59-67e7-4ca6-a396-12324852cf62","Type":"ContainerStarted","Data":"a2476f312679b692688531103a70d0148e94b6b708ea7358b2cc5e9a3a5fe4c8"} Jul 08 11:14:40.948890 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.948855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" event={"ID":"b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0","Type":"ContainerStarted","Data":"4d9b397624beeb8de7558fd4d61dbee330ece34ba8cb2c3fe95b3970637e3a99"} Jul 08 11:14:40.950093 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.950068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-pplp7" event={"ID":"30160d1d-928f-4336-8dcc-eb67e3a19449","Type":"ContainerStarted","Data":"08eb2713158947b23b3fbb47d3bc1b023d2c47c07985cb66a11385796a7dd46b"} Jul 08 11:14:40.951520 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.951491 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" event={"ID":"f11149d0-8210-422a-9d69-babccfe6d9bf","Type":"ContainerStarted","Data":"17723e9873248b7e93ba228bdc44ebc8007e53cddb9be5971c9887e0ef43d855"} Jul 08 11:14:40.951644 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.951551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" event={"ID":"f11149d0-8210-422a-9d69-babccfe6d9bf","Type":"ContainerStarted","Data":"8cbb7a1d61d6b183bb48e4dd48f9900b46235ff46754fd280ff1f2bc70bc444f"} Jul 08 11:14:40.951644 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.951620 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:14:40.983873 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:40.983827 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" podStartSLOduration=0.983812706 podStartE2EDuration="983.812706ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:40.983261524 +0000 UTC m=+81.919934114" watchObservedRunningTime="2026-07-08 11:14:40.983812706 +0000 UTC m=+81.920485275" Jul 08 11:14:42.964390 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:42.964351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" event={"ID":"b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0","Type":"ContainerStarted","Data":"24b3e11369f84606ae86b7523514b6ceebbc0df7165b9d43578e85579744a905"} Jul 08 11:14:42.964894 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:42.964815 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:42.970707 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:42.970679 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" Jul 08 11:14:42.987408 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:42.987360 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fsw2g" podStartSLOduration=1.306561755 podStartE2EDuration="2.987345322s" totalImagesPullingTime="1.680783567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:42.985144778 +0000 UTC m=+83.921817397" watchObservedRunningTime="2026-07-08 11:14:42.987345322 +0000 UTC m=+83.924017870" Jul 08 11:14:43.932420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.931582 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh"] Jul 08 11:14:43.955005 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.954966 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh"] Jul 08 11:14:43.955149 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.955099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:43.958744 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.958717 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 11:14:43.959550 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.959527 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7h9pv\"" Jul 08 11:14:43.959718 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.959705 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 11:14:43.959876 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.959863 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 11:14:43.960084 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.960071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 11:14:43.960738 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:43.960717 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 11:14:44.022372 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.022333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.022859 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.022399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.022859 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.022421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbgs\" (UniqueName: \"kubernetes.io/projected/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-kube-api-access-gmbgs\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.022859 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.022446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.123690 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.123656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.123865 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.123700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbgs\" (UniqueName: \"kubernetes.io/projected/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-kube-api-access-gmbgs\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.123865 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.123732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.123865 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.123782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.123865 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:14:44.123847 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 11:14:44.124090 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:14:44.123941 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-tls podName:0d8596fe-4cc9-41b8-ab08-7ade1c0af248 nodeName:}" failed. No retries permitted until 2026-07-08 11:14:44.623917273 +0000 UTC m=+85.560589842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-tzxqh" (UID: "0d8596fe-4cc9-41b8-ab08-7ade1c0af248") : secret "prometheus-operator-tls" not found Jul 08 11:14:44.124485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.124464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.126923 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.126897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.133237 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.133205 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbgs\" (UniqueName: \"kubernetes.io/projected/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-kube-api-access-gmbgs\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.628524 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.628482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.638794 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.638769 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d8596fe-4cc9-41b8-ab08-7ade1c0af248-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzxqh\" (UID: \"0d8596fe-4cc9-41b8-ab08-7ade1c0af248\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:44.872790 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:44.872755 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" Jul 08 11:14:45.417079 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:45.417044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh"] Jul 08 11:14:45.421151 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:45.421117 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8596fe_4cc9_41b8_ab08_7ade1c0af248.slice/crio-cca45035b402abdf1306ad82c9f55f187ba1460311302c39491d40ef4e700fdf WatchSource:0}: Error finding container cca45035b402abdf1306ad82c9f55f187ba1460311302c39491d40ef4e700fdf: Status 404 returned error can't find the container with id cca45035b402abdf1306ad82c9f55f187ba1460311302c39491d40ef4e700fdf Jul 08 11:14:45.979481 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:45.979446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52qtb" event={"ID":"93051d59-67e7-4ca6-a396-12324852cf62","Type":"ContainerStarted","Data":"e4456404254687b30baa6ebdef29bab2dbc3646eb0c115d6a72a2f159e5d9643"} Jul 08 11:14:45.980733 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:45.980687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" event={"ID":"0d8596fe-4cc9-41b8-ab08-7ade1c0af248","Type":"ContainerStarted","Data":"cca45035b402abdf1306ad82c9f55f187ba1460311302c39491d40ef4e700fdf"} Jul 08 11:14:46.990096 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:46.989999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52qtb" event={"ID":"93051d59-67e7-4ca6-a396-12324852cf62","Type":"ContainerStarted","Data":"131be05f7ffa64a7ef7539432852389b1c58ca6d32fc53b57aead38f5a6e9a06"} Jul 08 11:14:46.993110 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:46.993080 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" event={"ID":"0d8596fe-4cc9-41b8-ab08-7ade1c0af248","Type":"ContainerStarted","Data":"d050e3a8be05a789f89b77b13a5b5d3c02ca2ac251c6b5626967fbd528174122"} Jul 08 11:14:46.993233 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:46.993137 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" event={"ID":"0d8596fe-4cc9-41b8-ab08-7ade1c0af248","Type":"ContainerStarted","Data":"f0444a4de6540fe37a842efc53a097c9d6552d8e643da4fde9f3f1a294c4ece4"} Jul 08 11:14:47.024732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:47.024666 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzxqh" podStartSLOduration=2.759520656 podStartE2EDuration="4.024644927s" totalImagesPullingTime="1.265124271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:47.023142676 +0000 UTC m=+87.959815247" watchObservedRunningTime="2026-07-08 11:14:47.024644927 +0000 UTC m=+87.961317498" Jul 08 11:14:49.855845 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.855811 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hrcwl"] Jul 08 11:14:49.859098 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.859082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.866951 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.866931 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 11:14:49.867169 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.867154 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 11:14:49.867555 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.867541 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bm97j\"" Jul 08 11:14:49.867611 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.867566 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 11:14:49.969529 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-wtmp\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-root\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9qg\" (UniqueName: \"kubernetes.io/projected/d9024072-1aca-40fc-9b50-65311bd51e43-kube-api-access-fc9qg\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-tls\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-textfile\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969853 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-accelerators-collector-config\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969853 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9024072-1aca-40fc-9b50-65311bd51e43-metrics-client-ca\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:49.969853 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:49.969755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-sys\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.001522 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.001487 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:14:50.006242 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.006214 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52qtb" event={"ID":"93051d59-67e7-4ca6-a396-12324852cf62","Type":"ContainerStarted","Data":"413aada392c5d5ad4adf1668e4e95004cdc9e9e5d248a8ba9e23dfcdb49f50ab"} Jul 08 11:14:50.071094 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-tls\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-textfile\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-accelerators-collector-config\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9024072-1aca-40fc-9b50-65311bd51e43-metrics-client-ca\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-sys\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071265 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-wtmp\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071554 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-root\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071554 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071554 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9qg\" (UniqueName: \"kubernetes.io/projected/d9024072-1aca-40fc-9b50-65311bd51e43-kube-api-access-fc9qg\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071659 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-textfile\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-sys\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-root\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.071817 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.071746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-wtmp\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.072481 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.072454 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-accelerators-collector-config\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.072641 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.072538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9024072-1aca-40fc-9b50-65311bd51e43-metrics-client-ca\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.074076 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.074054 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-tls\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.074218 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.074199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9024072-1aca-40fc-9b50-65311bd51e43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.089581 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.089536 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-52qtb" podStartSLOduration=1.952136906 podStartE2EDuration="10.089504477s" totalImagesPullingTime="8.137367571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:14:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:50.088008871 +0000 UTC m=+91.024681470" watchObservedRunningTime="2026-07-08 11:14:50.089504477 +0000 UTC m=+91.026177048" Jul 08 11:14:50.094797 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.094775 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9qg\" (UniqueName: \"kubernetes.io/projected/d9024072-1aca-40fc-9b50-65311bd51e43-kube-api-access-fc9qg\") pod \"node-exporter-hrcwl\" (UID: \"d9024072-1aca-40fc-9b50-65311bd51e43\") " pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.168053 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:50.167958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hrcwl" Jul 08 11:14:50.180025 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:14:50.179996 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9024072_1aca_40fc_9b50_65311bd51e43.slice/crio-e2690093019712162bfff616fc3f6a75e30845306de89e3f4a4375564cf3d1f0 WatchSource:0}: Error finding container e2690093019712162bfff616fc3f6a75e30845306de89e3f4a4375564cf3d1f0: Status 404 returned error can't find the container with id e2690093019712162bfff616fc3f6a75e30845306de89e3f4a4375564cf3d1f0 Jul 08 11:14:51.013078 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:51.013035 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hrcwl" event={"ID":"d9024072-1aca-40fc-9b50-65311bd51e43","Type":"ContainerStarted","Data":"e2690093019712162bfff616fc3f6a75e30845306de89e3f4a4375564cf3d1f0"} Jul 08 11:14:52.018922 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:52.018880 2563 generic.go:356] "Generic (PLEG): container finished" podID="d9024072-1aca-40fc-9b50-65311bd51e43" containerID="6900f7c28addcce3eac0d4497377506d6d5fe15f4247f9f5abc1f3917726efd8" exitCode=0 Jul 08 11:14:52.019313 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:52.018967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hrcwl" event={"ID":"d9024072-1aca-40fc-9b50-65311bd51e43","Type":"ContainerDied","Data":"6900f7c28addcce3eac0d4497377506d6d5fe15f4247f9f5abc1f3917726efd8"} Jul 08 11:14:53.026157 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:53.026116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hrcwl" event={"ID":"d9024072-1aca-40fc-9b50-65311bd51e43","Type":"ContainerStarted","Data":"b93999f0b25a17c80dba0af36b9f9f5de605ab7c74fdd232e395665b873fcba4"} Jul 08 11:14:53.026601 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:14:53.026222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hrcwl" event={"ID":"d9024072-1aca-40fc-9b50-65311bd51e43","Type":"ContainerStarted","Data":"de62e60603820530ccce0028f7e1f2a08b6b7e83ecc7f294b3cd73a67b7b6d49"} Jul 08 11:15:01.059562 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.059498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-pplp7" event={"ID":"30160d1d-928f-4336-8dcc-eb67e3a19449","Type":"ContainerStarted","Data":"69da1f4abe8b59f134f51fcab5079e271396a44d40d70992a31c19085cc15072"} Jul 08 11:15:01.060104 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.059730 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:15:01.075262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.075236 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-pplp7" Jul 08 11:15:01.100877 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.100817 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hrcwl" podStartSLOduration=10.712962532 podStartE2EDuration="12.100797584s" totalImagesPullingTime="1.309257478s" totalInitContainerRuntime="78.577574ms" isStatefulPod=true podCreationTimestamp="2026-07-08 11:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:14:53.063691542 +0000 UTC m=+94.000364142" watchObservedRunningTime="2026-07-08 11:15:01.100797584 +0000 UTC m=+102.037470154" Jul 08 11:15:01.101095 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.101062 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-pplp7" podStartSLOduration=1.410537128 podStartE2EDuration="21.101055034s" totalImagesPullingTime="19.690517906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:15:01.100658406 +0000 UTC m=+102.037330998" watchObservedRunningTime="2026-07-08 11:15:01.101055034 +0000 UTC m=+102.037727603" Jul 08 11:15:01.919201 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.919167 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mzq7c" Jul 08 11:15:01.963254 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:01.963222 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79b5fc7878-5pdgl" Jul 08 11:15:05.024613 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.024539 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" containerID="cri-o://a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502" gracePeriod=30 Jul 08 11:15:05.316148 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.316111 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:15:05.401086 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401047 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-installation-pull-secrets\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.401267 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401110 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvc22\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-kube-api-access-fvc22\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401477 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-ca-trust-extracted\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401544 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401573 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-trusted-ca\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401599 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-image-registry-private-configuration\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401633 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-bound-sa-token\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401677 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-certificates\") pod \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\" (UID: \"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda\") " Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.401965 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 11:15:05.402195 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.402156 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 11:15:05.406233 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.406203 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 11:15:05.406483 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.406432 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:15:05.406610 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.406496 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:15:05.406610 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.406596 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-kube-api-access-fvc22" (OuterVolumeSpecName: "kube-api-access-fvc22") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "kube-api-access-fvc22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:15:05.406899 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.406867 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 11:15:05.412705 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.412680 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" (UID: "cdc4680a-0cfe-4cf8-a5ce-59a51132fcda"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:15:05.503053 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503012 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-bound-sa-token\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503053 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503046 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-certificates\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503053 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503057 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-installation-pull-secrets\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503301 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503067 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvc22\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-kube-api-access-fvc22\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503301 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503076 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-ca-trust-extracted\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503301 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503091 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-registry-tls\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503301 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503105 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-trusted-ca\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:05.503301 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:05.503120 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda-image-registry-private-configuration\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:15:06.080035 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.079996 2563 generic.go:356] "Generic (PLEG): container finished" podID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerID="a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502" exitCode=0 Jul 08 11:15:06.080420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.080096 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" event={"ID":"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda","Type":"ContainerDied","Data":"a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502"} Jul 08 11:15:06.080420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.080142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" event={"ID":"cdc4680a-0cfe-4cf8-a5ce-59a51132fcda","Type":"ContainerDied","Data":"1c104548e5c4bf0401ff777822e381c92ade2e74a63e1959acf0570ca7f59c59"} Jul 08 11:15:06.080420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.080162 2563 scope.go:117] "RemoveContainer" containerID="a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502" Jul 08 11:15:06.080420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.080303 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57996cdb88-55tq5" Jul 08 11:15:06.089758 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.089736 2563 scope.go:117] "RemoveContainer" containerID="a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502" Jul 08 11:15:06.090077 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:15:06.090037 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502\": container with ID starting with a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502 not found: ID does not exist" containerID="a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502" Jul 08 11:15:06.090193 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.090083 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502"} err="failed to get container status \"a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502\": rpc error: code = NotFound desc = could not find container \"a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502\": container with ID starting with a3de2e7b5f628add382d9cfe5a4bd7fb3740f549c7fa9dc559bca7eeab3f8502 not found: ID does not exist" Jul 08 11:15:06.113442 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.113409 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57996cdb88-55tq5"] Jul 08 11:15:06.124200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:06.124169 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57996cdb88-55tq5"] Jul 08 11:15:07.574644 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:15:07.574610 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" path="/var/lib/kubelet/pods/cdc4680a-0cfe-4cf8-a5ce-59a51132fcda/volumes" Jul 08 11:18:19.422431 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:18:19.422407 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 11:21:49.690585 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.690551 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6"] Jul 08 11:21:49.691055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.690903 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" Jul 08 11:21:49.691055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.690921 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" Jul 08 11:21:49.691055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.690998 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc4680a-0cfe-4cf8-a5ce-59a51132fcda" containerName="registry" Jul 08 11:21:49.692780 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.692763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.695840 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.695819 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 11:21:49.695929 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.695819 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 11:21:49.697281 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.697260 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 11:21:49.697387 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.697283 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 11:21:49.707865 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.707834 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6"] Jul 08 11:21:49.817403 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.817366 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j"] Jul 08 11:21:49.819259 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.819244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:49.822818 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.822795 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 11:21:49.823121 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.823111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lswrv\"" Jul 08 11:21:49.824004 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.823985 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n"] Jul 08 11:21:49.825948 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.825869 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.829051 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c670061-0b4b-45ca-9425-2f1226d1f286-tmp\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.829132 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c670061-0b4b-45ca-9425-2f1226d1f286-klusterlet-config\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.829132 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tp4m\" (UniqueName: \"kubernetes.io/projected/1c670061-0b4b-45ca-9425-2f1226d1f286-kube-api-access-9tp4m\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.829599 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829581 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 11:21:49.829640 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829622 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 11:21:49.829685 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829668 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 11:21:49.829815 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.829800 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 11:21:49.834699 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.834683 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j"] Jul 08 11:21:49.841367 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.841345 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n"] Jul 08 11:21:49.929978 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.929948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-hub\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.929978 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.929982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c670061-0b4b-45ca-9425-2f1226d1f286-tmp\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.930199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.930199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c670061-0b4b-45ca-9425-2f1226d1f286-klusterlet-config\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.930199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a3dd784-b078-45cb-b1ca-7ce0f3ef6127-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65cd6f8546-grq7j\" (UID: \"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:49.930199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.930199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9dmh\" (UniqueName: \"kubernetes.io/projected/41139c43-78d3-4693-adaa-79e8f7b9445c-kube-api-access-m9dmh\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.930392 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-ca\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.930392 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/41139c43-78d3-4693-adaa-79e8f7b9445c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:49.930392 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw79w\" (UniqueName: \"kubernetes.io/projected/1a3dd784-b078-45cb-b1ca-7ce0f3ef6127-kube-api-access-xw79w\") pod \"managed-serviceaccount-addon-agent-65cd6f8546-grq7j\" (UID: \"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:49.930392 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tp4m\" (UniqueName: \"kubernetes.io/projected/1c670061-0b4b-45ca-9425-2f1226d1f286-kube-api-access-9tp4m\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.930550 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.930402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c670061-0b4b-45ca-9425-2f1226d1f286-tmp\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.932555 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.932539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c670061-0b4b-45ca-9425-2f1226d1f286-klusterlet-config\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:49.940386 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:49.940365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tp4m\" (UniqueName: \"kubernetes.io/projected/1c670061-0b4b-45ca-9425-2f1226d1f286-kube-api-access-9tp4m\") pod \"klusterlet-addon-workmgr-66fd6bc48b-2p4k6\" (UID: \"1c670061-0b4b-45ca-9425-2f1226d1f286\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:50.003038 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.002966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:50.031090 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-ca\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.031244 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/41139c43-78d3-4693-adaa-79e8f7b9445c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.031244 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw79w\" (UniqueName: \"kubernetes.io/projected/1a3dd784-b078-45cb-b1ca-7ce0f3ef6127-kube-api-access-xw79w\") pod \"managed-serviceaccount-addon-agent-65cd6f8546-grq7j\" (UID: \"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:50.031244 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-hub\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.031244 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.031244 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a3dd784-b078-45cb-b1ca-7ce0f3ef6127-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65cd6f8546-grq7j\" (UID: \"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:50.031244 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.031575 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.031261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9dmh\" (UniqueName: \"kubernetes.io/projected/41139c43-78d3-4693-adaa-79e8f7b9445c-kube-api-access-m9dmh\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.032039 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.032008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/41139c43-78d3-4693-adaa-79e8f7b9445c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.034077 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.034029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a3dd784-b078-45cb-b1ca-7ce0f3ef6127-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65cd6f8546-grq7j\" (UID: \"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:50.034702 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.034316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-ca\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.034702 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.034662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.034702 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.034677 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-hub\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.034702 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.034662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41139c43-78d3-4693-adaa-79e8f7b9445c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.040167 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.040144 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw79w\" (UniqueName: \"kubernetes.io/projected/1a3dd784-b078-45cb-b1ca-7ce0f3ef6127-kube-api-access-xw79w\") pod \"managed-serviceaccount-addon-agent-65cd6f8546-grq7j\" (UID: \"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:50.040262 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.040243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9dmh\" (UniqueName: \"kubernetes.io/projected/41139c43-78d3-4693-adaa-79e8f7b9445c-kube-api-access-m9dmh\") pod \"cluster-proxy-proxy-agent-659b4cdcbd-gsf2n\" (UID: \"41139c43-78d3-4693-adaa-79e8f7b9445c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.133425 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.133389 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6"] Jul 08 11:21:50.135628 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:21:50.135602 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c670061_0b4b_45ca_9425_2f1226d1f286.slice/crio-2d033342ec466b54cb2109061f195b6bb9b695d61830ca8ca9d0a16da69ad540 WatchSource:0}: Error finding container 2d033342ec466b54cb2109061f195b6bb9b695d61830ca8ca9d0a16da69ad540: Status 404 returned error can't find the container with id 2d033342ec466b54cb2109061f195b6bb9b695d61830ca8ca9d0a16da69ad540 Jul 08 11:21:50.137293 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.137272 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 11:21:50.144012 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.143989 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" Jul 08 11:21:50.150601 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.150496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" Jul 08 11:21:50.278566 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.278537 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j"] Jul 08 11:21:50.280490 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:21:50.280466 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a3dd784_b078_45cb_b1ca_7ce0f3ef6127.slice/crio-3bfd272a997685a344e65afcf281f17edcd21d134c9b1208d3fd7a081e0e12f0 WatchSource:0}: Error finding container 3bfd272a997685a344e65afcf281f17edcd21d134c9b1208d3fd7a081e0e12f0: Status 404 returned error can't find the container with id 3bfd272a997685a344e65afcf281f17edcd21d134c9b1208d3fd7a081e0e12f0 Jul 08 11:21:50.297889 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.297864 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n"] Jul 08 11:21:50.300380 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:21:50.300359 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41139c43_78d3_4693_adaa_79e8f7b9445c.slice/crio-1a7f325ce2aefc3e205e942e8906d27e4d828c5a3ad3bcd9e5e5189c32353213 WatchSource:0}: Error finding container 1a7f325ce2aefc3e205e942e8906d27e4d828c5a3ad3bcd9e5e5189c32353213: Status 404 returned error can't find the container with id 1a7f325ce2aefc3e205e942e8906d27e4d828c5a3ad3bcd9e5e5189c32353213 Jul 08 11:21:50.337253 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.337226 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" event={"ID":"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127","Type":"ContainerStarted","Data":"3bfd272a997685a344e65afcf281f17edcd21d134c9b1208d3fd7a081e0e12f0"} Jul 08 11:21:50.338141 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.338120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" event={"ID":"1c670061-0b4b-45ca-9425-2f1226d1f286","Type":"ContainerStarted","Data":"2d033342ec466b54cb2109061f195b6bb9b695d61830ca8ca9d0a16da69ad540"} Jul 08 11:21:50.339074 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:50.339049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" event={"ID":"41139c43-78d3-4693-adaa-79e8f7b9445c","Type":"ContainerStarted","Data":"1a7f325ce2aefc3e205e942e8906d27e4d828c5a3ad3bcd9e5e5189c32353213"} Jul 08 11:21:54.357869 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:54.357835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" event={"ID":"1a3dd784-b078-45cb-b1ca-7ce0f3ef6127","Type":"ContainerStarted","Data":"f6292fa6b8766eb97dbf1c4acc147f11966664f1ce6def87004e0ed7ba1ec2d2"} Jul 08 11:21:54.359344 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:54.359323 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" event={"ID":"1c670061-0b4b-45ca-9425-2f1226d1f286","Type":"ContainerStarted","Data":"fc343225559e29d6c497fb68cc05ef5876dea4773cf8e556ae0e6f3874527e5c"} Jul 08 11:21:54.359547 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:54.359530 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:54.361126 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:54.361102 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" Jul 08 11:21:54.372571 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:54.372489 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65cd6f8546-grq7j" podStartSLOduration=1.789051621 podStartE2EDuration="5.37247706s" totalImagesPullingTime="3.583425439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:21:54.372019853 +0000 UTC m=+515.308692423" watchObservedRunningTime="2026-07-08 11:21:54.37247706 +0000 UTC m=+515.309149629" Jul 08 11:21:54.389456 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:21:54.389413 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66fd6bc48b-2p4k6" podStartSLOduration=1.6507837909999998 podStartE2EDuration="5.389399456s" totalImagesPullingTime="3.738615665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:21:54.388781803 +0000 UTC m=+515.325454375" watchObservedRunningTime="2026-07-08 11:21:54.389399456 +0000 UTC m=+515.326072026" Jul 08 11:22:12.424021 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:12.423981 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" event={"ID":"41139c43-78d3-4693-adaa-79e8f7b9445c","Type":"ContainerStarted","Data":"607cc9be3394f84ec3c70dd6b52812925e0df93e43b23fe53e52b63cf7dd3b83"} Jul 08 11:22:12.424412 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:12.424034 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" event={"ID":"41139c43-78d3-4693-adaa-79e8f7b9445c","Type":"ContainerStarted","Data":"222733ffb594bb96df996b4d3e5429834f3728e68c86a89f45f1ce249a10e958"} Jul 08 11:22:12.424412 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:12.424052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" event={"ID":"41139c43-78d3-4693-adaa-79e8f7b9445c","Type":"ContainerStarted","Data":"309d1798bb8f5ba45400f1fd466fa5ed609529f1bb4ba8a0a32361150cfdc936"} Jul 08 11:22:12.443480 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:12.443436 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-659b4cdcbd-gsf2n" podStartSLOduration=1.88627363 podStartE2EDuration="23.443423246s" totalImagesPullingTime="21.557149616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:22:12.443277293 +0000 UTC m=+533.379949862" watchObservedRunningTime="2026-07-08 11:22:12.443423246 +0000 UTC m=+533.380095816" Jul 08 11:22:52.840721 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.840684 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt"] Jul 08 11:22:52.842661 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.842644 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:52.847218 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.847197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bhz7d\"" Jul 08 11:22:52.847359 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.847219 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 11:22:52.847927 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.847912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 11:22:52.848865 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.848564 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 11:22:52.848865 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.848590 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 11:22:52.870466 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.870444 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt"] Jul 08 11:22:52.997336 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.997299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40366692-b290-466d-8cd3-51dbb425418f-manifests\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:52.997336 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.997337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40366692-b290-466d-8cd3-51dbb425418f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:52.997551 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.997356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40366692-b290-466d-8cd3-51dbb425418f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:52.997551 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.997418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40366692-b290-466d-8cd3-51dbb425418f-tmp\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:52.997551 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:52.997458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c48gs\" (UniqueName: \"kubernetes.io/projected/40366692-b290-466d-8cd3-51dbb425418f-kube-api-access-c48gs\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.098720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.098635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40366692-b290-466d-8cd3-51dbb425418f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.098720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.098680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40366692-b290-466d-8cd3-51dbb425418f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.098720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.098702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40366692-b290-466d-8cd3-51dbb425418f-tmp\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.098921 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.098732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c48gs\" (UniqueName: \"kubernetes.io/projected/40366692-b290-466d-8cd3-51dbb425418f-kube-api-access-c48gs\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.098921 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.098776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40366692-b290-466d-8cd3-51dbb425418f-manifests\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.099206 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.099178 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40366692-b290-466d-8cd3-51dbb425418f-manifests\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.101128 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.101107 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40366692-b290-466d-8cd3-51dbb425418f-tmp\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.101222 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.101206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40366692-b290-466d-8cd3-51dbb425418f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.101324 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.101306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40366692-b290-466d-8cd3-51dbb425418f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.110674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.110651 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c48gs\" (UniqueName: \"kubernetes.io/projected/40366692-b290-466d-8cd3-51dbb425418f-kube-api-access-c48gs\") pod \"opendatahub-operator-controller-manager-79c9b86684-27stt\" (UID: \"40366692-b290-466d-8cd3-51dbb425418f\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.151598 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.151567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:53.280485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.280453 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt"] Jul 08 11:22:53.283428 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:22:53.283403 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40366692_b290_466d_8cd3_51dbb425418f.slice/crio-86a2bfeac2bbcb0dc1aaff4d63c3000ac9ad08f50d8fbe897075aac111c76ef5 WatchSource:0}: Error finding container 86a2bfeac2bbcb0dc1aaff4d63c3000ac9ad08f50d8fbe897075aac111c76ef5: Status 404 returned error can't find the container with id 86a2bfeac2bbcb0dc1aaff4d63c3000ac9ad08f50d8fbe897075aac111c76ef5 Jul 08 11:22:53.557063 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:53.557023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" event={"ID":"40366692-b290-466d-8cd3-51dbb425418f","Type":"ContainerStarted","Data":"86a2bfeac2bbcb0dc1aaff4d63c3000ac9ad08f50d8fbe897075aac111c76ef5"} Jul 08 11:22:56.570674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:56.570594 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" event={"ID":"40366692-b290-466d-8cd3-51dbb425418f","Type":"ContainerStarted","Data":"ae9bb3d72ac90b929da727f85c86d2537686723912a5a2a9d3b27da48f72b706"} Jul 08 11:22:57.575608 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:57.575569 2563 generic.go:356] "Generic (PLEG): container finished" podID="40366692-b290-466d-8cd3-51dbb425418f" containerID="ae9bb3d72ac90b929da727f85c86d2537686723912a5a2a9d3b27da48f72b706" exitCode=0 Jul 08 11:22:57.575984 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:57.575649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" event={"ID":"40366692-b290-466d-8cd3-51dbb425418f","Type":"ContainerDied","Data":"ae9bb3d72ac90b929da727f85c86d2537686723912a5a2a9d3b27da48f72b706"} Jul 08 11:22:58.582324 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:58.582288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" event={"ID":"40366692-b290-466d-8cd3-51dbb425418f","Type":"ContainerStarted","Data":"2106be0e737392966dff966aca445d91ae4bcbf5f1b8a8adcfcfb0483c5e7e76"} Jul 08 11:22:58.582832 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:58.582361 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:22:58.604436 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:22:58.604392 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" podStartSLOduration=2.131963011 podStartE2EDuration="6.60437668s" totalImagesPullingTime="3.469913714s" totalInitContainerRuntime="1.002499955s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:22:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:22:58.602944645 +0000 UTC m=+579.539617235" watchObservedRunningTime="2026-07-08 11:22:58.60437668 +0000 UTC m=+579.541049250" Jul 08 11:23:09.588130 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:09.588099 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9b86684-27stt" Jul 08 11:23:13.220630 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.220586 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx"] Jul 08 11:23:13.224384 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.224361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.229609 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.229578 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 11:23:13.229723 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.229630 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 11:23:13.231219 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.231194 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 11:23:13.231784 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.231286 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 11:23:13.231784 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.231351 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4d6q4\"" Jul 08 11:23:13.245149 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.245125 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx"] Jul 08 11:23:13.256994 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.256970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d684ebd-7a90-4b65-950a-41d1fde26d6c-tls-certs\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.257087 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.257015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d684ebd-7a90-4b65-950a-41d1fde26d6c-tmp\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.257087 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.257032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbswx\" (UniqueName: \"kubernetes.io/projected/2d684ebd-7a90-4b65-950a-41d1fde26d6c-kube-api-access-nbswx\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.275338 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.275309 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sr26c"] Jul 08 11:23:13.278794 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.278777 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.281722 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.281703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-867mb\"" Jul 08 11:23:13.281819 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.281731 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 11:23:13.292364 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.292339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sr26c"] Jul 08 11:23:13.358199 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.358156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b578\" (UniqueName: \"kubernetes.io/projected/371772f4-5ece-4d6d-8b4d-30b713f0828a-kube-api-access-5b578\") pod \"odh-model-controller-7998c67dc4-sr26c\" (UID: \"371772f4-5ece-4d6d-8b4d-30b713f0828a\") " pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.358371 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.358243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d684ebd-7a90-4b65-950a-41d1fde26d6c-tls-certs\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.358371 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.358282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d684ebd-7a90-4b65-950a-41d1fde26d6c-tmp\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.358371 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.358301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbswx\" (UniqueName: \"kubernetes.io/projected/2d684ebd-7a90-4b65-950a-41d1fde26d6c-kube-api-access-nbswx\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.358556 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.358418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/371772f4-5ece-4d6d-8b4d-30b713f0828a-cert\") pod \"odh-model-controller-7998c67dc4-sr26c\" (UID: \"371772f4-5ece-4d6d-8b4d-30b713f0828a\") " pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.360735 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.360706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d684ebd-7a90-4b65-950a-41d1fde26d6c-tmp\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.360883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.360867 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d684ebd-7a90-4b65-950a-41d1fde26d6c-tls-certs\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.372979 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.372951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbswx\" (UniqueName: \"kubernetes.io/projected/2d684ebd-7a90-4b65-950a-41d1fde26d6c-kube-api-access-nbswx\") pod \"kube-auth-proxy-9cf876f85-f6pkx\" (UID: \"2d684ebd-7a90-4b65-950a-41d1fde26d6c\") " pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.459322 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.459293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b578\" (UniqueName: \"kubernetes.io/projected/371772f4-5ece-4d6d-8b4d-30b713f0828a-kube-api-access-5b578\") pod \"odh-model-controller-7998c67dc4-sr26c\" (UID: \"371772f4-5ece-4d6d-8b4d-30b713f0828a\") " pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.459493 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.459349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/371772f4-5ece-4d6d-8b4d-30b713f0828a-cert\") pod \"odh-model-controller-7998c67dc4-sr26c\" (UID: \"371772f4-5ece-4d6d-8b4d-30b713f0828a\") " pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.461807 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.461786 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/371772f4-5ece-4d6d-8b4d-30b713f0828a-cert\") pod \"odh-model-controller-7998c67dc4-sr26c\" (UID: \"371772f4-5ece-4d6d-8b4d-30b713f0828a\") " pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.468139 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.468108 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b578\" (UniqueName: \"kubernetes.io/projected/371772f4-5ece-4d6d-8b4d-30b713f0828a-kube-api-access-5b578\") pod \"odh-model-controller-7998c67dc4-sr26c\" (UID: \"371772f4-5ece-4d6d-8b4d-30b713f0828a\") " pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.534057 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.533975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" Jul 08 11:23:13.588675 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.588642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:13.680368 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.680342 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx"] Jul 08 11:23:13.682409 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:23:13.682378 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d684ebd_7a90_4b65_950a_41d1fde26d6c.slice/crio-2a3fcbc0ca92d02d800301f8b082bd69bd29e438f89128684d322fc7c3da4c14 WatchSource:0}: Error finding container 2a3fcbc0ca92d02d800301f8b082bd69bd29e438f89128684d322fc7c3da4c14: Status 404 returned error can't find the container with id 2a3fcbc0ca92d02d800301f8b082bd69bd29e438f89128684d322fc7c3da4c14 Jul 08 11:23:13.741500 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:13.741474 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sr26c"] Jul 08 11:23:13.743599 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:23:13.743572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371772f4_5ece_4d6d_8b4d_30b713f0828a.slice/crio-79335ee0c359bed0b15acc75861a1275d23f5eff09158d9b8eac7cc1c075b4fe WatchSource:0}: Error finding container 79335ee0c359bed0b15acc75861a1275d23f5eff09158d9b8eac7cc1c075b4fe: Status 404 returned error can't find the container with id 79335ee0c359bed0b15acc75861a1275d23f5eff09158d9b8eac7cc1c075b4fe Jul 08 11:23:14.224407 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.224370 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z8nvl"] Jul 08 11:23:14.228889 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.228871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.232750 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.232734 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kskr4\"" Jul 08 11:23:14.232846 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.232734 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 11:23:14.236748 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.236727 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z8nvl"] Jul 08 11:23:14.264891 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.264861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjhz\" (UniqueName: \"kubernetes.io/projected/5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd-kube-api-access-rkjhz\") pod \"model-serving-api-54d89bd5fc-z8nvl\" (UID: \"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.265020 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.264898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd-tls-certs\") pod \"model-serving-api-54d89bd5fc-z8nvl\" (UID: \"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.366158 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.366123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjhz\" (UniqueName: \"kubernetes.io/projected/5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd-kube-api-access-rkjhz\") pod \"model-serving-api-54d89bd5fc-z8nvl\" (UID: \"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.366329 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.366188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd-tls-certs\") pod \"model-serving-api-54d89bd5fc-z8nvl\" (UID: \"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.369754 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.369708 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd-tls-certs\") pod \"model-serving-api-54d89bd5fc-z8nvl\" (UID: \"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.379996 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.379969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjhz\" (UniqueName: \"kubernetes.io/projected/5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd-kube-api-access-rkjhz\") pod \"model-serving-api-54d89bd5fc-z8nvl\" (UID: \"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd\") " pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.463502 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.463467 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc"] Jul 08 11:23:14.467295 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.467262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468204 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcb4b\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-kube-api-access-pcb4b\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468297 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468297 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468297 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468460 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468460 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.468460 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.468391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08cee744-7992-41cf-b666-ededff0e4b75-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.481404 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.481307 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc"] Jul 08 11:23:14.482883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.482285 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 11:23:14.482883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.482548 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 11:23:14.482883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.482555 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 11:23:14.482883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.482732 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 11:23:14.482883 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.482789 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rvwvd\"" Jul 08 11:23:14.539715 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.539682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:14.569576 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08cee744-7992-41cf-b666-ededff0e4b75-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.569732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcb4b\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-kube-api-access-pcb4b\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.569732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.569732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.569732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.569918 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.569918 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.569790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.572102 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.571565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.576186 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.573704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.576186 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.576060 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08cee744-7992-41cf-b666-ededff0e4b75-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.576369 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.576352 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.578249 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.577201 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.580498 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.580442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.581353 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.581313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcb4b\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-kube-api-access-pcb4b\") pod \"istiod-openshift-gateway-7574459656-7kgpc\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.653340 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.653303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" event={"ID":"371772f4-5ece-4d6d-8b4d-30b713f0828a","Type":"ContainerStarted","Data":"79335ee0c359bed0b15acc75861a1275d23f5eff09158d9b8eac7cc1c075b4fe"} Jul 08 11:23:14.655252 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.655218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" event={"ID":"2d684ebd-7a90-4b65-950a-41d1fde26d6c","Type":"ContainerStarted","Data":"2a3fcbc0ca92d02d800301f8b082bd69bd29e438f89128684d322fc7c3da4c14"} Jul 08 11:23:14.728066 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.727948 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z8nvl"] Jul 08 11:23:14.729679 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:23:14.729646 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a85ea5b_2e55_41ac_95c0_22cc8be8a0bd.slice/crio-9a34466228fff1b11ca8911fd6c0676292952f6e9033cab9e584dbe5c0f5019f WatchSource:0}: Error finding container 9a34466228fff1b11ca8911fd6c0676292952f6e9033cab9e584dbe5c0f5019f: Status 404 returned error can't find the container with id 9a34466228fff1b11ca8911fd6c0676292952f6e9033cab9e584dbe5c0f5019f Jul 08 11:23:14.783442 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.783153 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:14.978991 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:14.978874 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc"] Jul 08 11:23:14.983710 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:23:14.983678 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cee744_7992_41cf_b666_ededff0e4b75.slice/crio-29e48fb2b34b81a57c49641ed43d43cd363c6c90d168c5a96dc8916d79ff2723 WatchSource:0}: Error finding container 29e48fb2b34b81a57c49641ed43d43cd363c6c90d168c5a96dc8916d79ff2723: Status 404 returned error can't find the container with id 29e48fb2b34b81a57c49641ed43d43cd363c6c90d168c5a96dc8916d79ff2723 Jul 08 11:23:15.664860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:15.664778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" event={"ID":"08cee744-7992-41cf-b666-ededff0e4b75","Type":"ContainerStarted","Data":"29e48fb2b34b81a57c49641ed43d43cd363c6c90d168c5a96dc8916d79ff2723"} Jul 08 11:23:15.667494 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:15.667419 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" event={"ID":"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd","Type":"ContainerStarted","Data":"9a34466228fff1b11ca8911fd6c0676292952f6e9033cab9e584dbe5c0f5019f"} Jul 08 11:23:19.236473 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.236432 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 11:23:19.236754 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.236534 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 11:23:19.688780 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.688745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" event={"ID":"2d684ebd-7a90-4b65-950a-41d1fde26d6c","Type":"ContainerStarted","Data":"3dbfe67445769c80dca29170cd68f98dc82a9e7ccb31c46fe8e00a15823840aa"} Jul 08 11:23:19.691308 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.691275 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" event={"ID":"371772f4-5ece-4d6d-8b4d-30b713f0828a","Type":"ContainerStarted","Data":"3b7bc89b94f68e1aa9368d5938fa3f084f599567358bab113cc40b6d74046e24"} Jul 08 11:23:19.691467 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.691390 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:19.693277 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.693253 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" event={"ID":"08cee744-7992-41cf-b666-ededff0e4b75","Type":"ContainerStarted","Data":"97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d"} Jul 08 11:23:19.693423 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.693389 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:19.694971 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.694950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" event={"ID":"5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd","Type":"ContainerStarted","Data":"d9bdc1564bcc151db028c8a98205e3fcd2f9d67af6354862d2c4eba39fd1109c"} Jul 08 11:23:19.695077 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.694995 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:23:19.706798 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.706064 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9cf876f85-f6pkx" podStartSLOduration=1.2238182260000001 podStartE2EDuration="6.706048691s" totalImagesPullingTime="5.482230465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:19.705846516 +0000 UTC m=+600.642519086" watchObservedRunningTime="2026-07-08 11:23:19.706048691 +0000 UTC m=+600.642721264" Jul 08 11:23:19.725437 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.724384 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" podStartSLOduration=1.474468129 podStartE2EDuration="5.724365195s" totalImagesPullingTime="4.249897066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:19.723371159 +0000 UTC m=+600.660043730" watchObservedRunningTime="2026-07-08 11:23:19.724365195 +0000 UTC m=+600.661037765" Jul 08 11:23:19.740787 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.740730 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" podStartSLOduration=1.318589821 podStartE2EDuration="6.740709518s" totalImagesPullingTime="5.422119697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:19.739290864 +0000 UTC m=+600.675963433" watchObservedRunningTime="2026-07-08 11:23:19.740709518 +0000 UTC m=+600.677382091" Jul 08 11:23:19.755257 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:19.755215 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" podStartSLOduration=1.321870552 podStartE2EDuration="5.75520027s" totalImagesPullingTime="4.433329718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:19.754193517 +0000 UTC m=+600.690866113" watchObservedRunningTime="2026-07-08 11:23:19.75520027 +0000 UTC m=+600.691872839" Jul 08 11:23:20.700774 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:20.700742 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7kgpc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 11:23:20.701114 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:20.700805 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" podUID="08cee744-7992-41cf-b666-ededff0e4b75" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 11:23:23.532876 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.532824 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg"] Jul 08 11:23:23.537580 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.537552 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.550695 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.550662 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg"] Jul 08 11:23:23.649164 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.649322 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.649322 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.649322 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.649322 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kx6\" (UniqueName: \"kubernetes.io/projected/4f3e8029-e0af-43b2-a446-55ce2a47996f-kube-api-access-w6kx6\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.649452 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f3e8029-e0af-43b2-a446-55ce2a47996f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.649452 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.649355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.700770 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.700737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:23.750655 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.750617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.750843 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.750698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.750843 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.750734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.750843 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.750771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.750843 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.750789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kx6\" (UniqueName: \"kubernetes.io/projected/4f3e8029-e0af-43b2-a446-55ce2a47996f-kube-api-access-w6kx6\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.751059 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.751014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f3e8029-e0af-43b2-a446-55ce2a47996f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.751115 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.751075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.752075 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.752042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.753300 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.753279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f3e8029-e0af-43b2-a446-55ce2a47996f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.753391 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.753281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.753391 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.753324 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.753391 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.753340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.767395 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.767374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f3e8029-e0af-43b2-a446-55ce2a47996f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.769951 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.769931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kx6\" (UniqueName: \"kubernetes.io/projected/4f3e8029-e0af-43b2-a446-55ce2a47996f-kube-api-access-w6kx6\") pod \"istiod-openshift-gateway-94bb8fbfd-7m2gg\" (UID: \"4f3e8029-e0af-43b2-a446-55ce2a47996f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.846230 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.846193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:23.983920 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.983888 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg"] Jul 08 11:23:23.985842 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:23:23.985810 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3e8029_e0af_43b2_a446_55ce2a47996f.slice/crio-0ae25b75ba2c7522a0ef671a5361548ecca2f8337ee8f484d84d3806cb29ec34 WatchSource:0}: Error finding container 0ae25b75ba2c7522a0ef671a5361548ecca2f8337ee8f484d84d3806cb29ec34: Status 404 returned error can't find the container with id 0ae25b75ba2c7522a0ef671a5361548ecca2f8337ee8f484d84d3806cb29ec34 Jul 08 11:23:23.987804 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.987773 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 11:23:23.987876 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:23.987831 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 11:23:24.718001 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:24.717965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" event={"ID":"4f3e8029-e0af-43b2-a446-55ce2a47996f","Type":"ContainerStarted","Data":"656fc0997c6e58c340847eada023234b3959b4024480cd43238657d35d79ea6f"} Jul 08 11:23:24.718440 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:24.718021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" event={"ID":"4f3e8029-e0af-43b2-a446-55ce2a47996f","Type":"ContainerStarted","Data":"0ae25b75ba2c7522a0ef671a5361548ecca2f8337ee8f484d84d3806cb29ec34"} Jul 08 11:23:24.718440 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:24.718095 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:25.724017 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:25.723988 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" Jul 08 11:23:25.757470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:25.757417 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7m2gg" podStartSLOduration=2.757402207 podStartE2EDuration="2.757402207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:23:24.7557077 +0000 UTC m=+605.692380271" watchObservedRunningTime="2026-07-08 11:23:25.757402207 +0000 UTC m=+606.694074777" Jul 08 11:23:25.823290 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:25.823260 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc"] Jul 08 11:23:25.823523 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:25.823483 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" podUID="08cee744-7992-41cf-b666-ededff0e4b75" containerName="discovery" containerID="cri-o://97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d" gracePeriod=30 Jul 08 11:23:26.062869 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.062842 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:26.170417 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170388 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-cacerts\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170428 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-dns-cert\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170453 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-kubeconfig\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170489 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-ca-configmap\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170529 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-istio-token\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170556 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08cee744-7992-41cf-b666-ededff0e4b75-local-certs\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170596 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170580 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcb4b\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-kube-api-access-pcb4b\") pod \"08cee744-7992-41cf-b666-ededff0e4b75\" (UID: \"08cee744-7992-41cf-b666-ededff0e4b75\") " Jul 08 11:23:26.170981 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.170952 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 11:23:26.173068 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.173041 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-cacerts" (OuterVolumeSpecName: "cacerts") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 11:23:26.173410 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.173381 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-istio-token" (OuterVolumeSpecName: "istio-token") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:23:26.173499 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.173468 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 11:23:26.173499 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.173478 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08cee744-7992-41cf-b666-ededff0e4b75-local-certs" (OuterVolumeSpecName: "local-certs") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:23:26.173641 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.173496 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-kube-api-access-pcb4b" (OuterVolumeSpecName: "kube-api-access-pcb4b") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "kube-api-access-pcb4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:23:26.173641 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.173602 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "08cee744-7992-41cf-b666-ededff0e4b75" (UID: "08cee744-7992-41cf-b666-ededff0e4b75"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 11:23:26.272143 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272062 2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-ca-configmap\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.272143 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272094 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-istio-token\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.272143 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272103 2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/08cee744-7992-41cf-b666-ededff0e4b75-local-certs\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.272143 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272112 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcb4b\" (UniqueName: \"kubernetes.io/projected/08cee744-7992-41cf-b666-ededff0e4b75-kube-api-access-pcb4b\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.272143 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272120 2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-cacerts\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.272143 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272129 2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-csr-dns-cert\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.272437 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.272151 2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08cee744-7992-41cf-b666-ededff0e4b75-istio-kubeconfig\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:23:26.727726 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.727696 2563 generic.go:356] "Generic (PLEG): container finished" podID="08cee744-7992-41cf-b666-ededff0e4b75" containerID="97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d" exitCode=0 Jul 08 11:23:26.728147 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.727739 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" Jul 08 11:23:26.728147 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.727784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" event={"ID":"08cee744-7992-41cf-b666-ededff0e4b75","Type":"ContainerDied","Data":"97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d"} Jul 08 11:23:26.728147 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.727832 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc" event={"ID":"08cee744-7992-41cf-b666-ededff0e4b75","Type":"ContainerDied","Data":"29e48fb2b34b81a57c49641ed43d43cd363c6c90d168c5a96dc8916d79ff2723"} Jul 08 11:23:26.728147 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.727856 2563 scope.go:117] "RemoveContainer" containerID="97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d" Jul 08 11:23:26.736335 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.736320 2563 scope.go:117] "RemoveContainer" containerID="97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d" Jul 08 11:23:26.736604 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:23:26.736586 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d\": container with ID starting with 97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d not found: ID does not exist" containerID="97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d" Jul 08 11:23:26.736650 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.736612 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d"} err="failed to get container status \"97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d\": rpc error: code = NotFound desc = could not find container \"97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d\": container with ID starting with 97477f569c568a97fe264142f8cddfc3f6ec9578f0a91bbba0848e0074a4415d not found: ID does not exist" Jul 08 11:23:26.750430 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.750407 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc"] Jul 08 11:23:26.755534 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:26.755497 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kgpc"] Jul 08 11:23:27.574378 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:27.574345 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08cee744-7992-41cf-b666-ededff0e4b75" path="/var/lib/kubelet/pods/08cee744-7992-41cf-b666-ededff0e4b75/volumes" Jul 08 11:23:30.701642 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:30.701605 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sr26c" Jul 08 11:23:30.703757 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:23:30.703737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-z8nvl" Jul 08 11:24:14.033359 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.033326 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrvx8"] Jul 08 11:24:14.033784 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.033639 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08cee744-7992-41cf-b666-ededff0e4b75" containerName="discovery" Jul 08 11:24:14.033784 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.033650 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="08cee744-7992-41cf-b666-ededff0e4b75" containerName="discovery" Jul 08 11:24:14.033784 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.033716 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="08cee744-7992-41cf-b666-ededff0e4b75" containerName="discovery" Jul 08 11:24:14.035518 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.035479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:14.039253 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.039231 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rnscj\"" Jul 08 11:24:14.039386 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.039366 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 11:24:14.039457 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.039430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 11:24:14.047470 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.047445 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrvx8"] Jul 08 11:24:14.065294 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.065268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ztmq\" (UniqueName: \"kubernetes.io/projected/c3d22842-a9c4-4654-b2c3-8f779b2c8c20-kube-api-access-6ztmq\") pod \"kuadrant-operator-catalog-zrvx8\" (UID: \"c3d22842-a9c4-4654-b2c3-8f779b2c8c20\") " pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:14.165856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.165820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ztmq\" (UniqueName: \"kubernetes.io/projected/c3d22842-a9c4-4654-b2c3-8f779b2c8c20-kube-api-access-6ztmq\") pod \"kuadrant-operator-catalog-zrvx8\" (UID: \"c3d22842-a9c4-4654-b2c3-8f779b2c8c20\") " pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:14.175410 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.175392 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ztmq\" (UniqueName: \"kubernetes.io/projected/c3d22842-a9c4-4654-b2c3-8f779b2c8c20-kube-api-access-6ztmq\") pod \"kuadrant-operator-catalog-zrvx8\" (UID: \"c3d22842-a9c4-4654-b2c3-8f779b2c8c20\") " pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:14.345442 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.345407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:14.390480 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.390449 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrvx8"] Jul 08 11:24:14.473271 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.473248 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrvx8"] Jul 08 11:24:14.475438 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:24:14.475412 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d22842_a9c4_4654_b2c3_8f779b2c8c20.slice/crio-c792aa8354efa6fc48276ed59fdabf7572c4ecb776995f5c9d52e99894a677fd WatchSource:0}: Error finding container c792aa8354efa6fc48276ed59fdabf7572c4ecb776995f5c9d52e99894a677fd: Status 404 returned error can't find the container with id c792aa8354efa6fc48276ed59fdabf7572c4ecb776995f5c9d52e99894a677fd Jul 08 11:24:14.601955 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.601877 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhh2t"] Jul 08 11:24:14.604676 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.604660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:14.612112 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.612075 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhh2t"] Jul 08 11:24:14.670061 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.670030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lgqd\" (UniqueName: \"kubernetes.io/projected/2f2acd20-763f-4fd5-b95a-e3fffb2211d4-kube-api-access-8lgqd\") pod \"kuadrant-operator-catalog-xhh2t\" (UID: \"2f2acd20-763f-4fd5-b95a-e3fffb2211d4\") " pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:14.770717 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.770685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgqd\" (UniqueName: \"kubernetes.io/projected/2f2acd20-763f-4fd5-b95a-e3fffb2211d4-kube-api-access-8lgqd\") pod \"kuadrant-operator-catalog-xhh2t\" (UID: \"2f2acd20-763f-4fd5-b95a-e3fffb2211d4\") " pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:14.780706 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.780676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lgqd\" (UniqueName: \"kubernetes.io/projected/2f2acd20-763f-4fd5-b95a-e3fffb2211d4-kube-api-access-8lgqd\") pod \"kuadrant-operator-catalog-xhh2t\" (UID: \"2f2acd20-763f-4fd5-b95a-e3fffb2211d4\") " pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:14.914020 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.913951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:14.917485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:14.917462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" event={"ID":"c3d22842-a9c4-4654-b2c3-8f779b2c8c20","Type":"ContainerStarted","Data":"c792aa8354efa6fc48276ed59fdabf7572c4ecb776995f5c9d52e99894a677fd"} Jul 08 11:24:15.049368 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:15.049322 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xhh2t"] Jul 08 11:24:15.066530 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:24:15.066489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2acd20_763f_4fd5_b95a_e3fffb2211d4.slice/crio-a0d6da5e0c5935db0c367e9c6987e25da3a553116fbd1bbc09e5f582bf0c1e34 WatchSource:0}: Error finding container a0d6da5e0c5935db0c367e9c6987e25da3a553116fbd1bbc09e5f582bf0c1e34: Status 404 returned error can't find the container with id a0d6da5e0c5935db0c367e9c6987e25da3a553116fbd1bbc09e5f582bf0c1e34 Jul 08 11:24:15.922708 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:15.922674 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" event={"ID":"2f2acd20-763f-4fd5-b95a-e3fffb2211d4","Type":"ContainerStarted","Data":"a0d6da5e0c5935db0c367e9c6987e25da3a553116fbd1bbc09e5f582bf0c1e34"} Jul 08 11:24:16.928458 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:16.928366 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" event={"ID":"c3d22842-a9c4-4654-b2c3-8f779b2c8c20","Type":"ContainerStarted","Data":"c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5"} Jul 08 11:24:16.928458 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:16.928411 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" podUID="c3d22842-a9c4-4654-b2c3-8f779b2c8c20" containerName="registry-server" containerID="cri-o://c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5" gracePeriod=2 Jul 08 11:24:16.929847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:16.929821 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" event={"ID":"2f2acd20-763f-4fd5-b95a-e3fffb2211d4","Type":"ContainerStarted","Data":"b43a013807d634c17eb276e96235873d97096e136a95d575c419877c61b5b0e4"} Jul 08 11:24:16.946337 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:16.946295 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" podStartSLOduration=0.853505765 podStartE2EDuration="2.946282833s" totalImagesPullingTime="2.092777068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:24:16.945256482 +0000 UTC m=+657.881929079" watchObservedRunningTime="2026-07-08 11:24:16.946282833 +0000 UTC m=+657.882955403" Jul 08 11:24:16.962049 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:16.962006 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" podStartSLOduration=1.457099702 podStartE2EDuration="2.961994958s" totalImagesPullingTime="1.504895256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:24:16.960980553 +0000 UTC m=+657.897653150" watchObservedRunningTime="2026-07-08 11:24:16.961994958 +0000 UTC m=+657.898667528" Jul 08 11:24:17.163156 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.163132 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:17.189712 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.189642 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ztmq\" (UniqueName: \"kubernetes.io/projected/c3d22842-a9c4-4654-b2c3-8f779b2c8c20-kube-api-access-6ztmq\") pod \"c3d22842-a9c4-4654-b2c3-8f779b2c8c20\" (UID: \"c3d22842-a9c4-4654-b2c3-8f779b2c8c20\") " Jul 08 11:24:17.192058 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.192027 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d22842-a9c4-4654-b2c3-8f779b2c8c20-kube-api-access-6ztmq" (OuterVolumeSpecName: "kube-api-access-6ztmq") pod "c3d22842-a9c4-4654-b2c3-8f779b2c8c20" (UID: "c3d22842-a9c4-4654-b2c3-8f779b2c8c20"). InnerVolumeSpecName "kube-api-access-6ztmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:24:17.290905 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.290871 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ztmq\" (UniqueName: \"kubernetes.io/projected/c3d22842-a9c4-4654-b2c3-8f779b2c8c20-kube-api-access-6ztmq\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:24:17.935008 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.934920 2563 generic.go:356] "Generic (PLEG): container finished" podID="c3d22842-a9c4-4654-b2c3-8f779b2c8c20" containerID="c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5" exitCode=0 Jul 08 11:24:17.935008 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.934967 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" Jul 08 11:24:17.935008 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.934997 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" event={"ID":"c3d22842-a9c4-4654-b2c3-8f779b2c8c20","Type":"ContainerDied","Data":"c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5"} Jul 08 11:24:17.935505 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.935042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zrvx8" event={"ID":"c3d22842-a9c4-4654-b2c3-8f779b2c8c20","Type":"ContainerDied","Data":"c792aa8354efa6fc48276ed59fdabf7572c4ecb776995f5c9d52e99894a677fd"} Jul 08 11:24:17.935505 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.935062 2563 scope.go:117] "RemoveContainer" containerID="c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5" Jul 08 11:24:17.943575 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.943559 2563 scope.go:117] "RemoveContainer" containerID="c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5" Jul 08 11:24:17.943857 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:24:17.943840 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5\": container with ID starting with c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5 not found: ID does not exist" containerID="c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5" Jul 08 11:24:17.943934 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.943874 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5"} err="failed to get container status \"c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5\": rpc error: code = NotFound desc = could not find container \"c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5\": container with ID starting with c9de38942886e368d00a8fd434ea4e9c5b3fc13b61e43588b854cd480f7960c5 not found: ID does not exist" Jul 08 11:24:17.951440 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.951421 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrvx8"] Jul 08 11:24:17.954857 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:17.954838 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zrvx8"] Jul 08 11:24:19.574699 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:19.574666 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d22842-a9c4-4654-b2c3-8f779b2c8c20" path="/var/lib/kubelet/pods/c3d22842-a9c4-4654-b2c3-8f779b2c8c20/volumes" Jul 08 11:24:24.914769 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:24.914730 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:24.915169 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:24.914789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:24.937562 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:24.937536 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:24.985629 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:24.985602 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xhh2t" Jul 08 11:24:46.217975 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.217943 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d772s"] Jul 08 11:24:46.218457 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.218245 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d22842-a9c4-4654-b2c3-8f779b2c8c20" containerName="registry-server" Jul 08 11:24:46.218457 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.218255 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d22842-a9c4-4654-b2c3-8f779b2c8c20" containerName="registry-server" Jul 08 11:24:46.218457 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.218321 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d22842-a9c4-4654-b2c3-8f779b2c8c20" containerName="registry-server" Jul 08 11:24:46.224277 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.224261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:24:46.226936 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.226918 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cpjdr\"" Jul 08 11:24:46.229983 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.229924 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d772s"] Jul 08 11:24:46.306625 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.306583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8b8\" (UniqueName: \"kubernetes.io/projected/73f2a599-c44b-4b52-8add-d6c9990359d2-kube-api-access-rl8b8\") pod \"authorino-operator-75cc8d5cb7-d772s\" (UID: \"73f2a599-c44b-4b52-8add-d6c9990359d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:24:46.407137 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.407104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8b8\" (UniqueName: \"kubernetes.io/projected/73f2a599-c44b-4b52-8add-d6c9990359d2-kube-api-access-rl8b8\") pod \"authorino-operator-75cc8d5cb7-d772s\" (UID: \"73f2a599-c44b-4b52-8add-d6c9990359d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:24:46.426354 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.426318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8b8\" (UniqueName: \"kubernetes.io/projected/73f2a599-c44b-4b52-8add-d6c9990359d2-kube-api-access-rl8b8\") pod \"authorino-operator-75cc8d5cb7-d772s\" (UID: \"73f2a599-c44b-4b52-8add-d6c9990359d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:24:46.535493 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.535417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:24:46.664732 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:46.664712 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d772s"] Jul 08 11:24:46.667308 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:24:46.667276 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f2a599_c44b_4b52_8add_d6c9990359d2.slice/crio-cf21bf3d2219bc87c969c33c4d48f8effd1ff848cc9d9f8e38e6b2ec82238338 WatchSource:0}: Error finding container cf21bf3d2219bc87c969c33c4d48f8effd1ff848cc9d9f8e38e6b2ec82238338: Status 404 returned error can't find the container with id cf21bf3d2219bc87c969c33c4d48f8effd1ff848cc9d9f8e38e6b2ec82238338 Jul 08 11:24:47.055048 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:47.055017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" event={"ID":"73f2a599-c44b-4b52-8add-d6c9990359d2","Type":"ContainerStarted","Data":"cf21bf3d2219bc87c969c33c4d48f8effd1ff848cc9d9f8e38e6b2ec82238338"} Jul 08 11:24:50.069684 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:50.069644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" event={"ID":"73f2a599-c44b-4b52-8add-d6c9990359d2","Type":"ContainerStarted","Data":"f6c9e82e76ddcd85fd0a14735733fd17862830a3679b7bde71e10ef7c20b8633"} Jul 08 11:24:50.070138 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:50.069781 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:24:50.088527 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:50.088447 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" podStartSLOduration=1.351779548 podStartE2EDuration="4.088429564s" totalImagesPullingTime="2.736650016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:24:50.087682707 +0000 UTC m=+691.024355294" watchObservedRunningTime="2026-07-08 11:24:50.088429564 +0000 UTC m=+691.025102187" Jul 08 11:24:51.341659 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.341624 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997"] Jul 08 11:24:51.347344 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.347325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.350047 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.350032 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-trpgp\"" Jul 08 11:24:51.358719 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.358694 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997"] Jul 08 11:24:51.452571 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.452536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b49aac5f-67af-46c3-b084-f63ef5600a02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.452571 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.452576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5h6\" (UniqueName: \"kubernetes.io/projected/b49aac5f-67af-46c3-b084-f63ef5600a02-kube-api-access-bf5h6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.553378 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.553336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b49aac5f-67af-46c3-b084-f63ef5600a02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.553378 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.553383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5h6\" (UniqueName: \"kubernetes.io/projected/b49aac5f-67af-46c3-b084-f63ef5600a02-kube-api-access-bf5h6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.553820 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.553798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b49aac5f-67af-46c3-b084-f63ef5600a02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.570844 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.570820 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5h6\" (UniqueName: \"kubernetes.io/projected/b49aac5f-67af-46c3-b084-f63ef5600a02-kube-api-access-bf5h6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.658420 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.658339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:51.803090 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:51.803065 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997"] Jul 08 11:24:51.806087 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:24:51.806052 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49aac5f_67af_46c3_b084_f63ef5600a02.slice/crio-80c4043815a437d391283623cec8162e7d59166b8ae3d4d4219c0766357313a0 WatchSource:0}: Error finding container 80c4043815a437d391283623cec8162e7d59166b8ae3d4d4219c0766357313a0: Status 404 returned error can't find the container with id 80c4043815a437d391283623cec8162e7d59166b8ae3d4d4219c0766357313a0 Jul 08 11:24:52.081288 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:52.081250 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" event={"ID":"b49aac5f-67af-46c3-b084-f63ef5600a02","Type":"ContainerStarted","Data":"80c4043815a437d391283623cec8162e7d59166b8ae3d4d4219c0766357313a0"} Jul 08 11:24:58.108723 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:58.108684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" event={"ID":"b49aac5f-67af-46c3-b084-f63ef5600a02","Type":"ContainerStarted","Data":"74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20"} Jul 08 11:24:58.109122 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:58.108794 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:24:58.136079 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:24:58.136025 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" podStartSLOduration=1.191180847 podStartE2EDuration="7.136009002s" totalImagesPullingTime="5.944828155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:24:58.135363856 +0000 UTC m=+699.072036442" watchObservedRunningTime="2026-07-08 11:24:58.136009002 +0000 UTC m=+699.072681571" Jul 08 11:25:01.075565 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:01.075535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d772s" Jul 08 11:25:09.115419 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:09.115388 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:25:11.285797 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.285710 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997"] Jul 08 11:25:11.286198 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.285934 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" containerName="manager" containerID="cri-o://74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20" gracePeriod=2 Jul 08 11:25:11.298860 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.298835 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997"] Jul 08 11:25:11.309732 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:25:11.309703 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b49aac5f-67af-46c3-b084-f63ef5600a02\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-kz997\": pods \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:25:11.338869 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.338845 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57"] Jul 08 11:25:11.339138 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.339122 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" containerName="manager" Jul 08 11:25:11.339138 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.339137 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" containerName="manager" Jul 08 11:25:11.339284 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.339211 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" containerName="manager" Jul 08 11:25:11.342119 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.342088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:11.346484 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.346461 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qkq4r\"" Jul 08 11:25:11.362175 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.362147 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57"] Jul 08 11:25:11.378877 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:25:11.378847 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" is forbidden: User \"system:node:ip-10-0-139-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-193.ec2.internal' and this object" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:25:11.429863 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.429826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8b67\" (UniqueName: \"kubernetes.io/projected/967d7105-8bf7-44a0-81c0-2711d7660d0d-kube-api-access-q8b67\") pod \"limitador-operator-controller-manager-859d7b78bd-wgv57\" (UID: \"967d7105-8bf7-44a0-81c0-2711d7660d0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:11.518611 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.518586 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:25:11.521333 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:25:11.521306 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kz997\" is forbidden: User \"system:node:ip-10-0-139-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-193.ec2.internal' and this object" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:25:11.530674 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.530651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8b67\" (UniqueName: \"kubernetes.io/projected/967d7105-8bf7-44a0-81c0-2711d7660d0d-kube-api-access-q8b67\") pod \"limitador-operator-controller-manager-859d7b78bd-wgv57\" (UID: \"967d7105-8bf7-44a0-81c0-2711d7660d0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:11.546242 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.546192 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8b67\" (UniqueName: \"kubernetes.io/projected/967d7105-8bf7-44a0-81c0-2711d7660d0d-kube-api-access-q8b67\") pod \"limitador-operator-controller-manager-859d7b78bd-wgv57\" (UID: \"967d7105-8bf7-44a0-81c0-2711d7660d0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:11.631114 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.631088 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf5h6\" (UniqueName: \"kubernetes.io/projected/b49aac5f-67af-46c3-b084-f63ef5600a02-kube-api-access-bf5h6\") pod \"b49aac5f-67af-46c3-b084-f63ef5600a02\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " Jul 08 11:25:11.631252 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.631153 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b49aac5f-67af-46c3-b084-f63ef5600a02-extensions-socket-volume\") pod \"b49aac5f-67af-46c3-b084-f63ef5600a02\" (UID: \"b49aac5f-67af-46c3-b084-f63ef5600a02\") " Jul 08 11:25:11.631598 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.631575 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49aac5f-67af-46c3-b084-f63ef5600a02-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b49aac5f-67af-46c3-b084-f63ef5600a02" (UID: "b49aac5f-67af-46c3-b084-f63ef5600a02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:25:11.633203 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.633177 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49aac5f-67af-46c3-b084-f63ef5600a02-kube-api-access-bf5h6" (OuterVolumeSpecName: "kube-api-access-bf5h6") pod "b49aac5f-67af-46c3-b084-f63ef5600a02" (UID: "b49aac5f-67af-46c3-b084-f63ef5600a02"). InnerVolumeSpecName "kube-api-access-bf5h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:25:11.678558 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.678500 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:11.731799 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.731765 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b49aac5f-67af-46c3-b084-f63ef5600a02-extensions-socket-volume\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:25:11.731940 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.731801 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf5h6\" (UniqueName: \"kubernetes.io/projected/b49aac5f-67af-46c3-b084-f63ef5600a02-kube-api-access-bf5h6\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:25:11.822851 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:11.822822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57"] Jul 08 11:25:11.825765 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:25:11.825736 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967d7105_8bf7_44a0_81c0_2711d7660d0d.slice/crio-afde607cf97d95aa68dee03925135164dcc0735f5cfb0261d77eb14f6e24d241 WatchSource:0}: Error finding container afde607cf97d95aa68dee03925135164dcc0735f5cfb0261d77eb14f6e24d241: Status 404 returned error can't find the container with id afde607cf97d95aa68dee03925135164dcc0735f5cfb0261d77eb14f6e24d241 Jul 08 11:25:12.166255 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:12.166182 2563 generic.go:356] "Generic (PLEG): container finished" podID="b49aac5f-67af-46c3-b084-f63ef5600a02" containerID="74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20" exitCode=0 Jul 08 11:25:12.166255 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:12.166225 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kz997" Jul 08 11:25:12.166459 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:12.166275 2563 scope.go:117] "RemoveContainer" containerID="74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20" Jul 08 11:25:12.167552 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:12.167502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" event={"ID":"967d7105-8bf7-44a0-81c0-2711d7660d0d","Type":"ContainerStarted","Data":"afde607cf97d95aa68dee03925135164dcc0735f5cfb0261d77eb14f6e24d241"} Jul 08 11:25:12.215761 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:12.215737 2563 scope.go:117] "RemoveContainer" containerID="74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20" Jul 08 11:25:12.216132 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:25:12.216108 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20\": container with ID starting with 74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20 not found: ID does not exist" containerID="74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20" Jul 08 11:25:12.216213 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:12.216143 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20"} err="failed to get container status \"74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20\": rpc error: code = NotFound desc = could not find container \"74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20\": container with ID starting with 74472c9b4cd1d69c924ffb066ef268f94be759172d05c89fbedf9bad74295e20 not found: ID does not exist" Jul 08 11:25:13.574623 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:13.574590 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49aac5f-67af-46c3-b084-f63ef5600a02" path="/var/lib/kubelet/pods/b49aac5f-67af-46c3-b084-f63ef5600a02/volumes" Jul 08 11:25:14.178750 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:14.178717 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" event={"ID":"967d7105-8bf7-44a0-81c0-2711d7660d0d","Type":"ContainerStarted","Data":"bcd70dfa4e29a28a3d07fb614346c86f5e98cfb37ba8d8bdafebbaa7e26d2189"} Jul 08 11:25:14.178904 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:14.178789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:14.198093 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:14.198048 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" podStartSLOduration=1.905150745 podStartE2EDuration="3.198031399s" totalImagesPullingTime="1.292880654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:25:14.196404211 +0000 UTC m=+715.133076781" watchObservedRunningTime="2026-07-08 11:25:14.198031399 +0000 UTC m=+715.134703968" Jul 08 11:25:25.186335 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:25.186304 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgv57" Jul 08 11:25:46.836875 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.836839 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:25:46.841354 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.841339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:46.844200 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.844170 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 11:25:46.844325 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.844288 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qq5gw\"" Jul 08 11:25:46.849647 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.849623 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:25:46.880808 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.880775 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:25:46.904589 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.904560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5126d82-f2f2-401c-b493-916e8004f877-config-file\") pod \"limitador-limitador-54d6d988d5-jsj5c\" (UID: \"c5126d82-f2f2-401c-b493-916e8004f877\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:46.904708 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:46.904609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dh95\" (UniqueName: \"kubernetes.io/projected/c5126d82-f2f2-401c-b493-916e8004f877-kube-api-access-4dh95\") pod \"limitador-limitador-54d6d988d5-jsj5c\" (UID: \"c5126d82-f2f2-401c-b493-916e8004f877\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:47.005879 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.005844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dh95\" (UniqueName: \"kubernetes.io/projected/c5126d82-f2f2-401c-b493-916e8004f877-kube-api-access-4dh95\") pod \"limitador-limitador-54d6d988d5-jsj5c\" (UID: \"c5126d82-f2f2-401c-b493-916e8004f877\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:47.006029 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.005910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5126d82-f2f2-401c-b493-916e8004f877-config-file\") pod \"limitador-limitador-54d6d988d5-jsj5c\" (UID: \"c5126d82-f2f2-401c-b493-916e8004f877\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:47.006458 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.006442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5126d82-f2f2-401c-b493-916e8004f877-config-file\") pod \"limitador-limitador-54d6d988d5-jsj5c\" (UID: \"c5126d82-f2f2-401c-b493-916e8004f877\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:47.014176 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.014156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dh95\" (UniqueName: \"kubernetes.io/projected/c5126d82-f2f2-401c-b493-916e8004f877-kube-api-access-4dh95\") pod \"limitador-limitador-54d6d988d5-jsj5c\" (UID: \"c5126d82-f2f2-401c-b493-916e8004f877\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:47.152229 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.152147 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:47.291664 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.291640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:25:47.294159 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:25:47.294128 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5126d82_f2f2_401c_b493_916e8004f877.slice/crio-f64217a7ef19c218ff7dcdba5f534fd943bc1b42e3cf546d0169abab1a84511f WatchSource:0}: Error finding container f64217a7ef19c218ff7dcdba5f534fd943bc1b42e3cf546d0169abab1a84511f: Status 404 returned error can't find the container with id f64217a7ef19c218ff7dcdba5f534fd943bc1b42e3cf546d0169abab1a84511f Jul 08 11:25:47.317019 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:47.316991 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" event={"ID":"c5126d82-f2f2-401c-b493-916e8004f877","Type":"ContainerStarted","Data":"f64217a7ef19c218ff7dcdba5f534fd943bc1b42e3cf546d0169abab1a84511f"} Jul 08 11:25:50.331761 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:50.331728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" event={"ID":"c5126d82-f2f2-401c-b493-916e8004f877","Type":"ContainerStarted","Data":"8dbc3c5cdb64dfd9cd4d859f8c699a39f1ba08e51522af9770121e954ba54f9f"} Jul 08 11:25:50.332127 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:50.331798 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:25:50.351073 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:25:50.351022 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" podStartSLOduration=1.737198454 podStartE2EDuration="4.351007238s" totalImagesPullingTime="2.613808784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:25:50.349017322 +0000 UTC m=+751.285689894" watchObservedRunningTime="2026-07-08 11:25:50.351007238 +0000 UTC m=+751.287679809" Jul 08 11:26:01.336959 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:26:01.336927 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jsj5c" Jul 08 11:26:57.702587 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:26:57.702552 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:27:13.126425 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:13.126386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:27:27.788789 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:27.788751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:27:41.291937 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:41.291893 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:27:44.793165 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.793128 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq"] Jul 08 11:27:44.796548 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.796502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.800764 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.800746 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 11:27:44.800878 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.800771 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 11:27:44.800942 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.800883 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 11:27:44.800942 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.800926 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5mvkj\"" Jul 08 11:27:44.807291 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.807272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq"] Jul 08 11:27:44.863714 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.863673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.863714 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.863720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.863913 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.863747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6tk5\" (UniqueName: \"kubernetes.io/projected/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-kube-api-access-z6tk5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.863913 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.863786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.863913 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.863809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.863913 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.863846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964388 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964565 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964565 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964565 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964695 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964695 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6tk5\" (UniqueName: \"kubernetes.io/projected/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-kube-api-access-z6tk5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.964795 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.964773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.965055 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.965029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.965235 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.965099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.966856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.966834 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.967160 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.967145 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:44.972667 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:44.972639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6tk5\" (UniqueName: \"kubernetes.io/projected/ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083-kube-api-access-z6tk5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq\" (UID: \"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:45.107715 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:45.107674 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:45.240234 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:45.240211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq"] Jul 08 11:27:45.242823 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:27:45.242798 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5f42b7_bcc4_4bd5_bf84_3ed1cd4fd083.slice/crio-6877e01c0cdee19b6505f56350321f68264a01f26f70f8a6668ab823b7167990 WatchSource:0}: Error finding container 6877e01c0cdee19b6505f56350321f68264a01f26f70f8a6668ab823b7167990: Status 404 returned error can't find the container with id 6877e01c0cdee19b6505f56350321f68264a01f26f70f8a6668ab823b7167990 Jul 08 11:27:45.244476 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:45.244460 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 11:27:45.794491 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:45.794452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" event={"ID":"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083","Type":"ContainerStarted","Data":"6877e01c0cdee19b6505f56350321f68264a01f26f70f8a6668ab823b7167990"} Jul 08 11:27:46.800002 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:46.799963 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" event={"ID":"ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083","Type":"ContainerStarted","Data":"bb7850420780a3a5dd2a3593d14b409419ecd06bc16b20e679332893505dd66a"} Jul 08 11:27:46.817453 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:46.817405 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" podStartSLOduration=1.781090909 podStartE2EDuration="2.817390329s" totalImagesPullingTime="1.03629942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:27:46.816709592 +0000 UTC m=+867.753382180" watchObservedRunningTime="2026-07-08 11:27:46.817390329 +0000 UTC m=+867.754062910" Jul 08 11:27:46.900182 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:46.900146 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:27:55.108717 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:55.108671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:55.109107 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:55.108783 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:55.121899 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:55.121866 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:55.848720 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:55.848691 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq" Jul 08 11:27:56.199973 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:56.199884 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:27:59.189461 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.189428 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47"] Jul 08 11:27:59.192902 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.192882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.196017 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.196001 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 11:27:59.204699 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.204667 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47"] Jul 08 11:27:59.297939 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.297905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrhs\" (UniqueName: \"kubernetes.io/projected/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-kube-api-access-mmrhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.298139 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.297953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.298139 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.297971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.298139 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.298081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.298139 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.298119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.298320 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.298186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.399410 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrhs\" (UniqueName: \"kubernetes.io/projected/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-kube-api-access-mmrhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.399599 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.399664 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.399723 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.399775 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.399824 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.400011 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.399987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.400096 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.400025 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.400153 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.400123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.401971 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.401943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.402388 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.402373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.407729 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.407705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrhs\" (UniqueName: \"kubernetes.io/projected/cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60-kube-api-access-mmrhs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47\" (UID: \"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.501552 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.501435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:27:59.639744 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.639711 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47"] Jul 08 11:27:59.641217 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:27:59.641194 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb2ffb2a_f60f_4d92_83d2_0c8f3ceefc60.slice/crio-46653c815a8f9fa71575d01cbc30f5042977352d476fa50d06a36ec56bc16b6e WatchSource:0}: Error finding container 46653c815a8f9fa71575d01cbc30f5042977352d476fa50d06a36ec56bc16b6e: Status 404 returned error can't find the container with id 46653c815a8f9fa71575d01cbc30f5042977352d476fa50d06a36ec56bc16b6e Jul 08 11:27:59.854581 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:27:59.854547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" event={"ID":"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60","Type":"ContainerStarted","Data":"46653c815a8f9fa71575d01cbc30f5042977352d476fa50d06a36ec56bc16b6e"} Jul 08 11:28:00.860419 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:00.860379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" event={"ID":"cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60","Type":"ContainerStarted","Data":"84df77877018aa769944b7e4ec684c8f8f8d0521769a7864db13881297898c30"} Jul 08 11:28:00.877309 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:00.877254 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" podStartSLOduration=1.709073037 podStartE2EDuration="1.877236544s" totalImagesPullingTime="168.163507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:28:00.876673293 +0000 UTC m=+881.813345866" watchObservedRunningTime="2026-07-08 11:28:00.877236544 +0000 UTC m=+881.813909131" Jul 08 11:28:02.799053 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:02.799019 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:28:09.502401 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:09.502346 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:28:09.502877 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:09.502422 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:28:09.515274 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:09.515246 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:28:09.909637 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:28:09.909604 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47" Jul 08 11:29:42.900300 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:29:42.900220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:29:56.099319 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:29:56.099276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:30:04.997780 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:30:04.997747 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:30:13.426694 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:30:13.426660 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:30:25.888633 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:30:25.888595 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:30:50.608300 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:30:50.608266 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:31:02.951400 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:31:02.951362 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:31:39.392031 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:31:39.391940 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:31:48.886847 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:31:48.886807 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:31:55.397955 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:31:55.397913 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:32:04.996403 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:32:04.996356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:32:16.401581 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:32:16.401541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:32:25.742906 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:32:25.742872 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:32:37.087728 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:32:37.087684 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:32:47.220404 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:32:47.220366 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:33:12.394708 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:33:12.394673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:33:21.699252 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:33:21.699215 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:33:44.728349 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:33:44.728311 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:33:55.094922 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:33:55.094886 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:34:11.692060 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:34:11.691983 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:34:20.502867 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:34:20.502835 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:34:30.499899 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:34:30.499866 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:34:39.888595 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:34:39.888552 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:34:49.099589 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:34:49.099552 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:36:39.014301 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:36:39.014262 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:36:50.309523 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:36:50.309484 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:37:00.812386 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:37:00.812348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:37:11.912289 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:37:11.912201 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:37:23.807485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:37:23.807447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:37:33.103548 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:37:33.103499 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:37:43.597302 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:37:43.597267 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:37:53.592749 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:37:53.592718 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:38:03.902042 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:38:03.902002 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:38:13.294692 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:38:13.294659 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:38:24.601127 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:38:24.601087 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:38:48.490592 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:38:48.490554 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:38:55.802537 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:38:55.802479 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:39:05.598612 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:39:05.598573 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:39:14.996142 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:39:14.996106 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:39:21.993300 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:39:21.993264 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:39:37.798561 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:39:37.798505 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:39:52.199430 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:39:52.199395 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:40:01.596919 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:40:01.596876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:40:15.900248 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:40:15.900172 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:40:25.493126 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:40:25.493093 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:40:38.792528 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:40:38.792487 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:40:47.799870 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:40:47.799827 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:40:56.797339 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:40:56.797308 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:41:07.389765 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:41:07.389725 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:41:16.891034 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:41:16.890990 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:41:24.800210 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:41:24.800172 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:41:40.509749 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:41:40.509669 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:41:52.001295 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:41:52.001258 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:42:01.697183 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:42:01.697145 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:42:17.701654 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:42:17.701619 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:42:30.988128 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:42:30.988094 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:42:42.786855 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:42:42.786821 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:44:19.312242 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:44:19.312212 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:44:28.504409 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:44:28.504370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:44:42.897668 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:44:42.897631 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:44:53.709766 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:44:53.709728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:45:21.500504 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:45:21.500451 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:45:55.489678 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:45:55.489636 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:46:14.294474 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:46:14.294391 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:46:24.801373 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:46:24.801341 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:46:34.993151 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:46:34.993120 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:47:10.706853 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:47:10.706818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:48:20.619493 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:20.619458 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:48:39.695617 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:39.695574 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:48:52.414329 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.414292 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p"] Jul 08 11:48:52.417742 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.417722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.424736 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.424701 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ae9da2\"/\"test-model-ae9da2-kserve-self-signed-certs\"" Jul 08 11:48:52.424858 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.424753 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ae9da2\"/\"openshift-service-ca.crt\"" Jul 08 11:48:52.424858 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.424757 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ae9da2\"/\"kube-root-ca.crt\"" Jul 08 11:48:52.424858 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.424708 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ae9da2\"/\"default-dockercfg-b8x4f\"" Jul 08 11:48:52.431121 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.431100 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p"] Jul 08 11:48:52.547454 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.547413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8cpt\" (UniqueName: \"kubernetes.io/projected/3d906cd7-aa93-469b-9d6a-22dea30b79b7-kube-api-access-m8cpt\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.547454 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.547458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-dshm\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.547697 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.547548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tmp-dir\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.547697 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.547605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-model-cache\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.547697 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.547639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-home\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.547697 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.547679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tls-certs\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.648912 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.648858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8cpt\" (UniqueName: \"kubernetes.io/projected/3d906cd7-aa93-469b-9d6a-22dea30b79b7-kube-api-access-m8cpt\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.648912 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.648917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-dshm\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649118 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.648966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tmp-dir\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649118 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.649007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-model-cache\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649118 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.649048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-home\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649118 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.649108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tls-certs\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649463 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.649441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-model-cache\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649578 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.649450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tmp-dir\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.649578 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.649542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-home\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.651384 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.651359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-dshm\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.651646 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.651630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tls-certs\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.662139 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.662111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8cpt\" (UniqueName: \"kubernetes.io/projected/3d906cd7-aa93-469b-9d6a-22dea30b79b7-kube-api-access-m8cpt\") pod \"test-model-ae9da2-kserve-789858b465-nls8p\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.726017 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.725937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:48:52.863601 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:52.863565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p"] Jul 08 11:48:52.865601 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:48:52.865580 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d906cd7_aa93_469b_9d6a_22dea30b79b7.slice/crio-a343a48852cd9568692b614a624a2f07471db0e2248a60d287d7ec281d5f3e67 WatchSource:0}: Error finding container a343a48852cd9568692b614a624a2f07471db0e2248a60d287d7ec281d5f3e67: Status 404 returned error can't find the container with id a343a48852cd9568692b614a624a2f07471db0e2248a60d287d7ec281d5f3e67 Jul 08 11:48:53.202418 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:53.202387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" event={"ID":"3d906cd7-aa93-469b-9d6a-22dea30b79b7","Type":"ContainerStarted","Data":"99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76"} Jul 08 11:48:53.202600 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:53.202427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" event={"ID":"3d906cd7-aa93-469b-9d6a-22dea30b79b7","Type":"ContainerStarted","Data":"a343a48852cd9568692b614a624a2f07471db0e2248a60d287d7ec281d5f3e67"} Jul 08 11:48:58.500738 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:58.500679 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" podStartSLOduration=6.500661435 podStartE2EDuration="6.500661435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 11:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:48:53.223591203 +0000 UTC m=+2134.160263771" watchObservedRunningTime="2026-07-08 11:48:58.500661435 +0000 UTC m=+2139.437334001" Jul 08 11:48:58.501116 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:48:58.501091 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:49:02.726710 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:02.726670 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:49:02.727081 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:02.726732 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:49:02.739675 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:02.739642 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:49:03.257957 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:03.257925 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:49:12.593264 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:12.593178 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:49:13.773634 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:13.773600 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p"] Jul 08 11:49:24.396057 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:24.396017 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:49:28.794027 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:28.793983 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" podUID="3d906cd7-aa93-469b-9d6a-22dea30b79b7" containerName="main" containerID="cri-o://99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76" gracePeriod=45 Jul 08 11:49:29.048819 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.048798 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:49:29.164818 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.164784 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-dshm\") pod \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " Jul 08 11:49:29.164965 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.164841 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tmp-dir\") pod \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " Jul 08 11:49:29.164965 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.164864 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-model-cache\") pod \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " Jul 08 11:49:29.164965 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.164915 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8cpt\" (UniqueName: \"kubernetes.io/projected/3d906cd7-aa93-469b-9d6a-22dea30b79b7-kube-api-access-m8cpt\") pod \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " Jul 08 11:49:29.164965 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.164936 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-home\") pod \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " Jul 08 11:49:29.164965 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.164951 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tls-certs\") pod \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\" (UID: \"3d906cd7-aa93-469b-9d6a-22dea30b79b7\") " Jul 08 11:49:29.165233 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.165160 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "3d906cd7-aa93-469b-9d6a-22dea30b79b7" (UID: "3d906cd7-aa93-469b-9d6a-22dea30b79b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:49:29.165233 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.165178 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3d906cd7-aa93-469b-9d6a-22dea30b79b7" (UID: "3d906cd7-aa93-469b-9d6a-22dea30b79b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:49:29.165233 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.165193 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-home" (OuterVolumeSpecName: "home") pod "3d906cd7-aa93-469b-9d6a-22dea30b79b7" (UID: "3d906cd7-aa93-469b-9d6a-22dea30b79b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:49:29.167150 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.167120 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d906cd7-aa93-469b-9d6a-22dea30b79b7-kube-api-access-m8cpt" (OuterVolumeSpecName: "kube-api-access-m8cpt") pod "3d906cd7-aa93-469b-9d6a-22dea30b79b7" (UID: "3d906cd7-aa93-469b-9d6a-22dea30b79b7"). InnerVolumeSpecName "kube-api-access-m8cpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 11:49:29.167264 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.167150 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3d906cd7-aa93-469b-9d6a-22dea30b79b7" (UID: "3d906cd7-aa93-469b-9d6a-22dea30b79b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 11:49:29.167264 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.167197 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-dshm" (OuterVolumeSpecName: "dshm") pod "3d906cd7-aa93-469b-9d6a-22dea30b79b7" (UID: "3d906cd7-aa93-469b-9d6a-22dea30b79b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 11:49:29.265856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.265814 2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-dshm\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:49:29.265856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.265843 2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tmp-dir\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:49:29.265856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.265854 2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-model-cache\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:49:29.265856 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.265864 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8cpt\" (UniqueName: \"kubernetes.io/projected/3d906cd7-aa93-469b-9d6a-22dea30b79b7-kube-api-access-m8cpt\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:49:29.266120 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.265872 2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d906cd7-aa93-469b-9d6a-22dea30b79b7-home\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:49:29.266120 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.265882 2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d906cd7-aa93-469b-9d6a-22dea30b79b7-tls-certs\") on node \"ip-10-0-139-193.ec2.internal\" DevicePath \"\"" Jul 08 11:49:29.357140 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.357057 2563 generic.go:356] "Generic (PLEG): container finished" podID="3d906cd7-aa93-469b-9d6a-22dea30b79b7" containerID="99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76" exitCode=0 Jul 08 11:49:29.357140 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.357098 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" Jul 08 11:49:29.357298 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.357098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" event={"ID":"3d906cd7-aa93-469b-9d6a-22dea30b79b7","Type":"ContainerDied","Data":"99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76"} Jul 08 11:49:29.357298 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.357224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p" event={"ID":"3d906cd7-aa93-469b-9d6a-22dea30b79b7","Type":"ContainerDied","Data":"a343a48852cd9568692b614a624a2f07471db0e2248a60d287d7ec281d5f3e67"} Jul 08 11:49:29.357298 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.357248 2563 scope.go:117] "RemoveContainer" containerID="99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76" Jul 08 11:49:29.367725 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.367704 2563 scope.go:117] "RemoveContainer" containerID="99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76" Jul 08 11:49:29.368075 ip-10-0-139-193 kubenswrapper[2563]: E0708 11:49:29.368017 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76\": container with ID starting with 99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76 not found: ID does not exist" containerID="99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76" Jul 08 11:49:29.368151 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.368063 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76"} err="failed to get container status \"99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76\": rpc error: code = NotFound desc = could not find container \"99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76\": container with ID starting with 99cd9615bcc8c7f9defe1e18cd18f588eb96addb33d616432806ccf9a52aba76 not found: ID does not exist" Jul 08 11:49:29.382147 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.382125 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p"] Jul 08 11:49:29.387640 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.387620 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ae9da2/test-model-ae9da2-kserve-789858b465-nls8p"] Jul 08 11:49:29.575190 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:29.575154 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d906cd7-aa93-469b-9d6a-22dea30b79b7" path="/var/lib/kubelet/pods/3d906cd7-aa93-469b-9d6a-22dea30b79b7/volumes" Jul 08 11:49:50.293934 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:49:50.293896 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:50:03.616959 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:50:03.616923 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:50:22.095211 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:50:22.095177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:50:35.409709 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:50:35.409674 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:50:50.897151 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:50:50.897113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:53:56.832485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:53:56.832453 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:54:09.390397 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:09.390361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jsj5c"] Jul 08 11:54:12.783261 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:12.783234 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z8nvl_5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd/server/0.log" Jul 08 11:54:12.911134 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:12.911102 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sr26c_371772f4-5ece-4d6d-8b4d-30b713f0828a/manager/0.log" Jul 08 11:54:13.052730 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:13.052700 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-27stt_40366692-b290-466d-8cd3-51dbb425418f/copy-manifests/0.log" Jul 08 11:54:13.071576 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:13.071546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-27stt_40366692-b290-466d-8cd3-51dbb425418f/manager/0.log" Jul 08 11:54:14.839622 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:14.839587 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d772s_73f2a599-c44b-4b52-8add-d6c9990359d2/manager/0.log" Jul 08 11:54:15.213034 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:15.212941 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xhh2t_2f2acd20-763f-4fd5-b95a-e3fffb2211d4/registry-server/0.log" Jul 08 11:54:15.453469 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:15.453440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jsj5c_c5126d82-f2f2-401c-b493-916e8004f877/limitador/0.log" Jul 08 11:54:15.583222 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:15.583184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wgv57_967d7105-8bf7-44a0-81c0-2711d7660d0d/manager/0.log" Jul 08 11:54:16.065171 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:16.065134 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7m2gg_4f3e8029-e0af-43b2-a446-55ce2a47996f/discovery/0.log" Jul 08 11:54:16.178740 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:16.178708 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-f6pkx_2d684ebd-7a90-4b65-950a-41d1fde26d6c/kube-auth-proxy/0.log" Jul 08 11:54:17.482067 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:17.482039 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db44slq_ce5f42b7-bcc4-4bd5-bf84-3ed1cd4fd083/main/0.log" Jul 08 11:54:17.702427 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:17.702396 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-b9m47_cb2ffb2a-f60f-4d92-83d2-0c8f3ceefc60/main/0.log" Jul 08 11:54:24.701682 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:24.701652 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qd6qz_62f21c1b-f7db-4fd1-8500-6d2046c94e7e/global-pull-secret-syncer/0.log" Jul 08 11:54:25.143748 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:25.143716 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-glbfs_d00f6ec7-2172-4d71-9cc7-e59ec7a20bf9/konnectivity-agent/0.log" Jul 08 11:54:25.188280 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:25.188252 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-193.ec2.internal_460a8649ce7a99a2ec27bc03a529a31a/haproxy/0.log" Jul 08 11:54:30.134580 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:30.134550 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d772s_73f2a599-c44b-4b52-8add-d6c9990359d2/manager/0.log" Jul 08 11:54:30.256294 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:30.256262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xhh2t_2f2acd20-763f-4fd5-b95a-e3fffb2211d4/registry-server/0.log" Jul 08 11:54:30.444146 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:30.444055 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jsj5c_c5126d82-f2f2-401c-b493-916e8004f877/limitador/0.log" Jul 08 11:54:30.532002 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:30.531973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wgv57_967d7105-8bf7-44a0-81c0-2711d7660d0d/manager/0.log" Jul 08 11:54:32.878161 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:32.878121 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hrcwl_d9024072-1aca-40fc-9b50-65311bd51e43/node-exporter/0.log" Jul 08 11:54:32.916205 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:32.916173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hrcwl_d9024072-1aca-40fc-9b50-65311bd51e43/kube-rbac-proxy/0.log" Jul 08 11:54:32.946321 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:32.946295 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hrcwl_d9024072-1aca-40fc-9b50-65311bd51e43/init-textfile/0.log" Jul 08 11:54:33.293572 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:33.293481 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tzxqh_0d8596fe-4cc9-41b8-ab08-7ade1c0af248/prometheus-operator/0.log" Jul 08 11:54:33.314796 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:33.314773 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tzxqh_0d8596fe-4cc9-41b8-ab08-7ade1c0af248/kube-rbac-proxy/0.log" Jul 08 11:54:33.347654 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:33.347630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fsw2g_b0fa5f61-3f9a-4d89-a6ea-6b7c51eef4c0/prometheus-operator-admission-webhook/0.log" Jul 08 11:54:34.375062 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.375032 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg"] Jul 08 11:54:34.375597 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.375446 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d906cd7-aa93-469b-9d6a-22dea30b79b7" containerName="main" Jul 08 11:54:34.375597 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.375470 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d906cd7-aa93-469b-9d6a-22dea30b79b7" containerName="main" Jul 08 11:54:34.375597 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.375554 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d906cd7-aa93-469b-9d6a-22dea30b79b7" containerName="main" Jul 08 11:54:34.378459 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.378444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.381783 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.381762 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wcxfn\"/\"openshift-service-ca.crt\"" Jul 08 11:54:34.383076 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.383057 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wcxfn\"/\"default-dockercfg-kjnzf\"" Jul 08 11:54:34.383136 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.383077 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wcxfn\"/\"kube-root-ca.crt\"" Jul 08 11:54:34.399229 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.399206 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg"] Jul 08 11:54:34.439061 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.439033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-podres\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.439198 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.439065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-lib-modules\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.439198 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.439083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-proc\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.439198 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.439102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh5q4\" (UniqueName: \"kubernetes.io/projected/62dda0bd-947d-4623-9296-6d80750223d5-kube-api-access-fh5q4\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.439330 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.439191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-sys\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540335 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-sys\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-podres\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-lib-modules\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540432 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-sys\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540485 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-proc\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540726 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh5q4\" (UniqueName: \"kubernetes.io/projected/62dda0bd-947d-4623-9296-6d80750223d5-kube-api-access-fh5q4\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540726 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-proc\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540726 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-lib-modules\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.540726 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.540608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62dda0bd-947d-4623-9296-6d80750223d5-podres\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.551481 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.551459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh5q4\" (UniqueName: \"kubernetes.io/projected/62dda0bd-947d-4623-9296-6d80750223d5-kube-api-access-fh5q4\") pod \"perf-node-gather-daemonset-gl9pg\" (UID: \"62dda0bd-947d-4623-9296-6d80750223d5\") " pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.688549 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.688441 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:34.819851 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:34.819828 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg"] Jul 08 11:54:34.822048 ip-10-0-139-193 kubenswrapper[2563]: W0708 11:54:34.822019 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62dda0bd_947d_4623_9296_6d80750223d5.slice/crio-54e2c9d4112e1784fbb8e838d7b5fa9729d8666ec8abaee0c1cbea6dd5f504d8 WatchSource:0}: Error finding container 54e2c9d4112e1784fbb8e838d7b5fa9729d8666ec8abaee0c1cbea6dd5f504d8: Status 404 returned error can't find the container with id 54e2c9d4112e1784fbb8e838d7b5fa9729d8666ec8abaee0c1cbea6dd5f504d8 Jul 08 11:54:35.638809 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:35.638772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" event={"ID":"62dda0bd-947d-4623-9296-6d80750223d5","Type":"ContainerStarted","Data":"04220b8a459d4e6795a961c0577335cdcd6414afe774eafc8283544b0ec6cd61"} Jul 08 11:54:35.639226 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:35.638824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" event={"ID":"62dda0bd-947d-4623-9296-6d80750223d5","Type":"ContainerStarted","Data":"54e2c9d4112e1784fbb8e838d7b5fa9729d8666ec8abaee0c1cbea6dd5f504d8"} Jul 08 11:54:35.639226 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:35.638854 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:35.661086 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:35.661037 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" podStartSLOduration=1.661022642 podStartE2EDuration="1.661022642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 11:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 11:54:35.660747168 +0000 UTC m=+2476.597419737" watchObservedRunningTime="2026-07-08 11:54:35.661022642 +0000 UTC m=+2476.597695259" Jul 08 11:54:35.983818 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:35.983736 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-pplp7_30160d1d-928f-4336-8dcc-eb67e3a19449/download-server/0.log" Jul 08 11:54:37.619992 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:37.619944 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dl2q_e6eb3240-0c29-4d1b-8a3d-e814e4ce5012/dns/0.log" Jul 08 11:54:37.664585 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:37.664549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dl2q_e6eb3240-0c29-4d1b-8a3d-e814e4ce5012/kube-rbac-proxy/0.log" Jul 08 11:54:37.934065 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:37.933983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8xnb7_d907dd46-36f4-4dae-90d3-33f12e7aed39/dns-node-resolver/0.log" Jul 08 11:54:38.544839 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:38.544806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79b5fc7878-5pdgl_f11149d0-8210-422a-9d69-babccfe6d9bf/registry/0.log" Jul 08 11:54:38.669063 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:38.669026 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x7blf_0cfd1065-2cf4-424c-8ec3-c0a680bbb1bb/node-ca/0.log" Jul 08 11:54:39.801692 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:39.801661 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7m2gg_4f3e8029-e0af-43b2-a446-55ce2a47996f/discovery/0.log" Jul 08 11:54:39.841670 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:39.841640 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-f6pkx_2d684ebd-7a90-4b65-950a-41d1fde26d6c/kube-auth-proxy/0.log" Jul 08 11:54:41.043924 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:41.043895 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dfd2q_f9f4b79d-8eb7-48f2-a66f-001e388e189e/serve-healthcheck-canary/0.log" Jul 08 11:54:41.602072 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:41.602035 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-52qtb_93051d59-67e7-4ca6-a396-12324852cf62/kube-rbac-proxy/0.log" Jul 08 11:54:41.628558 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:41.628531 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-52qtb_93051d59-67e7-4ca6-a396-12324852cf62/exporter/0.log" Jul 08 11:54:41.652289 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:41.652264 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wcxfn/perf-node-gather-daemonset-gl9pg" Jul 08 11:54:41.654249 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:41.654229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-52qtb_93051d59-67e7-4ca6-a396-12324852cf62/extractor/0.log" Jul 08 11:54:44.502472 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:44.502382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z8nvl_5a85ea5b-2e55-41ac-95c0-22cc8be8a0bd/server/0.log" Jul 08 11:54:44.613283 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:44.613247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sr26c_371772f4-5ece-4d6d-8b4d-30b713f0828a/manager/0.log" Jul 08 11:54:44.747971 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:44.747929 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-27stt_40366692-b290-466d-8cd3-51dbb425418f/manager/0.log" Jul 08 11:54:44.765424 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:44.765350 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7m2gg_4f3e8029-e0af-43b2-a446-55ce2a47996f/discovery/0.log" Jul 08 11:54:44.767415 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:44.767398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9b86684-27stt_40366692-b290-466d-8cd3-51dbb425418f/copy-manifests/0.log" Jul 08 11:54:44.773902 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:44.773882 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-f6pkx_2d684ebd-7a90-4b65-950a-41d1fde26d6c/kube-auth-proxy/0.log" Jul 08 11:54:46.298586 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:46.298549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7m2gg_4f3e8029-e0af-43b2-a446-55ce2a47996f/discovery/0.log" Jul 08 11:54:46.311442 ip-10-0-139-193 kubenswrapper[2563]: I0708 11:54:46.311415 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9cf876f85-f6pkx_2d684ebd-7a90-4b65-950a-41d1fde26d6c/kube-auth-proxy/0.log"