Jul 23 18:28:21.374065 ip-10-0-142-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 18:28:21.374076 ip-10-0-142-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 18:28:21.374083 ip-10-0-142-38 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 18:28:21.374310 ip-10-0-142-38 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 18:28:31.650802 ip-10-0-142-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 23 18:28:31.650817 ip-10-0-142-38 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b682e0314977465bb65f23c69942f895 -- Jul 23 18:30:18.113057 ip-10-0-142-38 systemd[1]: Starting Kubernetes Kubelet... Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.552878 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560788 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560800 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560803 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560806 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560810 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560813 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560816 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:18.653439 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560820 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:18.638944 ip-10-0-142-38 systemd[1]: Started Kubernetes Kubelet. Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560823 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560826 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560829 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560832 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560835 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560839 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560844 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560847 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560850 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560852 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560856 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560859 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560862 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560865 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560873 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560876 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560879 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560882 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560885 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:18.655125 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560887 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560890 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560892 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560895 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560897 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560900 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560902 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560905 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560908 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560911 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560913 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560916 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560918 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560921 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560924 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560927 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560929 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560932 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560934 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560937 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:18.656312 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560941 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560943 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560947 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560951 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560954 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560957 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560960 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560963 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560966 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560969 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560971 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560974 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560977 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560979 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560982 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560985 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560987 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560990 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560993 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:18.657841 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560995 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.560998 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561000 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561003 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561007 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561010 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561013 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561016 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561019 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561021 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561024 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561027 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561029 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561033 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561035 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561038 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561040 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561043 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561045 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561048 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:18.659097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561050 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561053 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561055 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561058 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561060 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561062 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561065 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561067 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561070 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561072 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561076 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561079 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561082 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561790 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561796 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561799 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561802 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561806 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561809 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561812 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:18.660202 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561814 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561817 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561819 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561825 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561829 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561832 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561836 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561839 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561842 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561845 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561848 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561850 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561853 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561856 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561860 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561862 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561865 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561867 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:18.660998 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561870 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561874 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561878 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561881 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561884 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561886 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561889 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561892 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561894 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561897 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561899 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561902 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561905 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561907 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561910 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561913 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561915 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561918 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561921 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:18.661593 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561924 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561926 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561929 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561932 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561935 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561939 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561941 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561944 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561947 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561949 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561952 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561954 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561957 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561959 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561962 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561964 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561967 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561969 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561972 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561975 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:18.663418 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561977 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561980 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561983 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561986 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561988 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561991 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561994 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561996 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.561999 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562001 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562006 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562009 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562011 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562014 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562017 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562020 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562023 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562026 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562028 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562031 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:18.664532 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562035 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562037 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562040 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562042 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562045 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562047 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562050 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562053 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562056 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562059 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562061 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562064 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562066 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562069 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562071 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562480 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562486 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562489 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562494 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562498 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:18.853580 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562501 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562504 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562509 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562512 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562515 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562518 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562520 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562523 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562526 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562528 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562531 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562534 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562536 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562539 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562541 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562544 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562546 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562549 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562552 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562554 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:18.875658 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562557 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562560 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562566 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562568 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562571 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562574 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562576 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562579 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562581 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562584 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562587 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562589 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562592 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562594 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562598 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562601 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562603 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562606 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562609 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562611 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:18.876506 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562614 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562617 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562619 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562622 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562624 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562627 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562629 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562632 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562634 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562637 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562640 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562643 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562647 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562650 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562654 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562657 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562660 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562663 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562665 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:18.877390 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562668 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562670 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562674 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562677 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562680 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562683 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562685 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562689 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562692 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562694 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562698 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562700 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562703 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562705 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562708 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562711 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562713 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562716 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562718 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:18.878077 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562721 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562723 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562725 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562728 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562730 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562733 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562735 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562738 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562742 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562745 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562747 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562750 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562752 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562755 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562774 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.562776 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562854 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562864 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562873 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562879 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562887 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 18:30:18.878740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562892 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562898 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562903 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562906 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562909 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562912 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562916 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562920 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562923 2564 flags.go:64] FLAG: --cgroup-root="" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562925 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562928 2564 flags.go:64] FLAG: --client-ca-file="" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562931 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562934 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562939 2564 flags.go:64] FLAG: --cluster-domain="" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562942 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562945 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562948 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562951 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562954 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562959 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562962 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562965 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562968 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562971 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 18:30:18.879393 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562974 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562977 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562980 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562984 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562987 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562989 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562992 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.562997 2564 flags.go:64] FLAG: --enable-server="true" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563000 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563004 2564 flags.go:64] FLAG: --event-burst="100" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563007 2564 flags.go:64] FLAG: --event-qps="50" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563009 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563012 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563015 2564 flags.go:64] FLAG: --eviction-hard="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563019 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563022 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563026 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563029 2564 flags.go:64] FLAG: --eviction-soft="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563032 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563035 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563038 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563041 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563044 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563046 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563049 2564 flags.go:64] FLAG: --feature-gates="" Jul 23 18:30:18.880276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563053 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563056 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563060 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563063 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563066 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563069 2564 flags.go:64] FLAG: --help="false" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563072 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-142-38.ec2.internal" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563075 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563078 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563081 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563084 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563088 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563091 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563093 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563097 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563101 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563104 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563107 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563110 2564 flags.go:64] FLAG: --kube-reserved="" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563113 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563115 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563119 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563122 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563124 2564 flags.go:64] FLAG: --lock-file="" Jul 23 18:30:18.881178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563127 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563131 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563133 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563139 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563141 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563144 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563147 2564 flags.go:64] FLAG: --logging-format="text" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563150 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563153 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563156 2564 flags.go:64] FLAG: --manifest-url="" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563160 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563165 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563168 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563171 2564 flags.go:64] FLAG: --max-pods="110" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563174 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563177 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563180 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563183 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563186 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563189 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563191 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563198 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563203 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563206 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 18:30:18.882066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563209 2564 flags.go:64] FLAG: --pod-cidr="" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563212 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563218 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563220 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563223 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563226 2564 flags.go:64] FLAG: --port="10250" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563229 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563232 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0342612299642890a" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563235 2564 flags.go:64] FLAG: --qos-reserved="" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563239 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563241 2564 flags.go:64] FLAG: --register-node="true" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563245 2564 flags.go:64] FLAG: --register-with-taints="" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563248 2564 flags.go:64] FLAG: --registry-burst="10" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563251 2564 flags.go:64] FLAG: --registry-qps="5" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563253 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563256 2564 flags.go:64] FLAG: --reserved-memory="" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563260 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563263 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563267 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563270 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563273 2564 flags.go:64] FLAG: --runonce="false" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563276 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563279 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563282 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563285 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 18:30:18.882774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563288 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563290 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563294 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563297 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563299 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563302 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563306 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563309 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563312 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563315 2564 flags.go:64] FLAG: --system-cgroups="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563318 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563323 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563325 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563328 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563333 2564 flags.go:64] FLAG: --tls-min-version="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563335 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563338 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563341 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563344 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563348 2564 flags.go:64] FLAG: --v="2" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563351 2564 flags.go:64] FLAG: --version="false" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563355 2564 flags.go:64] FLAG: --vmodule="" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563359 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.563362 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563475 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:18.883562 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563481 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563484 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563487 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563490 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563493 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563496 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563499 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563501 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563504 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563507 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563510 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563512 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563515 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563519 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563522 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563525 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563527 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563530 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563532 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563535 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:18.884291 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563537 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563542 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563545 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563548 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563551 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563554 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563557 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563560 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563563 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563566 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563568 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563571 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563575 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563578 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563580 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563583 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563585 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563588 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563590 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:18.884914 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563593 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563597 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563600 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563604 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563606 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563609 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563614 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563617 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563627 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563630 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563633 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563636 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563639 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563641 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563644 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563646 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563649 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563652 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563654 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563657 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:18.885463 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563660 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563663 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563665 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563668 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563671 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563675 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563678 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563680 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563683 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563685 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563687 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563690 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563694 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563697 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563701 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563703 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563706 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563709 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563713 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:18.886105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563715 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563718 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563720 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563723 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563726 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563728 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563731 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563733 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563736 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563738 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563741 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563743 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563746 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563752 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563768 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563772 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563774 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563777 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563781 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:18.886673 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.563783 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.564382 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.571415 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.571429 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.571448 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.571457 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571523 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571527 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571530 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571534 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571536 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571539 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571541 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571544 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571547 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:18.887290 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571549 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571552 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571555 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571558 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571560 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571563 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571565 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571568 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571570 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571573 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571576 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571578 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571580 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571583 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571585 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571588 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571591 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571593 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571596 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571599 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:18.887736 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571609 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571613 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571615 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571618 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571631 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571634 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571637 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571640 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571643 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571645 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571648 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571650 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571653 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571656 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571658 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571661 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571664 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571666 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571669 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:18.888410 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571671 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571674 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571677 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571679 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571682 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571684 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571690 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571692 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571695 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571697 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571700 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571703 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571705 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571708 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571712 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571715 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571717 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571720 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571724 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:18.889311 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571728 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571731 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571735 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571741 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571745 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571747 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571750 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571753 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571771 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571775 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571778 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571781 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571784 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571787 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571790 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571793 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571796 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571798 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571801 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:18.889920 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571805 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571808 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571810 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571813 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571815 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571818 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571821 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571823 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571826 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571834 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571837 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571840 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571842 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.571847 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571969 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:30:19.069591 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571974 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571977 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571981 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571984 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571987 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571990 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571992 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571995 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.571997 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572000 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572002 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572005 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572008 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572010 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572013 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572016 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572019 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572023 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572026 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572029 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:30:19.070527 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572032 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572034 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572037 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572039 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572042 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572045 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572047 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572051 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572053 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572056 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572058 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572061 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572064 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572066 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572071 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572074 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572076 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572079 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572081 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572084 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:30:19.071197 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572086 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572089 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572091 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572094 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572097 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572099 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572102 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572104 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572107 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572111 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572114 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572116 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572119 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572121 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572124 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572126 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572129 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572132 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572134 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572137 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:30:19.071860 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572140 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572142 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572146 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572150 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572153 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572156 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572161 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572163 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572166 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572169 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572171 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572174 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572177 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572179 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572182 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572184 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572187 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572189 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572192 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572194 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:30:19.072441 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572197 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572201 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572204 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572206 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572209 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572211 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572214 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572216 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572219 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572222 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572224 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572228 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572231 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572234 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572237 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572240 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572243 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:30:19.073105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:18.572247 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.572253 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.572347 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.574283 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.575565 2564 server.go:1019] "Starting client certificate rotation" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.575660 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.575697 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.578094 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.583906 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.593580 2564 log.go:25] "Validated CRI v1 runtime API" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.595591 2564 log.go:25] "Validated CRI v1 image API" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.596390 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 18:30:19.073614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.604309 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 82a7434d-a731-460c-9542-2bb3ed3dbfe6:/dev/nvme0n1p3 adf73b84-fe09-44ea-b040-067f224e9fb8:/dev/nvme0n1p4] Jul 23 18:30:19.074037 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.604326 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.608655 2564 manager.go:216] Machine: {Timestamp:2026-07-23 18:30:18.60819101 +0000 UTC m=+0.374288821 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099934 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec1fcac7aa59873a000ca01f02da6 SystemUUID:ec2ec1fc-ac7a-a598-73a0-00ca01f02da6 BootID:b682e031-4977-465b-b65f-23c69942f895 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:79:e3:6c:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:79:e3:6c:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:0a:8c:09:f4:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.608773 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.608845 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.609737 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.610912 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.610936 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 18:30:19.074127 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.611675 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.611684 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.611692 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.611705 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.612843 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616422 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616557 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616584 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616602 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616638 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616649 2564 kubelet.go:398] "Adding apiserver pod source" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.616673 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.617039 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.617059 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.620689 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.622531 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.622558 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623605 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623631 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623641 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623650 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623659 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623665 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623672 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623678 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623684 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623690 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623698 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.623704 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.624678 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.624684 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.627744 2564 server.go:1268] "Started kubelet" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.627825 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.627875 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.627928 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.637462 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.638837 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.639316 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.639838 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 18:30:19.074446 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.643045 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.643185 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.642990 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-38.ec2.internal.18c4feb803401b46 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-38.ec2.internal,UID:ip-10-0-142-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-38.ec2.internal,},FirstTimestamp:2026-07-23 18:30:18.627529542 +0000 UTC m=+0.393627354,LastTimestamp:2026-07-23 18:30:18.627529542 +0000 UTC m=+0.393627354,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-38.ec2.internal,}" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.645337 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.645357 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.645406 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646066 2564 factory.go:55] Registering systemd factory Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646082 2564 factory.go:223] Registration of the systemd container factory successfully Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646118 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646119 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646277 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646318 2564 factory.go:153] Registering CRI-O factory Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646333 2564 factory.go:223] Registration of the crio container factory successfully Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646366 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646374 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646379 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646402 2564 factory.go:103] Registering Raw factory Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646414 2564 manager.go:1196] Started watching for new ooms in manager Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.646815 2564 manager.go:349] Starting recovery of all containers Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.650345 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.650428 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.657710 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n5xqq" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.659537 2564 manager.go:354] Recovery completed Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.660931 2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.663429 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n5xqq" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.664194 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666003 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666028 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666039 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666496 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 18:30:19.075589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666506 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666506 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.666543 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.667143 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.667165 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.667181 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.668192 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-38.ec2.internal.18c4feb8058b59c0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-38.ec2.internal,UID:ip-10-0-142-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-38.ec2.internal,},FirstTimestamp:2026-07-23 18:30:18.666015168 +0000 UTC m=+0.432112984,LastTimestamp:2026-07-23 18:30:18.666015168 +0000 UTC m=+0.432112984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-38.ec2.internal,}" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.668578 2564 policy_none.go:49] "None policy: Start" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.668601 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.668619 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.670755 2564 policy_none.go:47] "Start" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697300 2564 manager.go:337] "Starting Device Plugin manager" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.697326 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697338 2564 server.go:87] "Starting device plugin registration server" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697575 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697588 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697667 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697746 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.697755 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.698163 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.698216 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.797901 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.798276 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.798931 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.798968 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.798987 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.799023 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.799642 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.799677 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.799695 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.799732 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.801835 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.809121 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.809139 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-38.ec2.internal\": node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.076495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.851953 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.900571 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal"] Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.900646 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.901559 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.901588 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.901599 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.903987 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904135 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904821 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904853 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904821 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904865 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904884 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.904900 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.907233 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.907265 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.908013 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.908041 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.908051 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.941410 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-38.ec2.internal\" not found" node="ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.945373 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-38.ec2.internal\" not found" node="ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.948597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa48c7a932e4b7ba4f5a45bb3aac178f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal\" (UID: \"aa48c7a932e4b7ba4f5a45bb3aac178f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.948621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa48c7a932e4b7ba4f5a45bb3aac178f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal\" (UID: \"aa48c7a932e4b7ba4f5a45bb3aac178f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:18.948636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa994f2ba01c45573160a315348131e9-config\") pod \"kube-apiserver-proxy-ip-10-0-142-38.ec2.internal\" (UID: \"fa994f2ba01c45573160a315348131e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.077571 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:18.952807 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.049267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa48c7a932e4b7ba4f5a45bb3aac178f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal\" (UID: \"aa48c7a932e4b7ba4f5a45bb3aac178f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.049291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa48c7a932e4b7ba4f5a45bb3aac178f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal\" (UID: \"aa48c7a932e4b7ba4f5a45bb3aac178f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.049307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa994f2ba01c45573160a315348131e9-config\") pod \"kube-apiserver-proxy-ip-10-0-142-38.ec2.internal\" (UID: \"fa994f2ba01c45573160a315348131e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.049345 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa994f2ba01c45573160a315348131e9-config\") pod \"kube-apiserver-proxy-ip-10-0-142-38.ec2.internal\" (UID: \"fa994f2ba01c45573160a315348131e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.049380 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa48c7a932e4b7ba4f5a45bb3aac178f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal\" (UID: \"aa48c7a932e4b7ba4f5a45bb3aac178f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.049404 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa48c7a932e4b7ba4f5a45bb3aac178f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal\" (UID: \"aa48c7a932e4b7ba4f5a45bb3aac178f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.078499 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.053521 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.281622 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.154682 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.281622 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.251271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.281622 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.251277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:19.281622 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.254930 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.482178 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.355200 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.482178 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.455401 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.647281 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.555461 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.647281 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.576145 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 18:30:19.647281 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.576292 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:30:19.836245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.655969 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.836245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.667830 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:25:19 +0000 UTC" deadline="2028-03-27 21:32:24.459271224 +0000 UTC" Jul 23 18:30:19.836245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.667859 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14715h2m4.791416842s" Jul 23 18:30:19.836245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.686121 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:19.836245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:19.756237 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-38.ec2.internal\" not found" Jul 23 18:30:19.836245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.787803 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:20.039907 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.843544 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:20.039907 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.846494 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" Jul 23 18:30:20.039907 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.860670 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:30:20.039907 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.861704 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" Jul 23 18:30:20.039907 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:19.869006 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:30:20.185107 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.113735 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa48c7a932e4b7ba4f5a45bb3aac178f.slice/crio-b74afcdf2407f231f3f0a476e55f908d390dc73cc04296ece255101b62762637 WatchSource:0}: Error finding container b74afcdf2407f231f3f0a476e55f908d390dc73cc04296ece255101b62762637: Status 404 returned error can't find the container with id b74afcdf2407f231f3f0a476e55f908d390dc73cc04296ece255101b62762637 Jul 23 18:30:20.185107 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.113949 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa994f2ba01c45573160a315348131e9.slice/crio-e662845f1b98943784d1ec85c196e693e39410b645d672a33d28c0404dcb3f7b WatchSource:0}: Error finding container e662845f1b98943784d1ec85c196e693e39410b645d672a33d28c0404dcb3f7b: Status 404 returned error can't find the container with id e662845f1b98943784d1ec85c196e693e39410b645d672a33d28c0404dcb3f7b Jul 23 18:30:20.185107 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.117709 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.602669 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.620720 2564 apiserver.go:52] "Watching apiserver" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.627590 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.630038 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-vh5jl","kube-system/konnectivity-agent-bdq22","openshift-dns/node-resolver-5455h","openshift-image-registry/node-ca-lvgnl","openshift-multus/multus-45ssf","openshift-multus/network-metrics-daemon-9wgrt","openshift-network-diagnostics/network-check-target-5s9nw","openshift-network-operator/iptables-alerter-d7dvb","kube-system/global-pull-secret-syncer-lpcrz","kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf","openshift-cluster-node-tuning-operator/tuned-s7q4j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-hkzdr"] Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.634053 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.636287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.636439 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.636545 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.636794 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.636817 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kc2h4\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.638318 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.638560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.638729 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n265x\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.638969 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.640899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.640923 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.640945 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.640947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pcg9q\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.642965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.643214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.643221 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.643237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.643304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxgl5\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.645379 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.645477 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.646506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.646717 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.646930 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:20.703917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.646968 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rlvl\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.647328 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.647378 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.651234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.653560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.654206 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.654210 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.654210 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.654508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.654558 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tr5mf\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.655031 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.655245 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.655923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qj7jf\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.656040 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.656202 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.656327 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.656339 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.656942 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.658444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qh76t\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.658464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.658506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.658524 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50969230-2d01-40fb-858d-2cb6d2a8d640-host\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50969230-2d01-40fb-858d-2cb6d2a8d640-serviceca\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-systemd-units\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.707348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-system-cni-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-node-log\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-log-socket\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovnkube-script-lib\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-etc-selinux\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpl4t\" (UniqueName: \"kubernetes.io/projected/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-kube-api-access-hpl4t\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/440d15a8-0698-4f25-b465-6abe1bc7b33a-konnectivity-ca\") pod \"konnectivity-agent-bdq22\" (UID: \"440d15a8-0698-4f25-b465-6abe1bc7b33a\") " pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-kubelet\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-device-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjlw\" (UniqueName: \"kubernetes.io/projected/d37c033d-4733-4410-a3bf-24a873b07bd4-kube-api-access-2xjlw\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-netns\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-k8s-cni-cncf-io\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.708279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-etc-kubernetes\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-ovn\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-cni-netd\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovnkube-config\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-registration-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/440d15a8-0698-4f25-b465-6abe1bc7b33a-agent-certs\") pod \"konnectivity-agent-bdq22\" (UID: \"440d15a8-0698-4f25-b465-6abe1bc7b33a\") " pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8cfp\" (UniqueName: \"kubernetes.io/projected/50969230-2d01-40fb-858d-2cb6d2a8d640-kube-api-access-n8cfp\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-slash\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-run-netns\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dms9\" (UniqueName: \"kubernetes.io/projected/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-kube-api-access-4dms9\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-os-release\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-sys-fs\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.712360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgttd\" (UniqueName: \"kubernetes.io/projected/3977e1c1-3336-4c31-8e6e-6a0285f6d415-kube-api-access-lgttd\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-var-lib-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-cni-binary-copy\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-socket-dir-parent\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d37c033d-4733-4410-a3bf-24a873b07bd4-hosts-file\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.659983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-cnibin\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660008 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-daemon-config\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-cni-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-cni-bin\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-hostroot\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-conf-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-multus-certs\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-env-overrides\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.713380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovn-node-metrics-cert\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-socket-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660356 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-cni-multus\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-kube-api-access-fs4lv\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-etc-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37c033d-4733-4410-a3bf-24a873b07bd4-tmp-dir\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-kubelet\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-systemd\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-cni-bin\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.660959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.661140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.661313 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2ktq\"" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.661355 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.663560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.663649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.684661 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-24tn9" Jul 23 18:30:20.716927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.693364 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-24tn9" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.747879 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-os-release\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-kubernetes\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysctl-conf\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-sys-fs\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-os-release\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgttd\" (UniqueName: \"kubernetes.io/projected/3977e1c1-3336-4c31-8e6e-6a0285f6d415-kube-api-access-lgttd\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysctl-d\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761477 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-sys-fs\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-var-lib-kubelet\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761520 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-os-release\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-var-lib-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-cni-binary-copy\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.834705 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-socket-dir-parent\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-var-lib-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d37c033d-4733-4410-a3bf-24a873b07bd4-hosts-file\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-cnibin\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761704 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d37c033d-4733-4410-a3bf-24a873b07bd4-hosts-file\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-daemon-config\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-socket-dir-parent\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a827359-4b90-490e-9d8a-7511934a486c-dbus\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-cni-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-cnibin\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.761739 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-cni-bin\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-hostroot\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.761867 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:21.26184083 +0000 UTC m=+3.027938647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:20.835614 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761878 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-cni-bin\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cf55c0c-1513-4e44-8038-c5a53bdafe52-host-slash\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-tuned\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cd8s\" (UniqueName: \"kubernetes.io/projected/96f4ebc2-1e82-4254-a81c-0062319b2880-kube-api-access-2cd8s\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-conf-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-cni-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761954 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-hostroot\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-multus-certs\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.761997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-conf-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-env-overrides\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-multus-certs\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovn-node-metrics-cert\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tq96\" (UniqueName: \"kubernetes.io/projected/e87d85b8-e3b3-40d1-9353-2177e6abadcd-kube-api-access-9tq96\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-socket-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.837416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-cni-multus\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-cni-multus\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-kube-api-access-fs4lv\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-etc-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-socket-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-sys\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-multus-daemon-config\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-cni-binary-copy\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-etc-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37c033d-4733-4410-a3bf-24a873b07bd4-tmp-dir\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762438 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-kubelet\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.838319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-systemd\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-cni-bin\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762510 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-kubelet\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762525 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-env-overrides\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50969230-2d01-40fb-858d-2cb6d2a8d640-host\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-systemd\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-cni-bin\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50969230-2d01-40fb-858d-2cb6d2a8d640-serviceca\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762612 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50969230-2d01-40fb-858d-2cb6d2a8d640-host\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-systemd-units\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0cf55c0c-1513-4e44-8038-c5a53bdafe52-iptables-alerter-script\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762677 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-lib-modules\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762688 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-systemd-units\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-system-cni-dir\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762721 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37c033d-4733-4410-a3bf-24a873b07bd4-tmp-dir\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.839644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-system-cni-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762830 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysconfig\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762919 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-system-cni-dir\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-run\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.762991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-node-log\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/50969230-2d01-40fb-858d-2cb6d2a8d640-serviceca\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-modprobe-d\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763062 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-node-log\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-systemd\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-log-socket\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovnkube-script-lib\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763137 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-log-socket\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.840528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-etc-selinux\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpl4t\" (UniqueName: \"kubernetes.io/projected/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-kube-api-access-hpl4t\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/440d15a8-0698-4f25-b465-6abe1bc7b33a-konnectivity-ca\") pod \"konnectivity-agent-bdq22\" (UID: \"440d15a8-0698-4f25-b465-6abe1bc7b33a\") " pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-kubelet\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-device-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-etc-selinux\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjlw\" (UniqueName: \"kubernetes.io/projected/d37c033d-4733-4410-a3bf-24a873b07bd4-kube-api-access-2xjlw\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-netns\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763428 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-netns\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-k8s-cni-cncf-io\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-etc-kubernetes\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.841824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-ovn\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87d85b8-e3b3-40d1-9353-2177e6abadcd-tmp\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-ovn\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-cnibin\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-cni-netd\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-var-lib-kubelet\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-host-run-k8s-cni-cncf-io\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovnkube-config\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-cni-netd\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-registration-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-etc-kubernetes\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/440d15a8-0698-4f25-b465-6abe1bc7b33a-agent-certs\") pod \"konnectivity-agent-bdq22\" (UID: \"440d15a8-0698-4f25-b465-6abe1bc7b33a\") " pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovnkube-script-lib\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cfp\" (UniqueName: \"kubernetes.io/projected/50969230-2d01-40fb-858d-2cb6d2a8d640-kube-api-access-n8cfp\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.844063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-registration-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-slash\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-run-netns\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dms9\" (UniqueName: \"kubernetes.io/projected/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-kube-api-access-4dms9\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763867 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/440d15a8-0698-4f25-b465-6abe1bc7b33a-konnectivity-ca\") pod \"konnectivity-agent-bdq22\" (UID: \"440d15a8-0698-4f25-b465-6abe1bc7b33a\") " pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a827359-4b90-490e-9d8a-7511934a486c-kubelet-config\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqx7\" (UniqueName: \"kubernetes.io/projected/0cf55c0c-1513-4e44-8038-c5a53bdafe52-kube-api-access-8gqx7\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763933 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-run-openvswitch\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-device-dir\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-host\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.763971 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-slash\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.764042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-run-netns\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.844535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.764048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.764041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovnkube-config\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.766042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-ovn-node-metrics-cert\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.766216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/440d15a8-0698-4f25-b465-6abe1bc7b33a-agent-certs\") pod \"konnectivity-agent-bdq22\" (UID: \"440d15a8-0698-4f25-b465-6abe1bc7b33a\") " pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.776629 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgttd\" (UniqueName: \"kubernetes.io/projected/3977e1c1-3336-4c31-8e6e-6a0285f6d415-kube-api-access-lgttd\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.776828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4lv\" (UniqueName: \"kubernetes.io/projected/3c7790a6-2103-4fb6-a41d-fa438a1d2eb3-kube-api-access-fs4lv\") pod \"multus-45ssf\" (UID: \"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3\") " pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.778799 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjlw\" (UniqueName: \"kubernetes.io/projected/d37c033d-4733-4410-a3bf-24a873b07bd4-kube-api-access-2xjlw\") pod \"node-resolver-5455h\" (UID: \"d37c033d-4733-4410-a3bf-24a873b07bd4\") " pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.778951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cfp\" (UniqueName: \"kubernetes.io/projected/50969230-2d01-40fb-858d-2cb6d2a8d640-kube-api-access-n8cfp\") pod \"node-ca-lvgnl\" (UID: \"50969230-2d01-40fb-858d-2cb6d2a8d640\") " pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.779071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpl4t\" (UniqueName: \"kubernetes.io/projected/39cfe553-9ea0-44fd-ac64-f662ff1ebae1-kube-api-access-hpl4t\") pod \"aws-ebs-csi-driver-node-25mqf\" (UID: \"39cfe553-9ea0-44fd-ac64-f662ff1ebae1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.779333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dms9\" (UniqueName: \"kubernetes.io/projected/32196ea4-2695-4c23-b9f7-5b0bf4db2d3e-kube-api-access-4dms9\") pod \"ovnkube-node-vh5jl\" (UID: \"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.803858 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" event={"ID":"fa994f2ba01c45573160a315348131e9","Type":"ContainerStarted","Data":"e662845f1b98943784d1ec85c196e693e39410b645d672a33d28c0404dcb3f7b"} Jul 23 18:30:20.845010 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.804987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" event={"ID":"aa48c7a932e4b7ba4f5a45bb3aac178f","Type":"ContainerStarted","Data":"b74afcdf2407f231f3f0a476e55f908d390dc73cc04296ece255101b62762637"} Jul 23 18:30:20.865291 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.865237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a827359-4b90-490e-9d8a-7511934a486c-dbus\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cf55c0c-1513-4e44-8038-c5a53bdafe52-host-slash\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-tuned\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cd8s\" (UniqueName: \"kubernetes.io/projected/96f4ebc2-1e82-4254-a81c-0062319b2880-kube-api-access-2cd8s\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tq96\" (UniqueName: \"kubernetes.io/projected/e87d85b8-e3b3-40d1-9353-2177e6abadcd-kube-api-access-9tq96\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-sys\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866527 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0cf55c0c-1513-4e44-8038-c5a53bdafe52-iptables-alerter-script\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-lib-modules\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-system-cni-dir\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a827359-4b90-490e-9d8a-7511934a486c-dbus\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysconfig\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-run\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866967 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysconfig\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.866975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-modprobe-d\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.867027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cf55c0c-1513-4e44-8038-c5a53bdafe52-host-slash\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.867071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-modprobe-d\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.867886 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.867998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-lib-modules\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.868040 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-system-cni-dir\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.868103 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0cf55c0c-1513-4e44-8038-c5a53bdafe52-iptables-alerter-script\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.868297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-sys\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.868964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.868344 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-run\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.870387 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.870358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-cni-binary-copy\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.871216 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-systemd\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871311 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-systemd\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871381 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.871474 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.871535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87d85b8-e3b3-40d1-9353-2177e6abadcd-tmp\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-cnibin\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.871645 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a827359-4b90-490e-9d8a-7511934a486c-kubelet-config\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.871645 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqx7\" (UniqueName: \"kubernetes.io/projected/0cf55c0c-1513-4e44-8038-c5a53bdafe52-kube-api-access-8gqx7\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.871645 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-host\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871645 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-kubernetes\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysctl-conf\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysctl-d\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-var-lib-kubelet\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.871871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-os-release\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.871871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871862 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-os-release\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.872125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-host\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.872125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.871968 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-kubernetes\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.872125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.872073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-var-lib-kubelet\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.872125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.872083 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysctl-conf\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.872125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.872116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96f4ebc2-1e82-4254-a81c-0062319b2880-cnibin\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.872362 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.872155 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:20.872362 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.872212 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-sysctl-d\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.872362 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.872233 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:21.372209551 +0000 UTC m=+3.138307352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:20.872767 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.872744 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a827359-4b90-490e-9d8a-7511934a486c-kubelet-config\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:20.872862 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.872684 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96f4ebc2-1e82-4254-a81c-0062319b2880-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.874766 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.874743 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:20.874917 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.874900 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:20.875036 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.875017 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:20.875155 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:20.875137 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:30:21.375107893 +0000 UTC m=+3.141205714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:20.875781 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.875755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87d85b8-e3b3-40d1-9353-2177e6abadcd-tmp\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.878277 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.878212 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tq96\" (UniqueName: \"kubernetes.io/projected/e87d85b8-e3b3-40d1-9353-2177e6abadcd-kube-api-access-9tq96\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.878540 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.878492 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87d85b8-e3b3-40d1-9353-2177e6abadcd-etc-tuned\") pod \"tuned-s7q4j\" (UID: \"e87d85b8-e3b3-40d1-9353-2177e6abadcd\") " pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:20.879362 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.879335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cd8s\" (UniqueName: \"kubernetes.io/projected/96f4ebc2-1e82-4254-a81c-0062319b2880-kube-api-access-2cd8s\") pod \"multus-additional-cni-plugins-hkzdr\" (UID: \"96f4ebc2-1e82-4254-a81c-0062319b2880\") " pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:20.880726 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.880685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqx7\" (UniqueName: \"kubernetes.io/projected/0cf55c0c-1513-4e44-8038-c5a53bdafe52-kube-api-access-8gqx7\") pod \"iptables-alerter-d7dvb\" (UID: \"0cf55c0c-1513-4e44-8038-c5a53bdafe52\") " pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.945046 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.945022 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" Jul 23 18:30:20.953483 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.953446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5455h" Jul 23 18:30:20.957275 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.957252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7dvb" Jul 23 18:30:20.957415 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.957366 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39cfe553_9ea0_44fd_ac64_f662ff1ebae1.slice/crio-a4834ebc919a8efa174da275c648ccbd889c000ee17126c01a33bcaf0c15189f WatchSource:0}: Error finding container a4834ebc919a8efa174da275c648ccbd889c000ee17126c01a33bcaf0c15189f: Status 404 returned error can't find the container with id a4834ebc919a8efa174da275c648ccbd889c000ee17126c01a33bcaf0c15189f Jul 23 18:30:20.961929 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.961908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:20.967566 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.967546 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lvgnl" Jul 23 18:30:20.970552 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.970451 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf55c0c_1513_4e44_8038_c5a53bdafe52.slice/crio-00667e1cacbf50ab4765f2d5e52c306e55d0c69b945933593aba799d496c2f4c WatchSource:0}: Error finding container 00667e1cacbf50ab4765f2d5e52c306e55d0c69b945933593aba799d496c2f4c: Status 404 returned error can't find the container with id 00667e1cacbf50ab4765f2d5e52c306e55d0c69b945933593aba799d496c2f4c Jul 23 18:30:20.971903 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.971876 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37c033d_4733_4410_a3bf_24a873b07bd4.slice/crio-b6358252535b93b6879d9c42b234a03a0193d73055d60b1cee74ffd80a5d5c2c WatchSource:0}: Error finding container b6358252535b93b6879d9c42b234a03a0193d73055d60b1cee74ffd80a5d5c2c: Status 404 returned error can't find the container with id b6358252535b93b6879d9c42b234a03a0193d73055d60b1cee74ffd80a5d5c2c Jul 23 18:30:20.972575 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.972544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-45ssf" Jul 23 18:30:20.979380 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:20.979358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:20.979622 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.979591 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50969230_2d01_40fb_858d_2cb6d2a8d640.slice/crio-4a36f614fb176624f24949c53ea16ece161bc5adb02a47f2a7a5090fe0213959 WatchSource:0}: Error finding container 4a36f614fb176624f24949c53ea16ece161bc5adb02a47f2a7a5090fe0213959: Status 404 returned error can't find the container with id 4a36f614fb176624f24949c53ea16ece161bc5adb02a47f2a7a5090fe0213959 Jul 23 18:30:20.981517 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.981491 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440d15a8_0698_4f25_b465_6abe1bc7b33a.slice/crio-4aed538cbfaeb4cfa23a990702491d933c9d0610e8a557805755493fdbab3c84 WatchSource:0}: Error finding container 4aed538cbfaeb4cfa23a990702491d933c9d0610e8a557805755493fdbab3c84: Status 404 returned error can't find the container with id 4aed538cbfaeb4cfa23a990702491d933c9d0610e8a557805755493fdbab3c84 Jul 23 18:30:20.988097 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.988062 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7790a6_2103_4fb6_a41d_fa438a1d2eb3.slice/crio-7f975086953678c2fbcb570d81acfaa4e9a4e5354b406e44e17342298b2891da WatchSource:0}: Error finding container 7f975086953678c2fbcb570d81acfaa4e9a4e5354b406e44e17342298b2891da: Status 404 returned error can't find the container with id 7f975086953678c2fbcb570d81acfaa4e9a4e5354b406e44e17342298b2891da Jul 23 18:30:20.991493 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:20.991399 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32196ea4_2695_4c23_b9f7_5b0bf4db2d3e.slice/crio-d0c7229370feea3a8e21e398fb49046e3a985ad6f2b1e07bed597f1fe246b16e WatchSource:0}: Error finding container d0c7229370feea3a8e21e398fb49046e3a985ad6f2b1e07bed597f1fe246b16e: Status 404 returned error can't find the container with id d0c7229370feea3a8e21e398fb49046e3a985ad6f2b1e07bed597f1fe246b16e Jul 23 18:30:21.013227 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.013206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" Jul 23 18:30:21.018120 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.018100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" Jul 23 18:30:21.029578 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:21.029554 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87d85b8_e3b3_40d1_9353_2177e6abadcd.slice/crio-e2cafa670603f975bb904b6a6b5dad89fb35808c50e8e8f9a1809f6b5c3443ce WatchSource:0}: Error finding container e2cafa670603f975bb904b6a6b5dad89fb35808c50e8e8f9a1809f6b5c3443ce: Status 404 returned error can't find the container with id e2cafa670603f975bb904b6a6b5dad89fb35808c50e8e8f9a1809f6b5c3443ce Jul 23 18:30:21.275337 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.275244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:21.275495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.275386 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:21.275495 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.275470 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:22.275449136 +0000 UTC m=+4.041546940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:21.375741 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.375686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:21.375934 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.375775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:21.375934 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.375844 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:21.375934 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.375877 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:21.375934 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.375889 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:21.376150 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.375930 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:21.376150 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.375946 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:30:22.375929836 +0000 UTC m=+4.142027637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:21.376150 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.375995 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:22.375976917 +0000 UTC m=+4.142074722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:21.696942 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.696831 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:25:21 +0000 UTC" deadline="2028-01-11 23:44:53.658341286 +0000 UTC" Jul 23 18:30:21.696942 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.696890 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12893h14m31.961455575s" Jul 23 18:30:21.800119 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.800090 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:21.800289 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:21.800232 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:21.807418 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.807384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerStarted","Data":"bb4831625c1f786dcf6e809d6ed5cf620021870dc97cf989e2d946e3ada7102b"} Jul 23 18:30:21.808635 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.808600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-45ssf" event={"ID":"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3","Type":"ContainerStarted","Data":"7f975086953678c2fbcb570d81acfaa4e9a4e5354b406e44e17342298b2891da"} Jul 23 18:30:21.809831 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.809795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdq22" event={"ID":"440d15a8-0698-4f25-b465-6abe1bc7b33a","Type":"ContainerStarted","Data":"4aed538cbfaeb4cfa23a990702491d933c9d0610e8a557805755493fdbab3c84"} Jul 23 18:30:21.811018 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.810993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7dvb" event={"ID":"0cf55c0c-1513-4e44-8038-c5a53bdafe52","Type":"ContainerStarted","Data":"00667e1cacbf50ab4765f2d5e52c306e55d0c69b945933593aba799d496c2f4c"} Jul 23 18:30:21.812172 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.812146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5455h" event={"ID":"d37c033d-4733-4410-a3bf-24a873b07bd4","Type":"ContainerStarted","Data":"b6358252535b93b6879d9c42b234a03a0193d73055d60b1cee74ffd80a5d5c2c"} Jul 23 18:30:21.813344 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.813321 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" event={"ID":"e87d85b8-e3b3-40d1-9353-2177e6abadcd","Type":"ContainerStarted","Data":"e2cafa670603f975bb904b6a6b5dad89fb35808c50e8e8f9a1809f6b5c3443ce"} Jul 23 18:30:21.814544 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.814513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"d0c7229370feea3a8e21e398fb49046e3a985ad6f2b1e07bed597f1fe246b16e"} Jul 23 18:30:21.815657 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.815635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lvgnl" event={"ID":"50969230-2d01-40fb-858d-2cb6d2a8d640","Type":"ContainerStarted","Data":"4a36f614fb176624f24949c53ea16ece161bc5adb02a47f2a7a5090fe0213959"} Jul 23 18:30:21.816839 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:21.816803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" event={"ID":"39cfe553-9ea0-44fd-ac64-f662ff1ebae1","Type":"ContainerStarted","Data":"a4834ebc919a8efa174da275c648ccbd889c000ee17126c01a33bcaf0c15189f"} Jul 23 18:30:22.284442 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.284403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:22.285261 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.284609 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:22.285261 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.284679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:24.284658928 +0000 UTC m=+6.050756733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:22.385144 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.385065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:22.385144 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.385129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:22.385366 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.385278 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:22.385366 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.385344 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:24.385323554 +0000 UTC m=+6.151421359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:22.385871 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.385762 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:22.385871 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.385786 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:22.385871 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.385800 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:22.385871 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.385861 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:30:24.385830968 +0000 UTC m=+6.151928789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:22.697304 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.697208 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:25:21 +0000 UTC" deadline="2027-12-17 23:43:44.657906341 +0000 UTC" Jul 23 18:30:22.697304 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.697258 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12293h13m21.96065402s" Jul 23 18:30:22.801053 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.801020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:22.801274 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.801179 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:22.801698 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:22.801677 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:22.801849 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:22.801822 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:23.800497 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:23.800458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:23.800956 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:23.800651 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:24.301775 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:24.301140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:24.301775 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.301338 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:24.301775 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.301408 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:28.301388285 +0000 UTC m=+10.067486090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:24.402306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:24.402414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.402580 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.402601 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.402616 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.402684 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:30:28.402663315 +0000 UTC m=+10.168761139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.403152 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:24.403245 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.403210 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:28.403192634 +0000 UTC m=+10.169290440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:24.802726 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:24.802011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:24.802726 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.802151 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:24.802726 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:24.802557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:24.802726 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:24.802651 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:25.801013 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:25.800872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:25.801214 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:25.801064 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:26.801967 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:26.801934 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:26.802328 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:26.802071 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:26.802487 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:26.802454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:26.802589 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:26.802569 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:27.800589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:27.800558 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:27.800880 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:27.800716 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:28.338668 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:28.338623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:28.339198 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.338813 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:28.339198 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.338882 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:36.338861533 +0000 UTC m=+18.104959352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:28.440085 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:28.440046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:28.440283 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:28.440106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:28.440283 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.440260 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:28.440412 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.440289 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:28.440412 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.440289 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:28.440412 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.440303 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:28.440412 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.440366 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:36.440344562 +0000 UTC m=+18.206442382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:28.440412 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.440393 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:30:36.440379637 +0000 UTC m=+18.206477442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:28.801892 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:28.801381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:28.801892 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.801511 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:28.801892 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:28.801861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:28.802211 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:28.801969 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:29.800686 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:29.800649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:29.801178 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:29.800815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:30.800686 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:30.800651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:30.800889 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:30.800812 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:30.800889 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:30.800858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:30.801342 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:30.800967 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:31.800869 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:31.800833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:31.801041 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:31.800968 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:32.800145 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:32.800117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:32.800145 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:32.800133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:32.800291 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:32.800262 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:32.800399 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:32.800376 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:33.800561 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:33.800310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:33.801063 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:33.800678 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:34.799962 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:34.799929 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:34.800147 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:34.800063 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:34.800147 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:34.800132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:34.800269 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:34.800244 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:35.800754 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:35.800721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:35.801256 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:35.800870 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:36.403640 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:36.403597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:36.403847 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.403740 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:36.403847 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.403822 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:52.403803568 +0000 UTC m=+34.169901380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:36.504787 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:36.504743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:36.504932 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:36.504803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:36.504932 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.504901 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:36.504932 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.504903 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:36.504932 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.504924 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:36.504932 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.504933 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:36.505177 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.504961 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:52.504944252 +0000 UTC m=+34.271042053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:36.505177 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.504981 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:30:52.504971175 +0000 UTC m=+34.271068982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:36.800557 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:36.800522 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:36.800710 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.800671 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:36.800710 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:36.800707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:36.800810 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:36.800785 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:37.800707 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:37.800667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:37.800882 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:37.800797 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:38.801376 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:38.801339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:38.801850 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:38.801421 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:38.801850 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:38.801438 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:38.801850 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:38.801523 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:39.800728 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:39.800697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:39.800916 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:39.800841 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:40.800481 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:40.800449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:40.800846 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:40.800594 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:40.800846 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:40.800629 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:40.800846 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:40.800717 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:41.801012 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.800853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:41.801438 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:41.801120 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:41.858781 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.858535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" event={"ID":"fa994f2ba01c45573160a315348131e9","Type":"ContainerStarted","Data":"ae2c18059227b177f79ade27cbab763ad5f59ddfd00cfe8b3eaa5e478e84cbe2"} Jul 23 18:30:41.860192 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.860164 2564 generic.go:356] "Generic (PLEG): container finished" podID="aa48c7a932e4b7ba4f5a45bb3aac178f" containerID="952ff80b2f5e792fd4df46d62c76ff72e36f8ba3c04f1cf11949a7add0f0b844" exitCode=0 Jul 23 18:30:41.860302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.860256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" event={"ID":"aa48c7a932e4b7ba4f5a45bb3aac178f","Type":"ContainerDied","Data":"952ff80b2f5e792fd4df46d62c76ff72e36f8ba3c04f1cf11949a7add0f0b844"} Jul 23 18:30:41.863122 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.862997 2564 generic.go:356] "Generic (PLEG): container finished" podID="96f4ebc2-1e82-4254-a81c-0062319b2880" containerID="83e4cb99ab05ac17b61de6b8eff14521a5baa83f313b54a73c8b8b2093cf1221" exitCode=0 Jul 23 18:30:41.863122 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.863083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerDied","Data":"83e4cb99ab05ac17b61de6b8eff14521a5baa83f313b54a73c8b8b2093cf1221"} Jul 23 18:30:41.865458 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.865428 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-45ssf" event={"ID":"3c7790a6-2103-4fb6-a41d-fa438a1d2eb3","Type":"ContainerStarted","Data":"f2eafea67b6854b220ffbb0c3da18941fc2b7dd0bfda10bf4ea4cdebeddce577"} Jul 23 18:30:41.867432 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.867258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bdq22" event={"ID":"440d15a8-0698-4f25-b465-6abe1bc7b33a","Type":"ContainerStarted","Data":"2e616ff694d1c53998d3749d9cf8f614c4f082ecaf8b73ed80c19e1acbffc7aa"} Jul 23 18:30:41.869398 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.869186 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5455h" event={"ID":"d37c033d-4733-4410-a3bf-24a873b07bd4","Type":"ContainerStarted","Data":"01a7ad2572ee6d48b01b693f1fdb340fffc1f52d9aa61d65d38df5f7794e812f"} Jul 23 18:30:41.871133 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.871112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" event={"ID":"e87d85b8-e3b3-40d1-9353-2177e6abadcd","Type":"ContainerStarted","Data":"8ac92fb5bccf5723ad266cab083b056ec973648a0922949da778df427f73ff0d"} Jul 23 18:30:41.874880 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.874855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"34e64391a9d8b5f1f5dfd73748219cf2b2a31ff402dc7c07397393ff8856658e"} Jul 23 18:30:41.874989 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.874939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"fe8f8d84151ddd0521c58eb42a5c5fe5ebf6807af104fe3841c059c85c2a8857"} Jul 23 18:30:41.875043 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.874993 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"50a80a1a2c3a89b74ab732a799a402030828cd08c5d4842a70d816f29dc6d94f"} Jul 23 18:30:41.875084 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.875046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"d128bb6e8dc4c1678f757e40878dd97c81421ec2b26915070c5f9ed47f2ce5bb"} Jul 23 18:30:41.875117 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.875095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"7dd9ca7b73577b8b4207e259bbf748b9867c9f339a9e7971ada770194d60303a"} Jul 23 18:30:41.875167 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.875144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"90653b4030a98ce6501769ea5b2c7aa1c677d8a757770afbcc1a30de7221a279"} Jul 23 18:30:41.876196 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.876177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lvgnl" event={"ID":"50969230-2d01-40fb-858d-2cb6d2a8d640","Type":"ContainerStarted","Data":"61b306aa240e179044395f9f8afdd1c147585c85019750c70d67c39956f32e9c"} Jul 23 18:30:41.877646 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.877623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" event={"ID":"39cfe553-9ea0-44fd-ac64-f662ff1ebae1","Type":"ContainerStarted","Data":"937674b30ee4537a73d4bf9e0bb768a4caa7909b7bfc9d43044229454c0575fb"} Jul 23 18:30:41.913229 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.913175 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-38.ec2.internal" podStartSLOduration=21.913157908 podStartE2EDuration="21.913157908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:41.880261525 +0000 UTC m=+23.646359348" watchObservedRunningTime="2026-07-23 18:30:41.913157908 +0000 UTC m=+23.679255730" Jul 23 18:30:41.969643 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:41.969598 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5455h" podStartSLOduration=2.896252791 podStartE2EDuration="22.969584774s" totalImagesPullingTime="20.073331983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:41.969485468 +0000 UTC m=+23.735583289" watchObservedRunningTime="2026-07-23 18:30:41.969584774 +0000 UTC m=+23.735682594" Jul 23 18:30:42.023984 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.023821 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-45ssf" podStartSLOduration=2.944406272 podStartE2EDuration="23.023804864s" totalImagesPullingTime="20.079398592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:41.99699131 +0000 UTC m=+23.763089131" watchObservedRunningTime="2026-07-23 18:30:42.023804864 +0000 UTC m=+23.789902687" Jul 23 18:30:42.050587 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.050540 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bdq22" podStartSLOduration=3.036599973 podStartE2EDuration="23.050526108s" totalImagesPullingTime="20.013926135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:42.023777062 +0000 UTC m=+23.789874875" watchObservedRunningTime="2026-07-23 18:30:42.050526108 +0000 UTC m=+23.816623929" Jul 23 18:30:42.050714 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.050640 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lvgnl" podStartSLOduration=11.249496813 podStartE2EDuration="23.050635787s" totalImagesPullingTime="11.801138974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:42.050501984 +0000 UTC m=+23.816599805" watchObservedRunningTime="2026-07-23 18:30:42.050635787 +0000 UTC m=+23.816733621" Jul 23 18:30:42.635275 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.635253 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 18:30:42.710602 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.710521 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:30:42.635270572Z","UUID":"607227e7-5bff-4327-ba91-dc076ba9b5f2","Handler":null,"Name":"","Endpoint":""} Jul 23 18:30:42.712045 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.712028 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 18:30:42.712166 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.712060 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 18:30:42.800454 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.800377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:42.800454 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.800415 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:42.800708 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:42.800508 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:42.800708 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:42.800641 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:42.881957 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.881916 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" event={"ID":"aa48c7a932e4b7ba4f5a45bb3aac178f","Type":"ContainerStarted","Data":"31eb51ade8761635052cdedaa02cadd6ba0b6b4637c30d1a43c01bdc3f723328"} Jul 23 18:30:42.883572 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.883544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7dvb" event={"ID":"0cf55c0c-1513-4e44-8038-c5a53bdafe52","Type":"ContainerStarted","Data":"cfecba6b0b75d32ea92f60dd66b23ea62a96df19968790eb490b75f5bc69c4bd"} Jul 23 18:30:42.885534 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.885496 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" event={"ID":"39cfe553-9ea0-44fd-ac64-f662ff1ebae1","Type":"ContainerStarted","Data":"17f215218aa2cdb49afe9820a79d4beb2ae02943fd98613c42d27aff928e8dbb"} Jul 23 18:30:42.899016 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.898969 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s7q4j" podStartSLOduration=3.880302489 podStartE2EDuration="23.898950275s" totalImagesPullingTime="20.018647786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:42.083884796 +0000 UTC m=+23.849982612" watchObservedRunningTime="2026-07-23 18:30:42.898950275 +0000 UTC m=+24.665048098" Jul 23 18:30:42.899143 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.899111 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-38.ec2.internal" podStartSLOduration=22.899102011 podStartE2EDuration="22.899102011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:42.898052192 +0000 UTC m=+24.664150015" watchObservedRunningTime="2026-07-23 18:30:42.899102011 +0000 UTC m=+24.665199836" Jul 23 18:30:42.916927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:42.916888 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d7dvb" podStartSLOduration=4.172286124 podStartE2EDuration="23.916870934s" totalImagesPullingTime="19.74458481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:42.91618248 +0000 UTC m=+24.682280302" watchObservedRunningTime="2026-07-23 18:30:42.916870934 +0000 UTC m=+24.682968757" Jul 23 18:30:43.371295 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:43.371257 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:43.371944 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:43.371923 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:43.800192 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:43.800169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:43.800304 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:43.800265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:43.889961 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:43.889924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" event={"ID":"39cfe553-9ea0-44fd-ac64-f662ff1ebae1","Type":"ContainerStarted","Data":"7f6f3f5f3048709ac86ab33b16cd3036e2a52e06ec71802e738854b8451b6597"} Jul 23 18:30:43.908963 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:43.908914 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25mqf" podStartSLOduration=2.653061835 podStartE2EDuration="24.908895671s" totalImagesPullingTime="22.255833836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:43.908822246 +0000 UTC m=+25.674920067" watchObservedRunningTime="2026-07-23 18:30:43.908895671 +0000 UTC m=+25.674993499" Jul 23 18:30:44.800662 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:44.800631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:44.800662 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:44.800651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:44.800925 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:44.800748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:44.800925 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:44.800868 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:44.895043 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:44.895019 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 23 18:30:44.895043 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:44.895033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"5f9d2a2a7da82953004df57c000ea363e5c87d3cc4099d971eea220ab6cc3569"} Jul 23 18:30:45.800554 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:45.800523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:45.800718 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:45.800661 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:46.800641 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:46.800523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:46.800641 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:46.800578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:46.801125 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:46.801098 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:46.801443 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:46.801408 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:47.800972 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.800806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:47.801629 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:47.801046 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:47.907289 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.907258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" event={"ID":"32196ea4-2695-4c23-b9f7-5b0bf4db2d3e","Type":"ContainerStarted","Data":"2f2dc04a35ec6c11e790f7ce67283e45b721521b0dd76c07f78d9ea6f39e18b2"} Jul 23 18:30:47.907524 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.907492 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:47.907651 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.907578 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:47.909316 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.909292 2564 generic.go:356] "Generic (PLEG): container finished" podID="96f4ebc2-1e82-4254-a81c-0062319b2880" containerID="40ab335c2efcee9790b43f99b188e1c994fd2071f52e95b45f13ae69b4608eb8" exitCode=0 Jul 23 18:30:47.909440 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.909330 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerDied","Data":"40ab335c2efcee9790b43f99b188e1c994fd2071f52e95b45f13ae69b4608eb8"} Jul 23 18:30:47.923854 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.923829 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:47.934324 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:47.934283 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" podStartSLOduration=8.800487137 podStartE2EDuration="28.934270668s" totalImagesPullingTime="20.133783531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:47.932968147 +0000 UTC m=+29.699065967" watchObservedRunningTime="2026-07-23 18:30:47.934270668 +0000 UTC m=+29.700368488" Jul 23 18:30:48.801128 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:48.801101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:48.801518 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:48.801190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:48.801518 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:48.801215 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:48.801518 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:48.801305 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:48.911570 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:48.911541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:48.933014 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:48.932986 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:30:49.392292 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.392262 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5s9nw"] Jul 23 18:30:49.392466 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.392372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:49.392524 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:49.392476 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:49.392999 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.392979 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpcrz"] Jul 23 18:30:49.393063 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.393047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:49.393133 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:49.393117 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:49.394926 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.394905 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9wgrt"] Jul 23 18:30:49.395025 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.394999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:49.395101 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:49.395081 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:49.915495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.915462 2564 generic.go:356] "Generic (PLEG): container finished" podID="96f4ebc2-1e82-4254-a81c-0062319b2880" containerID="d7aab8f0eef087dfba6f8f208e433da02234f8a056f176e5f9bc7dacee5a0023" exitCode=0 Jul 23 18:30:49.915937 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:49.915552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerDied","Data":"d7aab8f0eef087dfba6f8f208e433da02234f8a056f176e5f9bc7dacee5a0023"} Jul 23 18:30:50.089928 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:50.089889 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:50.090096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:50.090005 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 23 18:30:50.090431 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:50.090402 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bdq22" Jul 23 18:30:50.800858 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:50.800824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:50.800858 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:50.800842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:50.801057 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:50.800941 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:50.801116 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:50.801077 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:51.800829 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:51.800646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:51.801190 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:51.800896 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:51.922551 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:51.922517 2564 generic.go:356] "Generic (PLEG): container finished" podID="96f4ebc2-1e82-4254-a81c-0062319b2880" containerID="3296724e7b88133ac0910e649861b125affb45b5fb58709b73dae3f39fbbbc7b" exitCode=0 Jul 23 18:30:51.922702 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:51.922559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerDied","Data":"3296724e7b88133ac0910e649861b125affb45b5fb58709b73dae3f39fbbbc7b"} Jul 23 18:30:52.428744 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:52.428660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:52.428903 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.428795 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:52.428903 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.428860 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs podName:3977e1c1-3336-4c31-8e6e-6a0285f6d415 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:24.428842306 +0000 UTC m=+66.194940122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs") pod "network-metrics-daemon-9wgrt" (UID: "3977e1c1-3336-4c31-8e6e-6a0285f6d415") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:30:52.529966 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:52.529931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:52.530149 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:52.529999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:52.530149 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.530100 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:30:52.530149 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.530137 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:30:52.530149 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.530151 2564 projected.go:196] Error preparing data for projected volume kube-api-access-pwq97 for pod openshift-network-diagnostics/network-check-target-5s9nw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:52.530352 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.530108 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:52.530352 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.530205 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97 podName:1a59daef-a069-4628-85e3-d7516a77834a nodeName:}" failed. No retries permitted until 2026-07-23 18:31:24.530187961 +0000 UTC m=+66.296285777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwq97" (UniqueName: "kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97") pod "network-check-target-5s9nw" (UID: "1a59daef-a069-4628-85e3-d7516a77834a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:30:52.530352 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.530224 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret podName:5a827359-4b90-490e-9d8a-7511934a486c nodeName:}" failed. No retries permitted until 2026-07-23 18:31:24.530214751 +0000 UTC m=+66.296312553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret") pod "global-pull-secret-syncer-lpcrz" (UID: "5a827359-4b90-490e-9d8a-7511934a486c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:30:52.800589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:52.800563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:52.800789 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.800677 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lpcrz" podUID="5a827359-4b90-490e-9d8a-7511934a486c" Jul 23 18:30:52.800789 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:52.800753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:52.801199 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:52.800882 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9wgrt" podUID="3977e1c1-3336-4c31-8e6e-6a0285f6d415" Jul 23 18:30:53.800802 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:53.800769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:53.800977 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:53.800894 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5s9nw" podUID="1a59daef-a069-4628-85e3-d7516a77834a" Jul 23 18:30:54.014409 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.014376 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-38.ec2.internal" event="NodeReady" Jul 23 18:30:54.014573 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.014542 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 18:30:54.053191 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.053146 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77bb6cb977-mqvvv"] Jul 23 18:30:54.055664 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.055637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.058878 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.058850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 18:30:54.059139 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.059118 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 18:30:54.059289 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.059269 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 18:30:54.059405 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.059343 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6lc8t\"" Jul 23 18:30:54.063605 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.063584 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lxvdl"] Jul 23 18:30:54.064611 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.064590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 18:30:54.065811 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.065791 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.066125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.065955 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6hdcj"] Jul 23 18:30:54.067665 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.067645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 18:30:54.067775 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.067744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55lsf\"" Jul 23 18:30:54.067984 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.067968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.068285 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.068266 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 18:30:54.069983 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.069946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ndjj8\"" Jul 23 18:30:54.070076 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.070059 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 18:30:54.070272 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.070257 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 18:30:54.070590 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.070572 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 18:30:54.074018 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.073998 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bb6cb977-mqvvv"] Jul 23 18:30:54.081708 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.081678 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxvdl"] Jul 23 18:30:54.092407 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.092387 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6hdcj"] Jul 23 18:30:54.140444 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxr6f\" (UniqueName: \"kubernetes.io/projected/c607df59-9c4a-40be-9d9e-3f17b7b88121-kube-api-access-zxr6f\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.140568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.140568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607df59-9c4a-40be-9d9e-3f17b7b88121-tmp-dir\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.140568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc51ff15-ec8a-4469-ba0f-653065be6f5c-ca-trust-extracted\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.140568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-trusted-ca\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.140568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5w8\" (UniqueName: \"kubernetes.io/projected/32d2153a-203e-4e9d-8e25-673697985337-kube-api-access-xj5w8\") pod \"ingress-canary-6hdcj\" (UID: \"32d2153a-203e-4e9d-8e25-673697985337\") " pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.140837 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-certificates\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.140837 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-bound-sa-token\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.140837 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.140837 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-image-registry-private-configuration\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.140837 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-installation-pull-secrets\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.141039 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65t9q\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-kube-api-access-65t9q\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.141039 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c607df59-9c4a-40be-9d9e-3f17b7b88121-config-volume\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.141039 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.140914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32d2153a-203e-4e9d-8e25-673697985337-cert\") pod \"ingress-canary-6hdcj\" (UID: \"32d2153a-203e-4e9d-8e25-673697985337\") " pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.241554 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxr6f\" (UniqueName: \"kubernetes.io/projected/c607df59-9c4a-40be-9d9e-3f17b7b88121-kube-api-access-zxr6f\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.241554 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.241785 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607df59-9c4a-40be-9d9e-3f17b7b88121-tmp-dir\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.241785 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.241688 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:30:54.241785 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.241713 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb6cb977-mqvvv: secret "image-registry-tls" not found Jul 23 18:30:54.241785 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc51ff15-ec8a-4469-ba0f-653065be6f5c-ca-trust-extracted\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242000 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.241793 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls podName:dc51ff15-ec8a-4469-ba0f-653065be6f5c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:54.741750444 +0000 UTC m=+36.507848244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls") pod "image-registry-77bb6cb977-mqvvv" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c") : secret "image-registry-tls" not found Jul 23 18:30:54.242000 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-trusted-ca\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242000 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5w8\" (UniqueName: \"kubernetes.io/projected/32d2153a-203e-4e9d-8e25-673697985337-kube-api-access-xj5w8\") pod \"ingress-canary-6hdcj\" (UID: \"32d2153a-203e-4e9d-8e25-673697985337\") " pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.242000 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-certificates\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242000 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-bound-sa-token\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242000 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.241939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c607df59-9c4a-40be-9d9e-3f17b7b88121-tmp-dir\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc51ff15-ec8a-4469-ba0f-653065be6f5c-ca-trust-extracted\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-image-registry-private-configuration\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-installation-pull-secrets\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.242224 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65t9q\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-kube-api-access-65t9q\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c607df59-9c4a-40be-9d9e-3f17b7b88121-config-volume\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.242300 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.242291 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls podName:c607df59-9c4a-40be-9d9e-3f17b7b88121 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:54.742270547 +0000 UTC m=+36.508368356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls") pod "dns-default-lxvdl" (UID: "c607df59-9c4a-40be-9d9e-3f17b7b88121") : secret "dns-default-metrics-tls" not found Jul 23 18:30:54.242675 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32d2153a-203e-4e9d-8e25-673697985337-cert\") pod \"ingress-canary-6hdcj\" (UID: \"32d2153a-203e-4e9d-8e25-673697985337\") " pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.242675 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-certificates\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.242797 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c607df59-9c4a-40be-9d9e-3f17b7b88121-config-volume\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.242997 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.242979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-trusted-ca\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.246688 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.246649 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-image-registry-private-configuration\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.246688 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.246664 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-installation-pull-secrets\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.246879 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.246788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32d2153a-203e-4e9d-8e25-673697985337-cert\") pod \"ingress-canary-6hdcj\" (UID: \"32d2153a-203e-4e9d-8e25-673697985337\") " pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.256634 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.256574 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5w8\" (UniqueName: \"kubernetes.io/projected/32d2153a-203e-4e9d-8e25-673697985337-kube-api-access-xj5w8\") pod \"ingress-canary-6hdcj\" (UID: \"32d2153a-203e-4e9d-8e25-673697985337\") " pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.256634 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.256583 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65t9q\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-kube-api-access-65t9q\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.256634 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.256624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-bound-sa-token\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.256837 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.256673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxr6f\" (UniqueName: \"kubernetes.io/projected/c607df59-9c4a-40be-9d9e-3f17b7b88121-kube-api-access-zxr6f\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.382928 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.382853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hdcj" Jul 23 18:30:54.531784 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.531741 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6hdcj"] Jul 23 18:30:54.535684 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:54.535658 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d2153a_203e_4e9d_8e25_673697985337.slice/crio-49922bfcfa3ccea3b519dd4db3e5e128a0eb5cdb4786c11a8ea845f2007a9c02 WatchSource:0}: Error finding container 49922bfcfa3ccea3b519dd4db3e5e128a0eb5cdb4786c11a8ea845f2007a9c02: Status 404 returned error can't find the container with id 49922bfcfa3ccea3b519dd4db3e5e128a0eb5cdb4786c11a8ea845f2007a9c02 Jul 23 18:30:54.746347 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.746308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:54.746532 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.746389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:54.746532 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.746473 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:30:54.746532 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.746496 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb6cb977-mqvvv: secret "image-registry-tls" not found Jul 23 18:30:54.746696 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.746562 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls podName:dc51ff15-ec8a-4469-ba0f-653065be6f5c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:55.746540074 +0000 UTC m=+37.512637896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls") pod "image-registry-77bb6cb977-mqvvv" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c") : secret "image-registry-tls" not found Jul 23 18:30:54.746696 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.746477 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:30:54.746696 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:54.746648 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls podName:c607df59-9c4a-40be-9d9e-3f17b7b88121 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:55.746624683 +0000 UTC m=+37.512722506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls") pod "dns-default-lxvdl" (UID: "c607df59-9c4a-40be-9d9e-3f17b7b88121") : secret "dns-default-metrics-tls" not found Jul 23 18:30:54.800849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.800818 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:30:54.801009 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.800818 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:30:54.804078 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.803615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:30:54.804078 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.803902 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8szp\"" Jul 23 18:30:54.804078 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.803293 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:30:54.930396 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:54.930359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6hdcj" event={"ID":"32d2153a-203e-4e9d-8e25-673697985337","Type":"ContainerStarted","Data":"49922bfcfa3ccea3b519dd4db3e5e128a0eb5cdb4786c11a8ea845f2007a9c02"} Jul 23 18:30:55.754172 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:55.754136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:55.754359 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:55.754209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:55.754359 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:55.754299 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:30:55.754359 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:55.754302 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:30:55.754359 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:55.754326 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb6cb977-mqvvv: secret "image-registry-tls" not found Jul 23 18:30:55.754568 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:55.754364 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls podName:c607df59-9c4a-40be-9d9e-3f17b7b88121 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:57.754345649 +0000 UTC m=+39.520443474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls") pod "dns-default-lxvdl" (UID: "c607df59-9c4a-40be-9d9e-3f17b7b88121") : secret "dns-default-metrics-tls" not found Jul 23 18:30:55.754568 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:55.754383 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls podName:dc51ff15-ec8a-4469-ba0f-653065be6f5c nodeName:}" failed. No retries permitted until 2026-07-23 18:30:57.754374108 +0000 UTC m=+39.520471914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls") pod "image-registry-77bb6cb977-mqvvv" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c") : secret "image-registry-tls" not found Jul 23 18:30:55.800275 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:55.800247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:30:55.802785 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:55.802714 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:30:55.802785 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:55.802749 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:30:55.803189 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:55.802799 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ltcv\"" Jul 23 18:30:56.938126 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:56.938091 2564 generic.go:356] "Generic (PLEG): container finished" podID="96f4ebc2-1e82-4254-a81c-0062319b2880" containerID="0bb057db0ca34e6dd0e32fa6c3cf0ed1896964e6bfc07d6371f226d439a5e350" exitCode=0 Jul 23 18:30:56.938472 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:56.938158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerDied","Data":"0bb057db0ca34e6dd0e32fa6c3cf0ed1896964e6bfc07d6371f226d439a5e350"} Jul 23 18:30:57.172685 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.172460 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p"] Jul 23 18:30:57.174370 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.174347 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-c2bhz"] Jul 23 18:30:57.174518 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.174487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.176166 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.176146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.181302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.180470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 23 18:30:57.181302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.180863 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 18:30:57.181302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.180988 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 18:30:57.181302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.181063 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8"] Jul 23 18:30:57.181302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.181159 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 18:30:57.181302 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.181224 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 18:30:57.182290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.182269 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pc4fr\"" Jul 23 18:30:57.182663 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.182635 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 23 18:30:57.182776 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.182720 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 23 18:30:57.183329 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.183158 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b745b\"" Jul 23 18:30:57.183639 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.183620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.184291 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.184275 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 23 18:30:57.201988 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.201967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-997ps\"" Jul 23 18:30:57.202670 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.202650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 18:30:57.202926 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.202908 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:30:57.203026 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.202948 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 18:30:57.204187 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.204169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-c2bhz"] Jul 23 18:30:57.205492 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.205471 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p"] Jul 23 18:30:57.210648 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.210630 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 23 18:30:57.216261 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.216240 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8"] Jul 23 18:30:57.265647 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-service-ca-bundle\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.265787 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2btxs\" (UniqueName: \"kubernetes.io/projected/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-kube-api-access-2btxs\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.265787 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-tmp\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.265787 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.265934 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.265934 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.265934 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lz2\" (UniqueName: \"kubernetes.io/projected/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-kube-api-access-58lz2\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.266142 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t2n6\" (UniqueName: \"kubernetes.io/projected/913516da-9fcd-4c4f-a945-6c62e1371af4-kube-api-access-9t2n6\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.266142 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.266142 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-serving-cert\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.266142 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.265987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-snapshots\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367089 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-service-ca-bundle\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367089 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2btxs\" (UniqueName: \"kubernetes.io/projected/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-kube-api-access-2btxs\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367303 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-tmp\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367303 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367303 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.367456 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.367456 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58lz2\" (UniqueName: \"kubernetes.io/projected/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-kube-api-access-58lz2\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.367456 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t2n6\" (UniqueName: \"kubernetes.io/projected/913516da-9fcd-4c4f-a945-6c62e1371af4-kube-api-access-9t2n6\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.367608 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.367608 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-serving-cert\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367608 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-snapshots\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367746 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367605 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-tmp\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367746 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.367668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-service-ca-bundle\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.367961 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.367943 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:30:57.368027 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.368010 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls podName:3bb37e5a-9abd-404b-b75a-dabdd26c88ce nodeName:}" failed. No retries permitted until 2026-07-23 18:30:57.867990332 +0000 UTC m=+39.634088132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l2s9p" (UID: "3bb37e5a-9abd-404b-b75a-dabdd26c88ce") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:30:57.368085 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.368052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-snapshots\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.368161 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.368140 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.368225 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.368218 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:30:57.368276 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.368253 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls podName:913516da-9fcd-4c4f-a945-6c62e1371af4 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:57.868242136 +0000 UTC m=+39.634339935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xc2s8" (UID: "913516da-9fcd-4c4f-a945-6c62e1371af4") : secret "samples-operator-tls" not found Jul 23 18:30:57.368358 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.368340 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.371863 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.371838 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-serving-cert\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.374945 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.374920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2btxs\" (UniqueName: \"kubernetes.io/projected/5247730c-21b7-4b27-b6cf-8aec08b6bb0f-kube-api-access-2btxs\") pod \"insights-operator-555d9d7885-c2bhz\" (UID: \"5247730c-21b7-4b27-b6cf-8aec08b6bb0f\") " pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.376253 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.376235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lz2\" (UniqueName: \"kubernetes.io/projected/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-kube-api-access-58lz2\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.377737 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.377715 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t2n6\" (UniqueName: \"kubernetes.io/projected/913516da-9fcd-4c4f-a945-6c62e1371af4-kube-api-access-9t2n6\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.402895 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.402857 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:57.488352 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.488321 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:57.495184 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.495166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" Jul 23 18:30:57.622204 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.622175 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-c2bhz"] Jul 23 18:30:57.625719 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:57.625688 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5247730c_21b7_4b27_b6cf_8aec08b6bb0f.slice/crio-619773c385308fe1e05dacd551338e3eafd52759ee75e1e9fcc9cfb43b15067a WatchSource:0}: Error finding container 619773c385308fe1e05dacd551338e3eafd52759ee75e1e9fcc9cfb43b15067a: Status 404 returned error can't find the container with id 619773c385308fe1e05dacd551338e3eafd52759ee75e1e9fcc9cfb43b15067a Jul 23 18:30:57.770054 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.769979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:30:57.770054 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.770045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:30:57.770269 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.770157 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:30:57.770269 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.770174 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:30:57.770269 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.770185 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb6cb977-mqvvv: secret "image-registry-tls" not found Jul 23 18:30:57.770269 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.770233 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls podName:c607df59-9c4a-40be-9d9e-3f17b7b88121 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:01.770211959 +0000 UTC m=+43.536309762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls") pod "dns-default-lxvdl" (UID: "c607df59-9c4a-40be-9d9e-3f17b7b88121") : secret "dns-default-metrics-tls" not found Jul 23 18:30:57.770269 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.770254 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls podName:dc51ff15-ec8a-4469-ba0f-653065be6f5c nodeName:}" failed. No retries permitted until 2026-07-23 18:31:01.770244349 +0000 UTC m=+43.536342152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls") pod "image-registry-77bb6cb977-mqvvv" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c") : secret "image-registry-tls" not found Jul 23 18:30:57.870535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.870501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:57.870715 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.870561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:57.870715 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.870654 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:30:57.870829 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.870719 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:30:57.870829 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.870735 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls podName:3bb37e5a-9abd-404b-b75a-dabdd26c88ce nodeName:}" failed. No retries permitted until 2026-07-23 18:30:58.870714931 +0000 UTC m=+40.636812733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l2s9p" (UID: "3bb37e5a-9abd-404b-b75a-dabdd26c88ce") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:30:57.870829 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:57.870795 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls podName:913516da-9fcd-4c4f-a945-6c62e1371af4 nodeName:}" failed. No retries permitted until 2026-07-23 18:30:58.870776761 +0000 UTC m=+40.636874577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xc2s8" (UID: "913516da-9fcd-4c4f-a945-6c62e1371af4") : secret "samples-operator-tls" not found Jul 23 18:30:57.941462 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.941430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" event={"ID":"5247730c-21b7-4b27-b6cf-8aec08b6bb0f","Type":"ContainerStarted","Data":"619773c385308fe1e05dacd551338e3eafd52759ee75e1e9fcc9cfb43b15067a"} Jul 23 18:30:57.944906 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.944876 2564 generic.go:356] "Generic (PLEG): container finished" podID="96f4ebc2-1e82-4254-a81c-0062319b2880" containerID="9a79d3b32b4f24a14839c97f7feb8c15bde6d8a46817245650c880b325fdc894" exitCode=0 Jul 23 18:30:57.945025 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:57.944921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerDied","Data":"9a79d3b32b4f24a14839c97f7feb8c15bde6d8a46817245650c880b325fdc894"} Jul 23 18:30:58.073568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.073498 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf"] Jul 23 18:30:58.075814 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.075793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.078071 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.078045 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bv5xl\"" Jul 23 18:30:58.078210 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.078188 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:30:58.078335 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.078303 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 23 18:30:58.078447 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.078306 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 23 18:30:58.078447 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.078356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 23 18:30:58.087221 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.087196 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf"] Jul 23 18:30:58.173121 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.173091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67a0a55e-9638-4aab-9284-945a0e481fa4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.173282 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.173150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67a0a55e-9638-4aab-9284-945a0e481fa4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.173282 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.173209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk8d8\" (UniqueName: \"kubernetes.io/projected/67a0a55e-9638-4aab-9284-945a0e481fa4-kube-api-access-sk8d8\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.273577 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.273544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67a0a55e-9638-4aab-9284-945a0e481fa4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.273728 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.273597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67a0a55e-9638-4aab-9284-945a0e481fa4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.273728 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.273674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk8d8\" (UniqueName: \"kubernetes.io/projected/67a0a55e-9638-4aab-9284-945a0e481fa4-kube-api-access-sk8d8\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.274442 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.274416 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67a0a55e-9638-4aab-9284-945a0e481fa4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.277078 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.276912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67a0a55e-9638-4aab-9284-945a0e481fa4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.281832 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.281807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk8d8\" (UniqueName: \"kubernetes.io/projected/67a0a55e-9638-4aab-9284-945a0e481fa4-kube-api-access-sk8d8\") pod \"kube-storage-version-migrator-operator-7658d9b749-wdpjf\" (UID: \"67a0a55e-9638-4aab-9284-945a0e481fa4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.385987 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.385912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" Jul 23 18:30:58.647148 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.646955 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf"] Jul 23 18:30:58.651048 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:30:58.651021 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a0a55e_9638_4aab_9284_945a0e481fa4.slice/crio-1814af8aea71c41660faa4834d22fb781722bc4e654c54ebe878aa9fbc4d160a WatchSource:0}: Error finding container 1814af8aea71c41660faa4834d22fb781722bc4e654c54ebe878aa9fbc4d160a: Status 404 returned error can't find the container with id 1814af8aea71c41660faa4834d22fb781722bc4e654c54ebe878aa9fbc4d160a Jul 23 18:30:58.750268 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.750223 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:58.812389 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.812359 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:58.879099 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.879056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:30:58.879099 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.879113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:30:58.879312 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:58.879249 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:30:58.879312 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:58.879277 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:30:58.879395 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:58.879314 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls podName:3bb37e5a-9abd-404b-b75a-dabdd26c88ce nodeName:}" failed. No retries permitted until 2026-07-23 18:31:00.879297032 +0000 UTC m=+42.645394831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l2s9p" (UID: "3bb37e5a-9abd-404b-b75a-dabdd26c88ce") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:30:58.879395 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:30:58.879330 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls podName:913516da-9fcd-4c4f-a945-6c62e1371af4 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:00.879322936 +0000 UTC m=+42.645420735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xc2s8" (UID: "913516da-9fcd-4c4f-a945-6c62e1371af4") : secret "samples-operator-tls" not found Jul 23 18:30:58.951054 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.950944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" event={"ID":"96f4ebc2-1e82-4254-a81c-0062319b2880","Type":"ContainerStarted","Data":"0d2a693551320753c5780286fb58badf6f909c366b710a66e6c0714a53407235"} Jul 23 18:30:58.952950 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.952913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6hdcj" event={"ID":"32d2153a-203e-4e9d-8e25-673697985337","Type":"ContainerStarted","Data":"21fab114ad4183f13cd165e1dc7308644351c5fb6b17753cad6310a30e4aee0a"} Jul 23 18:30:58.954473 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.954244 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:58.954473 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.954403 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" event={"ID":"67a0a55e-9638-4aab-9284-945a0e481fa4","Type":"ContainerStarted","Data":"1814af8aea71c41660faa4834d22fb781722bc4e654c54ebe878aa9fbc4d160a"} Jul 23 18:30:58.976616 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.976565 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hkzdr" podStartSLOduration=8.553340808 podStartE2EDuration="39.976548107s" totalImagesPullingTime="31.423207299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:58.974877083 +0000 UTC m=+40.740974905" watchObservedRunningTime="2026-07-23 18:30:58.976548107 +0000 UTC m=+40.742645930" Jul 23 18:30:58.991531 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:58.991416 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6hdcj" podStartSLOduration=0.935538008 podStartE2EDuration="4.991397409s" totalImagesPullingTime="4.055859401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:58.990843455 +0000 UTC m=+40.756941285" watchObservedRunningTime="2026-07-23 18:30:58.991397409 +0000 UTC m=+40.757495233" Jul 23 18:30:59.052553 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:59.052521 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:59.153823 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:59.153790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:59.217141 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:59.217111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:30:59.919275 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:30:59.919226 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:00.019316 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.019278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:00.896442 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.896408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:31:00.896442 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.896454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:31:00.896690 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:00.896563 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:31:00.896690 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:00.896578 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:31:00.896690 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:00.896633 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls podName:3bb37e5a-9abd-404b-b75a-dabdd26c88ce nodeName:}" failed. No retries permitted until 2026-07-23 18:31:04.896615883 +0000 UTC m=+46.662713692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l2s9p" (UID: "3bb37e5a-9abd-404b-b75a-dabdd26c88ce") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:31:00.896690 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:00.896649 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls podName:913516da-9fcd-4c4f-a945-6c62e1371af4 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:04.896642366 +0000 UTC m=+46.662740165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xc2s8" (UID: "913516da-9fcd-4c4f-a945-6c62e1371af4") : secret "samples-operator-tls" not found Jul 23 18:31:00.965080 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.965048 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh"] Jul 23 18:31:00.966214 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.966190 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:00.987070 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.987041 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh"] Jul 23 18:31:00.987220 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.987185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" Jul 23 18:31:00.989502 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:00.989479 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h448q\"" Jul 23 18:31:01.067868 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.067836 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb"] Jul 23 18:31:01.092032 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.092004 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb"] Jul 23 18:31:01.092152 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.092106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.094544 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.094392 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 23 18:31:01.094544 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.094425 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 23 18:31:01.094544 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.094468 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:31:01.095441 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.095414 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xlz2q\"" Jul 23 18:31:01.095609 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.095594 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 23 18:31:01.099094 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.098692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv54t\" (UniqueName: \"kubernetes.io/projected/60c6d0c3-661d-4b71-bed2-760161aafeaf-kube-api-access-zv54t\") pod \"network-check-source-7bc5b6bf85-2r9qh\" (UID: \"60c6d0c3-661d-4b71-bed2-760161aafeaf\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" Jul 23 18:31:01.199638 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.199617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.199735 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.199678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-config\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.199790 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.199750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv54t\" (UniqueName: \"kubernetes.io/projected/60c6d0c3-661d-4b71-bed2-760161aafeaf-kube-api-access-zv54t\") pod \"network-check-source-7bc5b6bf85-2r9qh\" (UID: \"60c6d0c3-661d-4b71-bed2-760161aafeaf\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" Jul 23 18:31:01.199853 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.199837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wggrr\" (UniqueName: \"kubernetes.io/projected/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-kube-api-access-wggrr\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.208518 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.208494 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv54t\" (UniqueName: \"kubernetes.io/projected/60c6d0c3-661d-4b71-bed2-760161aafeaf-kube-api-access-zv54t\") pod \"network-check-source-7bc5b6bf85-2r9qh\" (UID: \"60c6d0c3-661d-4b71-bed2-760161aafeaf\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" Jul 23 18:31:01.299032 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.298999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" Jul 23 18:31:01.300261 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.300238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-config\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.300357 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.300318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggrr\" (UniqueName: \"kubernetes.io/projected/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-kube-api-access-wggrr\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.300427 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.300391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.300841 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.300821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-config\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.302377 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.302358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-serving-cert\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.308885 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.308860 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wggrr\" (UniqueName: \"kubernetes.io/projected/92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169-kube-api-access-wggrr\") pod \"service-ca-operator-5bcbc94c78-rgsxb\" (UID: \"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.402608 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.402579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" Jul 23 18:31:01.577882 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.577847 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh"] Jul 23 18:31:01.580960 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:01.580933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c6d0c3_661d_4b71_bed2_760161aafeaf.slice/crio-67da86c701518755deb92f85800d869293114d0aece0793bea651869e7391947 WatchSource:0}: Error finding container 67da86c701518755deb92f85800d869293114d0aece0793bea651869e7391947: Status 404 returned error can't find the container with id 67da86c701518755deb92f85800d869293114d0aece0793bea651869e7391947 Jul 23 18:31:01.595586 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.595518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb"] Jul 23 18:31:01.599782 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:01.599745 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e4dd1d_fe7c_4f1c_b2a2_076db1ed2169.slice/crio-41d69501aa5a426d794d23cf8a867fed4cc39a45ef81c7d583db91e79b0afe54 WatchSource:0}: Error finding container 41d69501aa5a426d794d23cf8a867fed4cc39a45ef81c7d583db91e79b0afe54: Status 404 returned error can't find the container with id 41d69501aa5a426d794d23cf8a867fed4cc39a45ef81c7d583db91e79b0afe54 Jul 23 18:31:01.804414 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.804377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:01.804576 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.804433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:01.804576 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:01.804539 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:01.804648 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:01.804604 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls podName:c607df59-9c4a-40be-9d9e-3f17b7b88121 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.804589215 +0000 UTC m=+51.570687018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls") pod "dns-default-lxvdl" (UID: "c607df59-9c4a-40be-9d9e-3f17b7b88121") : secret "dns-default-metrics-tls" not found Jul 23 18:31:01.804648 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:01.804543 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:31:01.804648 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:01.804637 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb6cb977-mqvvv: secret "image-registry-tls" not found Jul 23 18:31:01.804753 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:01.804680 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls podName:dc51ff15-ec8a-4469-ba0f-653065be6f5c nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.804669682 +0000 UTC m=+51.570767481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls") pod "image-registry-77bb6cb977-mqvvv" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c") : secret "image-registry-tls" not found Jul 23 18:31:01.836454 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.836414 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5gp4w"] Jul 23 18:31:01.870641 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.870599 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5gp4w"] Jul 23 18:31:01.870815 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.870752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:01.873152 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.873130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7rvg\"" Jul 23 18:31:01.873340 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.873327 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 18:31:01.873527 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.873506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 18:31:01.891581 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.891555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:01.904824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.904796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:01.904959 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.904902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vckc\" (UniqueName: \"kubernetes.io/projected/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-api-access-8vckc\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:01.904959 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.904943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-data-volume\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:01.905056 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.905016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:01.905109 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.905069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-crio-socket\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:01.961923 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.961878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:01.963382 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.963348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" event={"ID":"60c6d0c3-661d-4b71-bed2-760161aafeaf","Type":"ContainerStarted","Data":"67da86c701518755deb92f85800d869293114d0aece0793bea651869e7391947"} Jul 23 18:31:01.964946 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.964918 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" event={"ID":"5247730c-21b7-4b27-b6cf-8aec08b6bb0f","Type":"ContainerStarted","Data":"c80d83e16662699498b7a9bae20af17b51ced8b771ade1e4590cf10f6579f3a9"} Jul 23 18:31:01.966387 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.966359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" event={"ID":"67a0a55e-9638-4aab-9284-945a0e481fa4","Type":"ContainerStarted","Data":"650cce86d8aa030e12fa8a2ad0a39f2c7d59442bdbdddf8061caf50aa4e48223"} Jul 23 18:31:01.967612 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.967594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" event={"ID":"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169","Type":"ContainerStarted","Data":"41d69501aa5a426d794d23cf8a867fed4cc39a45ef81c7d583db91e79b0afe54"} Jul 23 18:31:01.986605 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:01.986548 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" podStartSLOduration=1.5061602920000001 podStartE2EDuration="4.986528501s" totalImagesPullingTime="3.480368209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:01.986394668 +0000 UTC m=+43.752492489" watchObservedRunningTime="2026-07-23 18:31:01.986528501 +0000 UTC m=+43.752626323" Jul 23 18:31:02.004347 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.004287 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" podStartSLOduration=1.212072825 podStartE2EDuration="4.004266433s" totalImagesPullingTime="2.792193608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:02.003948802 +0000 UTC m=+43.770046624" watchObservedRunningTime="2026-07-23 18:31:02.004266433 +0000 UTC m=+43.770364255" Jul 23 18:31:02.005387 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.005368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.005468 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.005442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vckc\" (UniqueName: \"kubernetes.io/projected/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-api-access-8vckc\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.005468 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.005459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-data-volume\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.005568 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.005495 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:02.005568 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.005564 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:02.505544453 +0000 UTC m=+44.271642254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:02.005900 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.005881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.006055 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.006029 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:02.006204 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.006098 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:02.50607989 +0000 UTC m=+44.272177694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : configmap "kube-rbac-proxy" not found Jul 23 18:31:02.006204 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.006193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-crio-socket\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.006323 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.006294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-data-volume\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.006405 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.006382 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-crio-socket\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.018671 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.018648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vckc\" (UniqueName: \"kubernetes.io/projected/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-api-access-8vckc\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.512713 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.512651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.513190 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:02.512803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:02.513190 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.512927 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:02.513190 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.512991 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:03.512971158 +0000 UTC m=+45.279068959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : configmap "kube-rbac-proxy" not found Jul 23 18:31:02.513434 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.513414 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:02.513521 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:02.513477 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:03.513461591 +0000 UTC m=+45.279559407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:03.310215 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:03.310102 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5455h_d37c033d-4733-4410-a3bf-24a873b07bd4/dns-node-resolver/0.log" Jul 23 18:31:03.521668 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:03.521614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:03.522118 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:03.521796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:03.522118 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:03.521806 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:03.522118 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:03.521887 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:05.521863887 +0000 UTC m=+47.287961698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:03.522118 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:03.521910 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:03.522118 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:03.521955 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:05.521943485 +0000 UTC m=+47.288041283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : configmap "kube-rbac-proxy" not found Jul 23 18:31:04.093987 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.093922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:04.158890 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.158853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:04.410565 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.410478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:04.508006 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.507964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:04.571914 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.571879 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:04.710451 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.710427 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvgnl_50969230-2d01-40fb-858d-2cb6d2a8d640/node-ca/0.log" Jul 23 18:31:04.934478 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.934439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:31:04.934654 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:04.934494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:31:04.934654 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:04.934610 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:31:04.934835 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:04.934690 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:31:04.934835 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:04.934712 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls podName:3bb37e5a-9abd-404b-b75a-dabdd26c88ce nodeName:}" failed. No retries permitted until 2026-07-23 18:31:12.934688866 +0000 UTC m=+54.700786669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l2s9p" (UID: "3bb37e5a-9abd-404b-b75a-dabdd26c88ce") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:31:04.934835 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:04.934781 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls podName:913516da-9fcd-4c4f-a945-6c62e1371af4 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:12.934743638 +0000 UTC m=+54.700841439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xc2s8" (UID: "913516da-9fcd-4c4f-a945-6c62e1371af4") : secret "samples-operator-tls" not found Jul 23 18:31:05.110170 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:05.110088 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6hdcj_32d2153a-203e-4e9d-8e25-673697985337/serve-healthcheck-canary/0.log" Jul 23 18:31:05.539885 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:05.539858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:05.539996 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:05.539969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:05.540053 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:05.540001 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:05.540106 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:05.540064 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.540049227 +0000 UTC m=+51.306147025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:05.540106 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:05.540066 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:05.540208 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:05.540145 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:09.540126354 +0000 UTC m=+51.306224164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : configmap "kube-rbac-proxy" not found Jul 23 18:31:05.979832 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:05.979794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" event={"ID":"60c6d0c3-661d-4b71-bed2-760161aafeaf","Type":"ContainerStarted","Data":"314f03f94694071083201eacce5ca9c12996522bf7927f28362b06e1c64ee0e3"} Jul 23 18:31:05.981305 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:05.981279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" event={"ID":"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169","Type":"ContainerStarted","Data":"c6832fd6818e459a94a5560e8ab97ea74a76181df4ef31e8b77f64530facde5e"} Jul 23 18:31:05.994441 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:05.994394 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2r9qh" podStartSLOduration=2.093953704 podStartE2EDuration="5.994379117s" totalImagesPullingTime="3.900425413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:05.993686317 +0000 UTC m=+47.759784139" watchObservedRunningTime="2026-07-23 18:31:05.994379117 +0000 UTC m=+47.760476937" Jul 23 18:31:06.007816 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:06.007754 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" podStartSLOduration=1.136189181 podStartE2EDuration="5.00774037s" totalImagesPullingTime="3.871551189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:06.007066662 +0000 UTC m=+47.773164495" watchObservedRunningTime="2026-07-23 18:31:06.00774037 +0000 UTC m=+47.773838190" Jul 23 18:31:07.806346 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:07.806313 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:07.903736 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:07.903701 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:07.963318 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:07.963288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:08.415828 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:08.415790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:08.516048 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:08.516013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:09.273391 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:09.273352 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:09.388097 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:09.388064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:09.572344 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:09.572261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:09.572344 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:09.572324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:09.572538 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.572395 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:31:09.572538 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.572434 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:09.572538 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.572465 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:17.572447029 +0000 UTC m=+59.338544851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : configmap "kube-rbac-proxy" not found Jul 23 18:31:09.572538 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.572481 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:17.572475134 +0000 UTC m=+59.338572932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:09.874621 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:09.874548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:09.874621 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:09.874588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:09.874812 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.874689 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:31:09.874812 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.874692 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:31:09.874812 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.874776 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls podName:c607df59-9c4a-40be-9d9e-3f17b7b88121 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:25.874742592 +0000 UTC m=+67.640840416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls") pod "dns-default-lxvdl" (UID: "c607df59-9c4a-40be-9d9e-3f17b7b88121") : secret "dns-default-metrics-tls" not found Jul 23 18:31:09.874812 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.874700 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bb6cb977-mqvvv: secret "image-registry-tls" not found Jul 23 18:31:09.874948 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:09.874823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls podName:dc51ff15-ec8a-4469-ba0f-653065be6f5c nodeName:}" failed. No retries permitted until 2026-07-23 18:31:25.874814069 +0000 UTC m=+67.640911871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls") pod "image-registry-77bb6cb977-mqvvv" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c") : secret "image-registry-tls" not found Jul 23 18:31:10.034029 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:10.033990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:10.237772 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:10.237733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:10.745696 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:10.745648 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:11.288458 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:11.288406 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:12.999068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:12.999036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:31:12.999068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:12.999071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:31:12.999523 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:12.999183 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 18:31:12.999523 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:12.999241 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 18:31:12.999523 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:12.999250 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls podName:3bb37e5a-9abd-404b-b75a-dabdd26c88ce nodeName:}" failed. No retries permitted until 2026-07-23 18:31:28.999232245 +0000 UTC m=+70.765330061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-l2s9p" (UID: "3bb37e5a-9abd-404b-b75a-dabdd26c88ce") : secret "cluster-monitoring-operator-tls" not found Jul 23 18:31:12.999523 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:12.999303 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls podName:913516da-9fcd-4c4f-a945-6c62e1371af4 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:28.99929074 +0000 UTC m=+70.765388541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-xc2s8" (UID: "913516da-9fcd-4c4f-a945-6c62e1371af4") : secret "samples-operator-tls" not found Jul 23 18:31:13.867723 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:13.867686 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:14.814898 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:14.814863 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:14.947427 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:14.947399 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:15.055094 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:15.055060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:15.148412 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:15.148320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:15.268490 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:15.268454 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:15.484676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:15.484647 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:16.279086 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:16.279052 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:16.874559 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:16.874522 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:17.092187 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.092156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:17.280033 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.279996 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:17.481447 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.481413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:17.549543 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.549452 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:17.636147 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.636120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:17.636308 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.636215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:17.636308 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:17.636288 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:31:17.636428 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:17.636369 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls podName:10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:33.636347692 +0000 UTC m=+75.402445513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5gp4w" (UID: "10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8") : secret "insights-runtime-extractor-tls" not found Jul 23 18:31:17.636708 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:17.636689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:18.488958 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:18.488925 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:18.553444 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:18.553413 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:18.875574 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:18.875493 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.063580 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.063552 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.130254 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.130166 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.321107 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.321072 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.421826 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.421748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.521397 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.521366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.642700 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.642668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.853285 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.853256 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:19.913654 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:19.913608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:20.209197 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.209167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:20.324324 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.324290 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:20.624900 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.624832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:20.731709 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.731672 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:20.832098 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.832066 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:20.933219 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.933142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vh5jl" Jul 23 18:31:20.933406 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:20.933142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:21.033496 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:21.033461 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:21.134824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:21.134787 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:21.275595 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:21.275555 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:21.424983 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:21.424950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:21.494423 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:21.494392 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:22.480989 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:22.480956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:22.879284 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:22.879201 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:23.075929 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:23.075899 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:23.278781 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:23.278737 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:23.680146 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:23.680064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:24.074563 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.074531 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:24.486802 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.486776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:31:24.489258 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.489239 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:31:24.499133 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.499110 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3977e1c1-3336-4c31-8e6e-6a0285f6d415-metrics-certs\") pod \"network-metrics-daemon-9wgrt\" (UID: \"3977e1c1-3336-4c31-8e6e-6a0285f6d415\") " pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:31:24.521783 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.521741 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8szp\"" Jul 23 18:31:24.530565 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.530550 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9wgrt" Jul 23 18:31:24.588082 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.588041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:31:24.588232 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.588103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:31:24.591066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.590712 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:31:24.591066 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.590856 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwq97\" (UniqueName: \"kubernetes.io/projected/1a59daef-a069-4628-85e3-d7516a77834a-kube-api-access-pwq97\") pod \"network-check-target-5s9nw\" (UID: \"1a59daef-a069-4628-85e3-d7516a77834a\") " pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:31:24.600305 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.600265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a827359-4b90-490e-9d8a-7511934a486c-original-pull-secret\") pod \"global-pull-secret-syncer-lpcrz\" (UID: \"5a827359-4b90-490e-9d8a-7511934a486c\") " pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:31:24.613689 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.613664 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ltcv\"" Jul 23 18:31:24.621501 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.621483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:31:24.651986 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.651959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9wgrt"] Jul 23 18:31:24.654048 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:24.654020 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3977e1c1_3336_4c31_8e6e_6a0285f6d415.slice/crio-05e7aae28a80d9f36826a692d1e452b74dd80807bbe95ed42b333e06716fae68 WatchSource:0}: Error finding container 05e7aae28a80d9f36826a692d1e452b74dd80807bbe95ed42b333e06716fae68: Status 404 returned error can't find the container with id 05e7aae28a80d9f36826a692d1e452b74dd80807bbe95ed42b333e06716fae68 Jul 23 18:31:24.688941 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.688910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:24.741074 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.741006 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5s9nw"] Jul 23 18:31:24.743711 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:24.743690 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a59daef_a069_4628_85e3_d7516a77834a.slice/crio-a551f379ce5dca7db562b13df71c5c3428b92a3bb3c7f025f49c171d74edcc7d WatchSource:0}: Error finding container a551f379ce5dca7db562b13df71c5c3428b92a3bb3c7f025f49c171d74edcc7d: Status 404 returned error can't find the container with id a551f379ce5dca7db562b13df71c5c3428b92a3bb3c7f025f49c171d74edcc7d Jul 23 18:31:24.814139 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.814112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lpcrz" Jul 23 18:31:24.886563 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.886530 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:24.926990 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:24.926940 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lpcrz"] Jul 23 18:31:24.930069 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:24.930047 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a827359_4b90_490e_9d8a_7511934a486c.slice/crio-6c1d48a1b95f4516dc7e2a5d234e827778a9bc300bc92a3f1404aff4451333db WatchSource:0}: Error finding container 6c1d48a1b95f4516dc7e2a5d234e827778a9bc300bc92a3f1404aff4451333db: Status 404 returned error can't find the container with id 6c1d48a1b95f4516dc7e2a5d234e827778a9bc300bc92a3f1404aff4451333db Jul 23 18:31:25.028707 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.028658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5s9nw" event={"ID":"1a59daef-a069-4628-85e3-d7516a77834a","Type":"ContainerStarted","Data":"560735486c3dad43a0ecb8b3f1ebefea484b055c293a73d5c8e2b74a8a89854b"} Jul 23 18:31:25.028707 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.028701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5s9nw" event={"ID":"1a59daef-a069-4628-85e3-d7516a77834a","Type":"ContainerStarted","Data":"a551f379ce5dca7db562b13df71c5c3428b92a3bb3c7f025f49c171d74edcc7d"} Jul 23 18:31:25.028888 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.028780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:31:25.029889 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.029865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpcrz" event={"ID":"5a827359-4b90-490e-9d8a-7511934a486c","Type":"ContainerStarted","Data":"6c1d48a1b95f4516dc7e2a5d234e827778a9bc300bc92a3f1404aff4451333db"} Jul 23 18:31:25.030932 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.030915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wgrt" event={"ID":"3977e1c1-3336-4c31-8e6e-6a0285f6d415","Type":"ContainerStarted","Data":"05e7aae28a80d9f36826a692d1e452b74dd80807bbe95ed42b333e06716fae68"} Jul 23 18:31:25.046040 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.045999 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5s9nw" podStartSLOduration=65.045986939 podStartE2EDuration="1m5.045986939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:25.045027061 +0000 UTC m=+66.811124893" watchObservedRunningTime="2026-07-23 18:31:25.045986939 +0000 UTC m=+66.812084759" Jul 23 18:31:25.475745 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.475697 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:25.683653 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.683603 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:25.882185 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.882152 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:25.899175 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.899147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:25.899329 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.899285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:25.902056 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.902035 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c607df59-9c4a-40be-9d9e-3f17b7b88121-metrics-tls\") pod \"dns-default-lxvdl\" (UID: \"c607df59-9c4a-40be-9d9e-3f17b7b88121\") " pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:25.902143 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:25.902106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"image-registry-77bb6cb977-mqvvv\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:26.035331 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.035259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wgrt" event={"ID":"3977e1c1-3336-4c31-8e6e-6a0285f6d415","Type":"ContainerStarted","Data":"c09a88c96e5f8475506c2f2f1fcade8dcf793429566f84ffb5784f407c7b2716"} Jul 23 18:31:26.035331 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.035315 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9wgrt" event={"ID":"3977e1c1-3336-4c31-8e6e-6a0285f6d415","Type":"ContainerStarted","Data":"0e11eb9b664caa77baf2bce382ad065224082e5300d1c6377e17e350f914ef99"} Jul 23 18:31:26.050986 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.050940 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9wgrt" podStartSLOduration=65.929318732 podStartE2EDuration="1m7.050927189s" totalImagesPullingTime="1.121608457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:26.05083105 +0000 UTC m=+67.816928884" watchObservedRunningTime="2026-07-23 18:31:26.050927189 +0000 UTC m=+67.817025009" Jul 23 18:31:26.169850 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.169825 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6lc8t\"" Jul 23 18:31:26.177840 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.177814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:26.178727 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.178700 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55lsf\"" Jul 23 18:31:26.187526 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.187507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:26.318271 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.318201 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bb6cb977-mqvvv"] Jul 23 18:31:26.321253 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:26.321230 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice/crio-fec2295c809ed46bb3e51dd266811319f15e7229ca414ace2f8b6246f4c3724a WatchSource:0}: Error finding container fec2295c809ed46bb3e51dd266811319f15e7229ca414ace2f8b6246f4c3724a: Status 404 returned error can't find the container with id fec2295c809ed46bb3e51dd266811319f15e7229ca414ace2f8b6246f4c3724a Jul 23 18:31:26.329229 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:26.329205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxvdl"] Jul 23 18:31:26.333105 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:26.333077 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc607df59_9c4a_40be_9d9e_3f17b7b88121.slice/crio-ff92fa67d357b9305cc8787cdf8514be9cc3efe7cb80824905bcfaa54402b8a1 WatchSource:0}: Error finding container ff92fa67d357b9305cc8787cdf8514be9cc3efe7cb80824905bcfaa54402b8a1: Status 404 returned error can't find the container with id ff92fa67d357b9305cc8787cdf8514be9cc3efe7cb80824905bcfaa54402b8a1 Jul 23 18:31:27.043505 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.043201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" event={"ID":"dc51ff15-ec8a-4469-ba0f-653065be6f5c","Type":"ContainerStarted","Data":"f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a"} Jul 23 18:31:27.043505 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.043260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" event={"ID":"dc51ff15-ec8a-4469-ba0f-653065be6f5c","Type":"ContainerStarted","Data":"fec2295c809ed46bb3e51dd266811319f15e7229ca414ace2f8b6246f4c3724a"} Jul 23 18:31:27.043505 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.043327 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:27.044937 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.044909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxvdl" event={"ID":"c607df59-9c4a-40be-9d9e-3f17b7b88121","Type":"ContainerStarted","Data":"ff92fa67d357b9305cc8787cdf8514be9cc3efe7cb80824905bcfaa54402b8a1"} Jul 23 18:31:27.065719 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.065653 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" podStartSLOduration=68.065639865 podStartE2EDuration="1m8.065639865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:27.064045847 +0000 UTC m=+68.830143670" watchObservedRunningTime="2026-07-23 18:31:27.065639865 +0000 UTC m=+68.831737685" Jul 23 18:31:27.667889 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.667855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:27.735598 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:27.735565 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:29.026197 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.026162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:31:29.026607 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.026207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:31:29.028714 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.028686 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3bb37e5a-9abd-404b-b75a-dabdd26c88ce-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-l2s9p\" (UID: \"3bb37e5a-9abd-404b-b75a-dabdd26c88ce\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:31:29.028835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.028815 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/913516da-9fcd-4c4f-a945-6c62e1371af4-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-xc2s8\" (UID: \"913516da-9fcd-4c4f-a945-6c62e1371af4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:31:29.289387 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.289305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b745b\"" Jul 23 18:31:29.297058 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.297029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" Jul 23 18:31:29.305580 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.305547 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-997ps\"" Jul 23 18:31:29.313714 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.313688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" Jul 23 18:31:29.994977 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:29.994943 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7"] Jul 23 18:31:30.010045 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.010014 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx"] Jul 23 18:31:30.012855 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.012752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.016898 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.016204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-r4fdw\"" Jul 23 18:31:30.016898 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.016507 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 18:31:30.016898 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.016723 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 18:31:30.017175 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.017107 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 18:31:30.017362 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.017308 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 23 18:31:30.024068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.023867 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7"] Jul 23 18:31:30.024068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.023895 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx"] Jul 23 18:31:30.024068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.023987 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.027320 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.027044 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 18:31:30.027320 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.027217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-thxxq\"" Jul 23 18:31:30.028070 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.028051 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 18:31:30.094629 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.094602 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-hd86s"] Jul 23 18:31:30.108960 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.108909 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p"] Jul 23 18:31:30.109061 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.109040 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:30.110927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.110861 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8"] Jul 23 18:31:30.112012 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.111964 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 18:31:30.112194 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.112163 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hd86s"] Jul 23 18:31:30.112275 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.112266 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lsv45\"" Jul 23 18:31:30.112702 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.112680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 18:31:30.125138 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.125115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:30.136528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.136508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/245755e1-fe29-4c2d-97f7-9abe911ecfc1-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wn5hx\" (UID: \"245755e1-fe29-4c2d-97f7-9abe911ecfc1\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.136639 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.136548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63a77640-8a5d-44c8-b252-1dd9a96f2eb2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75f445c86-ddzk7\" (UID: \"63a77640-8a5d-44c8-b252-1dd9a96f2eb2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.136639 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.136568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgl55\" (UniqueName: \"kubernetes.io/projected/63a77640-8a5d-44c8-b252-1dd9a96f2eb2-kube-api-access-vgl55\") pod \"managed-serviceaccount-addon-agent-75f445c86-ddzk7\" (UID: \"63a77640-8a5d-44c8-b252-1dd9a96f2eb2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.136639 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.136616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/245755e1-fe29-4c2d-97f7-9abe911ecfc1-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wn5hx\" (UID: \"245755e1-fe29-4c2d-97f7-9abe911ecfc1\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.173972 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:30.173929 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb37e5a_9abd_404b_b75a_dabdd26c88ce.slice/crio-b759a5fe36bb6e3e152e98419e04211a511330e6740f8af54e881dd411c65673 WatchSource:0}: Error finding container b759a5fe36bb6e3e152e98419e04211a511330e6740f8af54e881dd411c65673: Status 404 returned error can't find the container with id b759a5fe36bb6e3e152e98419e04211a511330e6740f8af54e881dd411c65673 Jul 23 18:31:30.231468 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.231436 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:30.237068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.237043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/245755e1-fe29-4c2d-97f7-9abe911ecfc1-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wn5hx\" (UID: \"245755e1-fe29-4c2d-97f7-9abe911ecfc1\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.237161 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.237100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63a77640-8a5d-44c8-b252-1dd9a96f2eb2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75f445c86-ddzk7\" (UID: \"63a77640-8a5d-44c8-b252-1dd9a96f2eb2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.237161 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.237131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgl55\" (UniqueName: \"kubernetes.io/projected/63a77640-8a5d-44c8-b252-1dd9a96f2eb2-kube-api-access-vgl55\") pod \"managed-serviceaccount-addon-agent-75f445c86-ddzk7\" (UID: \"63a77640-8a5d-44c8-b252-1dd9a96f2eb2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.237284 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.237163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sb5t\" (UniqueName: \"kubernetes.io/projected/9ba887d5-1060-4f80-807a-8a837e3d695a-kube-api-access-5sb5t\") pod \"downloads-5bc67dcd46-hd86s\" (UID: \"9ba887d5-1060-4f80-807a-8a837e3d695a\") " pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:30.237284 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.237220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/245755e1-fe29-4c2d-97f7-9abe911ecfc1-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wn5hx\" (UID: \"245755e1-fe29-4c2d-97f7-9abe911ecfc1\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.237818 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.237796 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/245755e1-fe29-4c2d-97f7-9abe911ecfc1-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-wn5hx\" (UID: \"245755e1-fe29-4c2d-97f7-9abe911ecfc1\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.240389 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.240343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/245755e1-fe29-4c2d-97f7-9abe911ecfc1-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-wn5hx\" (UID: \"245755e1-fe29-4c2d-97f7-9abe911ecfc1\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.240557 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.240536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63a77640-8a5d-44c8-b252-1dd9a96f2eb2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75f445c86-ddzk7\" (UID: \"63a77640-8a5d-44c8-b252-1dd9a96f2eb2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.247296 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.247250 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgl55\" (UniqueName: \"kubernetes.io/projected/63a77640-8a5d-44c8-b252-1dd9a96f2eb2-kube-api-access-vgl55\") pod \"managed-serviceaccount-addon-agent-75f445c86-ddzk7\" (UID: \"63a77640-8a5d-44c8-b252-1dd9a96f2eb2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.327893 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.327817 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:30.332241 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.332215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" Jul 23 18:31:30.338100 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.338077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sb5t\" (UniqueName: \"kubernetes.io/projected/9ba887d5-1060-4f80-807a-8a837e3d695a-kube-api-access-5sb5t\") pod \"downloads-5bc67dcd46-hd86s\" (UID: \"9ba887d5-1060-4f80-807a-8a837e3d695a\") " pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:30.343100 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.343051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" Jul 23 18:31:30.349111 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.349088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sb5t\" (UniqueName: \"kubernetes.io/projected/9ba887d5-1060-4f80-807a-8a837e3d695a-kube-api-access-5sb5t\") pod \"downloads-5bc67dcd46-hd86s\" (UID: \"9ba887d5-1060-4f80-807a-8a837e3d695a\") " pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:30.424012 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.423735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:30.433304 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.433205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:30.523436 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.523408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7"] Jul 23 18:31:30.527044 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:30.527017 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63a77640_8a5d_44c8_b252_1dd9a96f2eb2.slice/crio-7e3e18a60247dfece429eb77c8826807f0e9f12e2bfa41299e6558f6b5f35a24 WatchSource:0}: Error finding container 7e3e18a60247dfece429eb77c8826807f0e9f12e2bfa41299e6558f6b5f35a24: Status 404 returned error can't find the container with id 7e3e18a60247dfece429eb77c8826807f0e9f12e2bfa41299e6558f6b5f35a24 Jul 23 18:31:30.543348 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.543326 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx"] Jul 23 18:31:30.546652 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:30.546624 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245755e1_fe29_4c2d_97f7_9abe911ecfc1.slice/crio-fa3773c0170194b743d18a6e41f0e5ef5591bda79f032ff6f6cb501fe6bbd5bb WatchSource:0}: Error finding container fa3773c0170194b743d18a6e41f0e5ef5591bda79f032ff6f6cb501fe6bbd5bb: Status 404 returned error can't find the container with id fa3773c0170194b743d18a6e41f0e5ef5591bda79f032ff6f6cb501fe6bbd5bb Jul 23 18:31:30.591636 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:30.591601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hd86s"] Jul 23 18:31:30.594089 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:30.594067 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba887d5_1060_4f80_807a_8a837e3d695a.slice/crio-c18774d367ff000f83b9c9a93f11d740e88f09b8dc9fff144d863b1e082787d9 WatchSource:0}: Error finding container c18774d367ff000f83b9c9a93f11d740e88f09b8dc9fff144d863b1e082787d9: Status 404 returned error can't find the container with id c18774d367ff000f83b9c9a93f11d740e88f09b8dc9fff144d863b1e082787d9 Jul 23 18:31:31.061717 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.061682 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" event={"ID":"245755e1-fe29-4c2d-97f7-9abe911ecfc1","Type":"ContainerStarted","Data":"fa3773c0170194b743d18a6e41f0e5ef5591bda79f032ff6f6cb501fe6bbd5bb"} Jul 23 18:31:31.063092 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.063064 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lpcrz" event={"ID":"5a827359-4b90-490e-9d8a-7511934a486c","Type":"ContainerStarted","Data":"0042f81a307b8dcc4e17286f1190ca68dd2a059f110442ff33c21e7c94717bf1"} Jul 23 18:31:31.064699 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.064673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxvdl" event={"ID":"c607df59-9c4a-40be-9d9e-3f17b7b88121","Type":"ContainerStarted","Data":"ce26a0a1c410d48eb5e71c7faa5c26317e4b062b9d53c28697d29346abeec995"} Jul 23 18:31:31.064816 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.064716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxvdl" event={"ID":"c607df59-9c4a-40be-9d9e-3f17b7b88121","Type":"ContainerStarted","Data":"7784ef5902d73c6cbaba3507d76841363a21fd80c305ed81828acdbc419e7e32"} Jul 23 18:31:31.064816 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.064752 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:31.065799 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.065780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" event={"ID":"63a77640-8a5d-44c8-b252-1dd9a96f2eb2","Type":"ContainerStarted","Data":"7e3e18a60247dfece429eb77c8826807f0e9f12e2bfa41299e6558f6b5f35a24"} Jul 23 18:31:31.066790 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.066749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" event={"ID":"913516da-9fcd-4c4f-a945-6c62e1371af4","Type":"ContainerStarted","Data":"4454c593c9d47827d2f8e93e72644a9fe0f8a8f2760e954df5888c9c0858b2b7"} Jul 23 18:31:31.068270 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.068241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" event={"ID":"3bb37e5a-9abd-404b-b75a-dabdd26c88ce","Type":"ContainerStarted","Data":"b759a5fe36bb6e3e152e98419e04211a511330e6740f8af54e881dd411c65673"} Jul 23 18:31:31.071752 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.071375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hd86s" event={"ID":"9ba887d5-1060-4f80-807a-8a837e3d695a","Type":"ContainerStarted","Data":"c18774d367ff000f83b9c9a93f11d740e88f09b8dc9fff144d863b1e082787d9"} Jul 23 18:31:31.097065 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.097016 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lpcrz" podStartSLOduration=65.829900893 podStartE2EDuration="1m11.096985191s" totalImagesPullingTime="5.267084298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:31.095899166 +0000 UTC m=+72.861996988" watchObservedRunningTime="2026-07-23 18:31:31.096985191 +0000 UTC m=+72.863082994" Jul 23 18:31:31.145121 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:31.145075 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lxvdl" podStartSLOduration=33.542559673 podStartE2EDuration="37.145056701s" totalImagesPullingTime="3.602497028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:31.144692569 +0000 UTC m=+72.910790391" watchObservedRunningTime="2026-07-23 18:31:31.145056701 +0000 UTC m=+72.911154523" Jul 23 18:31:33.669071 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:33.669019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:33.671854 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:33.671794 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5gp4w\" (UID: \"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8\") " pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:33.682440 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:33.682415 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7rvg\"" Jul 23 18:31:33.690543 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:33.690519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5gp4w" Jul 23 18:31:34.073246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.073210 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:34.134670 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.134630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:34.255553 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.255453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:34.328004 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.327922 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:34.696655 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.696630 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5gp4w"] Jul 23 18:31:34.870627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.870487 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:34.876056 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.876027 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-988d7b9d8-svmmb"] Jul 23 18:31:34.879306 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.879280 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:34.882966 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.882945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 18:31:34.883083 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.883060 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 18:31:34.883121 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.883103 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 18:31:34.883223 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.883208 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 18:31:34.883534 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.883521 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 18:31:34.883983 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.883955 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g5q6w\"" Jul 23 18:31:34.899146 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.898420 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-988d7b9d8-svmmb"] Jul 23 18:31:34.964830 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.964741 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:34.982625 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.982592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-oauth-config\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:34.982804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.982637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-console-config\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:34.982804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.982686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9vdj\" (UniqueName: \"kubernetes.io/projected/b0d656ae-6f89-47c0-beee-465173dc7a61-kube-api-access-z9vdj\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:34.982804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.982720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-service-ca\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:34.982804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.982753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-oauth-serving-cert\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:34.982804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:34.982805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-serving-cert\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.057336 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.057302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:35.084097 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.084069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-oauth-config\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.084246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.084108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-console-config\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.084246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.084137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9vdj\" (UniqueName: \"kubernetes.io/projected/b0d656ae-6f89-47c0-beee-465173dc7a61-kube-api-access-z9vdj\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.084246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.084164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-service-ca\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.084246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.084192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-oauth-serving-cert\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.084246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.084221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-serving-cert\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.085128 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.085076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-oauth-serving-cert\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.085128 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.085109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-console-config\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.085301 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.085076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-service-ca\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.087322 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.087175 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-oauth-config\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.087721 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.087698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-serving-cert\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.090749 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.090686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" event={"ID":"245755e1-fe29-4c2d-97f7-9abe911ecfc1","Type":"ContainerStarted","Data":"d8ed3cacea501ad9d81bb5b85cbe471e5d5bd2ba331fdecb1b88540225fff2a2"} Jul 23 18:31:35.092208 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.092186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9vdj\" (UniqueName: \"kubernetes.io/projected/b0d656ae-6f89-47c0-beee-465173dc7a61-kube-api-access-z9vdj\") pod \"console-988d7b9d8-svmmb\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.092975 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.092946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" event={"ID":"63a77640-8a5d-44c8-b252-1dd9a96f2eb2","Type":"ContainerStarted","Data":"6e551b02076673d334940c191f66c9b06118c35246c53908fa87f8e2ce1ac76b"} Jul 23 18:31:35.101980 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.101955 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" event={"ID":"913516da-9fcd-4c4f-a945-6c62e1371af4","Type":"ContainerStarted","Data":"11a715d0a12516ef277c027a4a64e5b2a83ab42e8456a46476ca9f9d4822bbe6"} Jul 23 18:31:35.102083 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.102035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" event={"ID":"913516da-9fcd-4c4f-a945-6c62e1371af4","Type":"ContainerStarted","Data":"c272fcfa77d4d654758f616139fc60e7ed4f865a84b8faf3a69ec90c617c6d6e"} Jul 23 18:31:35.105016 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.104986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" event={"ID":"3bb37e5a-9abd-404b-b75a-dabdd26c88ce","Type":"ContainerStarted","Data":"a47aa45524d25655392cae4bfa69733c8933e1e0de92a90f5990032008666a77"} Jul 23 18:31:35.106345 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.106326 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gp4w" event={"ID":"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8","Type":"ContainerStarted","Data":"4e23aa49605400013332083d5b7fb1b7686c35d91535f925e820e509ad5db162"} Jul 23 18:31:35.129833 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.129727 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-wn5hx" podStartSLOduration=2.133965413 podStartE2EDuration="6.129710901s" totalImagesPullingTime="3.995745488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:35.109283594 +0000 UTC m=+76.875381416" watchObservedRunningTime="2026-07-23 18:31:35.129710901 +0000 UTC m=+76.895808700" Jul 23 18:31:35.149882 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.149826 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-xc2s8" podStartSLOduration=33.857598297 podStartE2EDuration="38.149806541s" totalImagesPullingTime="4.292208244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:35.129186791 +0000 UTC m=+76.895284613" watchObservedRunningTime="2026-07-23 18:31:35.149806541 +0000 UTC m=+76.915904372" Jul 23 18:31:35.150418 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.150333 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-l2s9p" podStartSLOduration=33.788808313 podStartE2EDuration="38.150319663s" totalImagesPullingTime="4.36151135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:35.149897244 +0000 UTC m=+76.915995065" watchObservedRunningTime="2026-07-23 18:31:35.150319663 +0000 UTC m=+76.916417488" Jul 23 18:31:35.172449 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.172390 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75f445c86-ddzk7" podStartSLOduration=2.076843377 podStartE2EDuration="6.172340354s" totalImagesPullingTime="4.095496977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:35.172301301 +0000 UTC m=+76.938399121" watchObservedRunningTime="2026-07-23 18:31:35.172340354 +0000 UTC m=+76.938438176" Jul 23 18:31:35.176356 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.176331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:35.194788 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.194739 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:35.275665 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.275615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:35.337813 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.337662 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:35.363072 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:35.363000 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-988d7b9d8-svmmb"] Jul 23 18:31:35.368986 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:35.368799 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d656ae_6f89_47c0_beee_465173dc7a61.slice/crio-4a25c292db62aa2a284f0a34eb7fd0b0a7be7b81ad3d4e3adb6455c24e65111a WatchSource:0}: Error finding container 4a25c292db62aa2a284f0a34eb7fd0b0a7be7b81ad3d4e3adb6455c24e65111a: Status 404 returned error can't find the container with id 4a25c292db62aa2a284f0a34eb7fd0b0a7be7b81ad3d4e3adb6455c24e65111a Jul 23 18:31:36.113311 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.113232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-988d7b9d8-svmmb" event={"ID":"b0d656ae-6f89-47c0-beee-465173dc7a61","Type":"ContainerStarted","Data":"4a25c292db62aa2a284f0a34eb7fd0b0a7be7b81ad3d4e3adb6455c24e65111a"} Jul 23 18:31:36.446915 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.446829 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7f6d46d8-fprvc"] Jul 23 18:31:36.450594 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.450510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:36.450594 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.450585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.461786 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.458987 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 18:31:36.461786 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.460659 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7f6d46d8-fprvc"] Jul 23 18:31:36.508317 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.508264 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:36.607208 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-serving-cert\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.607434 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-oauth-serving-cert\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.607434 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-config\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.607434 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-service-ca\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.607434 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-trusted-ca-bundle\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.607434 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk29f\" (UniqueName: \"kubernetes.io/projected/9759a85d-fcf8-4b56-804b-9b0556a0e30f-kube-api-access-qk29f\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.607686 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.607484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-oauth-config\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-serving-cert\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-oauth-serving-cert\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-config\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-service-ca\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-trusted-ca-bundle\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk29f\" (UniqueName: \"kubernetes.io/projected/9759a85d-fcf8-4b56-804b-9b0556a0e30f-kube-api-access-qk29f\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709096 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.708569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-oauth-config\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.709788 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.709734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-config\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.710504 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.710478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-trusted-ca-bundle\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.712082 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.711091 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-service-ca\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.712082 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.711544 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-oauth-serving-cert\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.712082 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.711574 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-oauth-config\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.713231 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.713205 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-serving-cert\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.721411 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.721381 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk29f\" (UniqueName: \"kubernetes.io/projected/9759a85d-fcf8-4b56-804b-9b0556a0e30f-kube-api-access-qk29f\") pod \"console-7d7f6d46d8-fprvc\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.764507 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.764472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:36.926618 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:36.926584 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7f6d46d8-fprvc"] Jul 23 18:31:36.930316 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:36.930287 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9759a85d_fcf8_4b56_804b_9b0556a0e30f.slice/crio-17a3f56b848db4f793485eb7e27024228d10296d1606a527ed08886613c7d522 WatchSource:0}: Error finding container 17a3f56b848db4f793485eb7e27024228d10296d1606a527ed08886613c7d522: Status 404 returned error can't find the container with id 17a3f56b848db4f793485eb7e27024228d10296d1606a527ed08886613c7d522 Jul 23 18:31:37.118520 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:37.118434 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f6d46d8-fprvc" event={"ID":"9759a85d-fcf8-4b56-804b-9b0556a0e30f","Type":"ContainerStarted","Data":"17a3f56b848db4f793485eb7e27024228d10296d1606a527ed08886613c7d522"} Jul 23 18:31:38.092235 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:38.092193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:38.150882 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:38.150824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:39.257313 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:39.257259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:39.320919 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:39.320787 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:40.198680 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:40.198645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:40.269448 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:40.269404 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:40.593702 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:40.593668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:40.911008 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:40.910927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:40.974624 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:40.974538 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:41.079933 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:41.079904 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lxvdl" Jul 23 18:31:41.666259 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:41.666142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:41.763413 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:41.763373 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:43.148699 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:43.148651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gp4w" event={"ID":"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8","Type":"ContainerStarted","Data":"0496e5dcf81e5f5cb33b1b55c223dd5356ece3bfc608cbd694cd3990dbdc15d4"} Jul 23 18:31:43.150961 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:43.150929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-988d7b9d8-svmmb" event={"ID":"b0d656ae-6f89-47c0-beee-465173dc7a61","Type":"ContainerStarted","Data":"83b233ba912ae25f29d88fbbbb03af8d3e1595c1092108f7b48732d38ab0073d"} Jul 23 18:31:43.153926 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:43.153903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f6d46d8-fprvc" event={"ID":"9759a85d-fcf8-4b56-804b-9b0556a0e30f","Type":"ContainerStarted","Data":"1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb"} Jul 23 18:31:43.175089 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:43.174737 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-988d7b9d8-svmmb" podStartSLOduration=2.256194607 podStartE2EDuration="9.174724154s" totalImagesPullingTime="6.918529547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:43.17259747 +0000 UTC m=+84.938695292" watchObservedRunningTime="2026-07-23 18:31:43.174724154 +0000 UTC m=+84.940821953" Jul 23 18:31:43.191104 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:43.191060 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7f6d46d8-fprvc" podStartSLOduration=1.837841739 podStartE2EDuration="7.191044128s" totalImagesPullingTime="5.353202389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:43.189972684 +0000 UTC m=+84.956070506" watchObservedRunningTime="2026-07-23 18:31:43.191044128 +0000 UTC m=+84.957141950" Jul 23 18:31:43.873438 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:43.873401 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:44.074303 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:44.074212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:45.195655 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:45.195623 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:45.196134 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:45.195693 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:45.201212 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:45.201188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:45.261163 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:45.261110 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:45.923126 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:45.923085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:45.984839 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:45.984806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:46.170604 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:46.170576 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:31:46.765591 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:46.765554 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:46.766145 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:46.765620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:46.770954 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:46.770930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:47.004228 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.004186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.102946 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.102858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.180554 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.180524 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:31:47.202225 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.202192 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.227245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.227216 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-988d7b9d8-svmmb"] Jul 23 18:31:47.318070 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.318026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.516957 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.516885 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.664128 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.664086 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.694831 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.694799 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6"] Jul 23 18:31:47.700859 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.700839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.703199 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.703009 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 18:31:47.703199 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.703082 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jdcsm\"" Jul 23 18:31:47.703383 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.703291 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 18:31:47.703869 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.703849 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 18:31:47.708262 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.707219 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6"] Jul 23 18:31:47.744458 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.744429 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r6j8s"] Jul 23 18:31:47.748948 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.748926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.751455 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.751433 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 18:31:47.751574 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.751492 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 18:31:47.751574 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.751509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 18:31:47.751824 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.751802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ngb6f\"" Jul 23 18:31:47.783581 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.783484 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.803422 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35f82158-3567-4336-b8dc-f9654b49e451-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.803565 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803467 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-root\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803565 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-wtmp\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803679 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803679 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803605 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803679 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxvp6\" (UniqueName: \"kubernetes.io/projected/35f82158-3567-4336-b8dc-f9654b49e451-kube-api-access-vxvp6\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.803679 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rz9v\" (UniqueName: \"kubernetes.io/projected/ebd30fd9-7722-4276-83c2-d88e1740fd0b-kube-api-access-2rz9v\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803880 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35f82158-3567-4336-b8dc-f9654b49e451-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.803880 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-tls\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803880 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35f82158-3567-4336-b8dc-f9654b49e451-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.803998 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-textfile\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.803998 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-sys\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.804078 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.803998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebd30fd9-7722-4276-83c2-d88e1740fd0b-metrics-client-ca\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.866652 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.866613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:47.904774 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-wtmp\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.904956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.904956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.904956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxvp6\" (UniqueName: \"kubernetes.io/projected/35f82158-3567-4336-b8dc-f9654b49e451-kube-api-access-vxvp6\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.904956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rz9v\" (UniqueName: \"kubernetes.io/projected/ebd30fd9-7722-4276-83c2-d88e1740fd0b-kube-api-access-2rz9v\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.904956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35f82158-3567-4336-b8dc-f9654b49e451-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.904956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.904942 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-wtmp\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905251 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-tls\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905251 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35f82158-3567-4336-b8dc-f9654b49e451-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.905251 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-textfile\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905251 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-sys\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905251 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebd30fd9-7722-4276-83c2-d88e1740fd0b-metrics-client-ca\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905251 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35f82158-3567-4336-b8dc-f9654b49e451-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.905585 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-root\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905585 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905361 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-root\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905585 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905405 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebd30fd9-7722-4276-83c2-d88e1740fd0b-sys\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905585 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905553 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-textfile\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.905991 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.905966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.906298 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.906276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35f82158-3567-4336-b8dc-f9654b49e451-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.906503 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.906459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebd30fd9-7722-4276-83c2-d88e1740fd0b-metrics-client-ca\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.907667 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.907535 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.907791 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.907704 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35f82158-3567-4336-b8dc-f9654b49e451-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.907992 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.907962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebd30fd9-7722-4276-83c2-d88e1740fd0b-node-exporter-tls\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.908125 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.908101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35f82158-3567-4336-b8dc-f9654b49e451-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.913011 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.912985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxvp6\" (UniqueName: \"kubernetes.io/projected/35f82158-3567-4336-b8dc-f9654b49e451-kube-api-access-vxvp6\") pod \"openshift-state-metrics-79f6958cdf-hfjz6\" (UID: \"35f82158-3567-4336-b8dc-f9654b49e451\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:47.913213 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.913192 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rz9v\" (UniqueName: \"kubernetes.io/projected/ebd30fd9-7722-4276-83c2-d88e1740fd0b-kube-api-access-2rz9v\") pod \"node-exporter-r6j8s\" (UID: \"ebd30fd9-7722-4276-83c2-d88e1740fd0b\") " pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:47.966909 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:47.966863 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:48.011974 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.011942 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" Jul 23 18:31:48.054575 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.054513 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:31:48.060406 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.060358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r6j8s" Jul 23 18:31:48.067227 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.067193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:48.168412 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.168362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:48.307161 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.307038 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:48.822671 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.822637 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:48.960901 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:48.960834 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:49.113497 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:49.113416 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:50.708535 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.708492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:50.779999 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.779962 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:50.784699 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.784672 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz"] Jul 23 18:31:50.843306 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.843272 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz"] Jul 23 18:31:50.843457 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.843379 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.846087 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lqdl8\"" Jul 23 18:31:50.846340 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846322 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 18:31:50.846627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846426 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 18:31:50.846627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846489 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b9dimp9dnk8sb\"" Jul 23 18:31:50.846627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846491 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 18:31:50.846627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846549 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 18:31:50.846627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.846432 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 18:31:50.937610 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc89n\" (UniqueName: \"kubernetes.io/projected/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-kube-api-access-bc89n\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.937805 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-tls\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.937805 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.937805 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.937805 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-grpc-tls\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.938003 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-metrics-client-ca\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.938003 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:50.938003 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:50.937882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.009910 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.009791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:51.038678 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.038648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.038843 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.038684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.038843 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.038812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc89n\" (UniqueName: \"kubernetes.io/projected/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-kube-api-access-bc89n\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.038955 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.038925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-tls\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.039015 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.038960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.039015 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.038989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.039142 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.039117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-grpc-tls\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.039191 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.039176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-metrics-client-ca\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.040003 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.039953 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-metrics-client-ca\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.041457 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.041429 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.041577 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.041465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-tls\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.041645 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.041598 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.041858 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.041839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.041858 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.041849 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.041962 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.041914 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-secret-grpc-tls\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.046711 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.046691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc89n\" (UniqueName: \"kubernetes.io/projected/a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189-kube-api-access-bc89n\") pod \"thanos-querier-7d44cfffc5-8nlzz\" (UID: \"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189\") " pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.154532 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.154501 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:31:51.210823 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:51.210796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:52.458287 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.458257 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:52.461661 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.461634 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz"] Jul 23 18:31:52.555970 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.555939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:52.680986 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.680957 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz"] Jul 23 18:31:52.681115 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.681049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:52.683367 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.683346 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 18:31:52.683519 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.683350 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ttvjz\"" Jul 23 18:31:52.755961 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.755891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdxbq\" (UniqueName: \"kubernetes.io/projected/2d329e36-2cf7-42c9-b9ad-ca8255e92768-kube-api-access-tdxbq\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:52.755961 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.755953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d329e36-2cf7-42c9-b9ad-ca8255e92768-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:52.856917 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.856890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdxbq\" (UniqueName: \"kubernetes.io/projected/2d329e36-2cf7-42c9-b9ad-ca8255e92768-kube-api-access-tdxbq\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:52.857051 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.856951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d329e36-2cf7-42c9-b9ad-ca8255e92768-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:52.857098 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:52.857076 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 23 18:31:52.857162 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:31:52.857149 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d329e36-2cf7-42c9-b9ad-ca8255e92768-monitoring-plugin-cert podName:2d329e36-2cf7-42c9-b9ad-ca8255e92768 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:53.35712736 +0000 UTC m=+95.123225159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2d329e36-2cf7-42c9-b9ad-ca8255e92768-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-jhlkz" (UID: "2d329e36-2cf7-42c9-b9ad-ca8255e92768") : secret "monitoring-plugin-cert" not found Jul 23 18:31:52.883224 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.883172 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdxbq\" (UniqueName: \"kubernetes.io/projected/2d329e36-2cf7-42c9-b9ad-ca8255e92768-kube-api-access-tdxbq\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:52.892022 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.891987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:52.980189 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:52.980153 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:53.002354 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.002331 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bb6cb977-mqvvv"] Jul 23 18:31:53.057593 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.057518 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:53.117880 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.117852 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:53.195165 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.195127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:53.360855 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.360775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d329e36-2cf7-42c9-b9ad-ca8255e92768-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:53.363589 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.363561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2d329e36-2cf7-42c9-b9ad-ca8255e92768-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-jhlkz\" (UID: \"2d329e36-2cf7-42c9-b9ad-ca8255e92768\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:53.590395 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.590353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:31:53.722140 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:53.722104 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd30fd9_7722_4276_83c2_d88e1740fd0b.slice/crio-aeb8d22a46f2c15c1aeab56e875cdbaf3060d28c1ca4132825a80adc97577ce3 WatchSource:0}: Error finding container aeb8d22a46f2c15c1aeab56e875cdbaf3060d28c1ca4132825a80adc97577ce3: Status 404 returned error can't find the container with id aeb8d22a46f2c15c1aeab56e875cdbaf3060d28c1ca4132825a80adc97577ce3 Jul 23 18:31:53.745514 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.745485 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6"] Jul 23 18:31:53.764686 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:53.764362 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f82158_3567_4336_b8dc_f9654b49e451.slice/crio-b0bf6290139bb419bdbca19516fe132a1942f747a40a0425f71b1fd184097d74 WatchSource:0}: Error finding container b0bf6290139bb419bdbca19516fe132a1942f747a40a0425f71b1fd184097d74: Status 404 returned error can't find the container with id b0bf6290139bb419bdbca19516fe132a1942f747a40a0425f71b1fd184097d74 Jul 23 18:31:53.872611 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.871955 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz"] Jul 23 18:31:53.883159 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:53.883133 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dbfd97_9d7f_4586_aa6e_09b7b5e6b189.slice/crio-b7210b70d51cee8caacb8c7430a0b745bc6bbe53898daa4b12a99c0090a136ba WatchSource:0}: Error finding container b7210b70d51cee8caacb8c7430a0b745bc6bbe53898daa4b12a99c0090a136ba: Status 404 returned error can't find the container with id b7210b70d51cee8caacb8c7430a0b745bc6bbe53898daa4b12a99c0090a136ba Jul 23 18:31:53.893298 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:53.893271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz"] Jul 23 18:31:53.896516 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:53.895592 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d329e36_2cf7_42c9_b9ad_ca8255e92768.slice/crio-9eb90badbfc1a23f3fdce4bf60fa50f94bd6cbdf5242f00c1b13cc05bf4d4d9e WatchSource:0}: Error finding container 9eb90badbfc1a23f3fdce4bf60fa50f94bd6cbdf5242f00c1b13cc05bf4d4d9e: Status 404 returned error can't find the container with id 9eb90badbfc1a23f3fdce4bf60fa50f94bd6cbdf5242f00c1b13cc05bf4d4d9e Jul 23 18:31:54.052629 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.052591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:54.057293 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.057267 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:31:54.062146 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.062124 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.064543 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.064516 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 18:31:54.064655 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.064518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 18:31:54.065237 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.065216 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 18:31:54.065498 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.065481 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 18:31:54.065575 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.065541 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 18:31:54.066004 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.065851 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 18:31:54.066004 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.065856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ehhqlsj2fqguk\"" Jul 23 18:31:54.066602 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.066175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 18:31:54.067091 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067074 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 18:31:54.067091 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067087 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 18:31:54.067250 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067123 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 18:31:54.067339 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067316 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 18:31:54.067406 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067395 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 18:31:54.067489 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067321 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 18:31:54.067607 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067587 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 18:31:54.067752 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.067729 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8sbwh\"" Jul 23 18:31:54.069169 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.069146 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 18:31:54.076946 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.076920 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:31:54.168133 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168321 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-config\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168321 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168321 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168321 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168321 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168546 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168546 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.168923 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95ks\" (UniqueName: \"kubernetes.io/projected/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-kube-api-access-x95ks\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169060 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169060 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.168974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169060 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169188 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169248 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169248 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169333 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169254 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169333 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169333 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169333 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.169484 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.169396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.202644 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.202610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6j8s" event={"ID":"ebd30fd9-7722-4276-83c2-d88e1740fd0b","Type":"ContainerStarted","Data":"aeb8d22a46f2c15c1aeab56e875cdbaf3060d28c1ca4132825a80adc97577ce3"} Jul 23 18:31:54.205848 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.205821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" event={"ID":"35f82158-3567-4336-b8dc-f9654b49e451","Type":"ContainerStarted","Data":"55c47f54863cd17e19cd55dcce64a8f9071c0bd16c20eccb8c7a4b713e2a11f8"} Jul 23 18:31:54.206011 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.205992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" event={"ID":"35f82158-3567-4336-b8dc-f9654b49e451","Type":"ContainerStarted","Data":"dff346482841ebd6827400c344de3ad859e4411bdebb97f9635a3114f68db016"} Jul 23 18:31:54.206162 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.206145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" event={"ID":"35f82158-3567-4336-b8dc-f9654b49e451","Type":"ContainerStarted","Data":"b0bf6290139bb419bdbca19516fe132a1942f747a40a0425f71b1fd184097d74"} Jul 23 18:31:54.207944 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.207916 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"b7210b70d51cee8caacb8c7430a0b745bc6bbe53898daa4b12a99c0090a136ba"} Jul 23 18:31:54.211082 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.211057 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hd86s" event={"ID":"9ba887d5-1060-4f80-807a-8a837e3d695a","Type":"ContainerStarted","Data":"7e1e4bd79aa8f75758d90cc4df2339bd43c0071a8ef6a2f37bc3c37703fd71cb"} Jul 23 18:31:54.211467 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.211447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:54.214210 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.214164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" event={"ID":"2d329e36-2cf7-42c9-b9ad-ca8255e92768","Type":"ContainerStarted","Data":"9eb90badbfc1a23f3fdce4bf60fa50f94bd6cbdf5242f00c1b13cc05bf4d4d9e"} Jul 23 18:31:54.216618 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.216592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gp4w" event={"ID":"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8","Type":"ContainerStarted","Data":"12b7b4a984c90a9c1347e4b00723d312ffdab31fe5502e1ccca4694901626732"} Jul 23 18:31:54.223579 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.223557 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-hd86s" Jul 23 18:31:54.246735 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.245258 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-hd86s" podStartSLOduration=1.123876149 podStartE2EDuration="24.245242434s" totalImagesPullingTime="23.121366285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:54.228941747 +0000 UTC m=+95.995039569" watchObservedRunningTime="2026-07-23 18:31:54.245242434 +0000 UTC m=+96.011340276" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.270804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.270856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.270883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.270918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95ks\" (UniqueName: \"kubernetes.io/projected/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-kube-api-access-x95ks\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.270958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.270981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.272849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.273578 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.273578 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.273578 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-config\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.273578 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.273578 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.273578 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.271467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.276871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.273978 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.276871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.274927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.276871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.275420 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.276871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.276518 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.281154 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.280349 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.281154 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.280872 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.287171 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.286466 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.287171 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.287119 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.288064 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.288037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.289888 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.289865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.290013 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.289893 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.290368 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.290325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-config\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.291219 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.290991 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.291219 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.291177 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.291869 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.291826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.292382 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.292030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.292382 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.292327 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.293113 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.293052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.296511 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.296469 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.299170 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.299132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95ks\" (UniqueName: \"kubernetes.io/projected/62f8b1b5-40cf-4401-a3e7-720eaa778f2c-kube-api-access-x95ks\") pod \"prometheus-k8s-0\" (UID: \"62f8b1b5-40cf-4401-a3e7-720eaa778f2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.373823 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.373777 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:31:54.582004 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:54.581904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:31:54.586746 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:31:54.586710 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f8b1b5_40cf_4401_a3e7_720eaa778f2c.slice/crio-dd16e59c1cce806da21fbfe2367a65fb918dd827dc0b3104750bde9af7fa46d9 WatchSource:0}: Error finding container dd16e59c1cce806da21fbfe2367a65fb918dd827dc0b3104750bde9af7fa46d9: Status 404 returned error can't find the container with id dd16e59c1cce806da21fbfe2367a65fb918dd827dc0b3104750bde9af7fa46d9 Jul 23 18:31:55.227358 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:55.227122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"dd16e59c1cce806da21fbfe2367a65fb918dd827dc0b3104750bde9af7fa46d9"} Jul 23 18:31:56.037866 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:56.037812 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5s9nw" Jul 23 18:31:56.935889 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:56.935852 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:57.015213 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:57.015178 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:57.517179 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:57.517056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:31:57.618316 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:31:57.618212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:02.130057 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.130015 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:02.231375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.231335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:02.265050 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.265014 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" event={"ID":"2d329e36-2cf7-42c9-b9ad-ca8255e92768","Type":"ContainerStarted","Data":"9a4ec40e3e35386e094124d76d89598492dbfed988d061f470af71c0b2bac26b"} Jul 23 18:32:02.265240 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.265196 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:32:02.267752 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.267723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5gp4w" event={"ID":"10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8","Type":"ContainerStarted","Data":"b9833c38a29a39fa4d7356c12106b873225009ba95f0ef181863d2c5f9bc23a1"} Jul 23 18:32:02.269849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.269822 2564 generic.go:356] "Generic (PLEG): container finished" podID="ebd30fd9-7722-4276-83c2-d88e1740fd0b" containerID="1d67712ae1bee5d5f63253cd13eb13324a57ee99e89200a6ea126fa9cbcc6132" exitCode=0 Jul 23 18:32:02.269982 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.269909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6j8s" event={"ID":"ebd30fd9-7722-4276-83c2-d88e1740fd0b","Type":"ContainerDied","Data":"1d67712ae1bee5d5f63253cd13eb13324a57ee99e89200a6ea126fa9cbcc6132"} Jul 23 18:32:02.271839 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.271805 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" Jul 23 18:32:02.272622 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.272595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" event={"ID":"35f82158-3567-4336-b8dc-f9654b49e451","Type":"ContainerStarted","Data":"c3910830f514b4bc63642334aad392a9358b97536485bd7f703f964d18d2278d"} Jul 23 18:32:02.274421 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.274401 2564 generic.go:356] "Generic (PLEG): container finished" podID="62f8b1b5-40cf-4401-a3e7-720eaa778f2c" containerID="af383e636b8598673208128a2680fc6940fed226b36780ed44626b22b4da75b1" exitCode=0 Jul 23 18:32:02.274531 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.274483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerDied","Data":"af383e636b8598673208128a2680fc6940fed226b36780ed44626b22b4da75b1"} Jul 23 18:32:02.276862 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.276839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"24982e29e37841467b8a4f19ea9a4538b8b1b60b6761c471d66746f7cdadc237"} Jul 23 18:32:02.276964 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.276911 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"7a5f52f7e72eb7272dac2bea63098e4cfe40e9336e0c13aec38505083b137f8b"} Jul 23 18:32:02.277039 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.276971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"6ca730bf049a57e1e42e54ea35eb6fd1a9818d0bf389db1a21f2ca75194800da"} Jul 23 18:32:02.283078 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.283039 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-jhlkz" podStartSLOduration=2.587308996 podStartE2EDuration="10.283025708s" totalImagesPullingTime="7.695716712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:02.281366267 +0000 UTC m=+104.047464099" watchObservedRunningTime="2026-07-23 18:32:02.283025708 +0000 UTC m=+104.049123531" Jul 23 18:32:02.302500 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.302448 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-hfjz6" podStartSLOduration=7.65307013 podStartE2EDuration="15.302433255s" totalImagesPullingTime="7.649363125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:02.300519925 +0000 UTC m=+104.066617745" watchObservedRunningTime="2026-07-23 18:32:02.302433255 +0000 UTC m=+104.068531076" Jul 23 18:32:02.339738 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:02.339685 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5gp4w" podStartSLOduration=34.594953069 podStartE2EDuration="1m1.339664724s" totalImagesPullingTime="26.744711655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:31:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:02.339463759 +0000 UTC m=+104.105561581" watchObservedRunningTime="2026-07-23 18:32:02.339664724 +0000 UTC m=+104.105762545" Jul 23 18:32:03.283236 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:03.283196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6j8s" event={"ID":"ebd30fd9-7722-4276-83c2-d88e1740fd0b","Type":"ContainerStarted","Data":"1654e51904f3a14c727cc28145c6b8d3c55da3b648a704785be353cfe59effe7"} Jul 23 18:32:03.283611 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:03.283256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6j8s" event={"ID":"ebd30fd9-7722-4276-83c2-d88e1740fd0b","Type":"ContainerStarted","Data":"2c6d24ba1936ce9899b4be542bd5c81158294d6a479d3ae2d08f1eb47f949962"} Jul 23 18:32:03.303050 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:03.303003 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r6j8s" podStartSLOduration=8.345625353 podStartE2EDuration="16.302988294s" totalImagesPullingTime="7.842858491s" totalInitContainerRuntime="114.50445ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:03.301634193 +0000 UTC m=+105.067732013" watchObservedRunningTime="2026-07-23 18:32:03.302988294 +0000 UTC m=+105.069086114" Jul 23 18:32:04.056165 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:04.056114 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:04.112959 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:04.112879 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:04.289997 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:04.289957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"1ca2a35307d5afd7f255bedaf78fa4a22ea06eb404bf156c486457f9ba3d1495"} Jul 23 18:32:04.290455 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:04.290022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"00c3147030a069ca47bdf0db68cf6b076cd48418819c4876fb0fbf04feef0348"} Jul 23 18:32:04.290455 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:04.290048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" event={"ID":"a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189","Type":"ContainerStarted","Data":"2c368b5099d1384709a8519970667ba91a4f763909491e1432782e18509c2d0b"} Jul 23 18:32:04.313337 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:04.313286 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" podStartSLOduration=5.280638292 podStartE2EDuration="14.313263201s" totalImagesPullingTime="9.032624909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:04.312530831 +0000 UTC m=+106.078628690" watchObservedRunningTime="2026-07-23 18:32:04.313263201 +0000 UTC m=+106.079361023" Jul 23 18:32:05.295862 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:05.295820 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:32:06.979102 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:06.979056 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7f6d46d8-fprvc"] Jul 23 18:32:07.077328 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.077295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:07.306225 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.306196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"6966aa78fac15b12b0b479fabb9a2ffa479e4596de4c9ba0801962cb3b00e300"} Jul 23 18:32:07.306370 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.306273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"9916f30b322563a9737e21f82a37103b0b1bb5a571f3adcbd15e4b4ad8efa47b"} Jul 23 18:32:07.306370 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.306315 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"f2f029d83d7098e493b247442c53682c1cb8ace448518fcff8bc5ab40fc954c3"} Jul 23 18:32:07.306370 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.306355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"9294f9e3fdd87d403ee68f88372761fea50c62d80bc1125f018ab9312f4bbda2"} Jul 23 18:32:07.306528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.306392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"fa6b6d84fcf91d2d5129f592bd428c9ba8ddfb541d1a18dd21dd9037b21aec81"} Jul 23 18:32:07.306528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.306441 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"62f8b1b5-40cf-4401-a3e7-720eaa778f2c","Type":"ContainerStarted","Data":"875a29d4d1d080a91b338aed8c8c8249b321dffc89c687362fb2b2cf37de374e"} Jul 23 18:32:07.336301 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:07.336248 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9837575360000002 podStartE2EDuration="13.336226362s" totalImagesPullingTime="11.329990024s" totalInitContainerRuntime="22.478802ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:07.334104167 +0000 UTC m=+109.100201988" watchObservedRunningTime="2026-07-23 18:32:07.336226362 +0000 UTC m=+109.102324184" Jul 23 18:32:09.375103 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:09.375062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:32:11.304477 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:11.304450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d44cfffc5-8nlzz" Jul 23 18:32:11.320634 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:11.320587 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:11.426258 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:11.426229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:11.499505 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:11.499478 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:13.198108 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.198066 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-988d7b9d8-svmmb" podUID="b0d656ae-6f89-47c0-beee-465173dc7a61" containerName="console" containerID="cri-o://83b233ba912ae25f29d88fbbbb03af8d3e1595c1092108f7b48732d38ab0073d" gracePeriod=15 Jul 23 18:32:13.333890 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.333863 2564 generic.go:356] "Generic (PLEG): container finished" podID="b0d656ae-6f89-47c0-beee-465173dc7a61" containerID="83b233ba912ae25f29d88fbbbb03af8d3e1595c1092108f7b48732d38ab0073d" exitCode=0 Jul 23 18:32:13.334014 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.333943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-988d7b9d8-svmmb" event={"ID":"b0d656ae-6f89-47c0-beee-465173dc7a61","Type":"ContainerDied","Data":"83b233ba912ae25f29d88fbbbb03af8d3e1595c1092108f7b48732d38ab0073d"} Jul 23 18:32:13.459050 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.459028 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:32:13.464372 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464342 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-oauth-serving-cert\") pod \"b0d656ae-6f89-47c0-beee-465173dc7a61\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " Jul 23 18:32:13.464486 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464383 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-service-ca\") pod \"b0d656ae-6f89-47c0-beee-465173dc7a61\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " Jul 23 18:32:13.464486 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464428 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-oauth-config\") pod \"b0d656ae-6f89-47c0-beee-465173dc7a61\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " Jul 23 18:32:13.464563 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464486 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-console-config\") pod \"b0d656ae-6f89-47c0-beee-465173dc7a61\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " Jul 23 18:32:13.464563 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464516 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9vdj\" (UniqueName: \"kubernetes.io/projected/b0d656ae-6f89-47c0-beee-465173dc7a61-kube-api-access-z9vdj\") pod \"b0d656ae-6f89-47c0-beee-465173dc7a61\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " Jul 23 18:32:13.464563 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464544 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-serving-cert\") pod \"b0d656ae-6f89-47c0-beee-465173dc7a61\" (UID: \"b0d656ae-6f89-47c0-beee-465173dc7a61\") " Jul 23 18:32:13.464841 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464811 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0d656ae-6f89-47c0-beee-465173dc7a61" (UID: "b0d656ae-6f89-47c0-beee-465173dc7a61"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:13.464955 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464817 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0d656ae-6f89-47c0-beee-465173dc7a61" (UID: "b0d656ae-6f89-47c0-beee-465173dc7a61"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:13.464955 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.464873 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-console-config" (OuterVolumeSpecName: "console-config") pod "b0d656ae-6f89-47c0-beee-465173dc7a61" (UID: "b0d656ae-6f89-47c0-beee-465173dc7a61"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:13.466641 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.466621 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0d656ae-6f89-47c0-beee-465173dc7a61" (UID: "b0d656ae-6f89-47c0-beee-465173dc7a61"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:32:13.466720 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.466647 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d656ae-6f89-47c0-beee-465173dc7a61-kube-api-access-z9vdj" (OuterVolumeSpecName: "kube-api-access-z9vdj") pod "b0d656ae-6f89-47c0-beee-465173dc7a61" (UID: "b0d656ae-6f89-47c0-beee-465173dc7a61"). InnerVolumeSpecName "kube-api-access-z9vdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:13.466789 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.466716 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0d656ae-6f89-47c0-beee-465173dc7a61" (UID: "b0d656ae-6f89-47c0-beee-465173dc7a61"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:32:13.565748 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.565716 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-service-ca\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:13.565748 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.565742 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-oauth-config\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:13.565748 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.565752 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-console-config\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:13.566007 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.565780 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9vdj\" (UniqueName: \"kubernetes.io/projected/b0d656ae-6f89-47c0-beee-465173dc7a61-kube-api-access-z9vdj\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:13.566007 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.565789 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0d656ae-6f89-47c0-beee-465173dc7a61-console-serving-cert\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:13.566007 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:13.565797 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0d656ae-6f89-47c0-beee-465173dc7a61-oauth-serving-cert\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:14.339345 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:14.339316 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-988d7b9d8-svmmb" Jul 23 18:32:14.339828 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:14.339311 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-988d7b9d8-svmmb" event={"ID":"b0d656ae-6f89-47c0-beee-465173dc7a61","Type":"ContainerDied","Data":"4a25c292db62aa2a284f0a34eb7fd0b0a7be7b81ad3d4e3adb6455c24e65111a"} Jul 23 18:32:14.339828 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:14.339450 2564 scope.go:117] "RemoveContainer" containerID="83b233ba912ae25f29d88fbbbb03af8d3e1595c1092108f7b48732d38ab0073d" Jul 23 18:32:14.359236 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:14.359215 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-988d7b9d8-svmmb"] Jul 23 18:32:14.363118 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:14.363098 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-988d7b9d8-svmmb"] Jul 23 18:32:14.806533 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:14.806502 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d656ae-6f89-47c0-beee-465173dc7a61" path="/var/lib/kubelet/pods/b0d656ae-6f89-47c0-beee-465173dc7a61/volumes" Jul 23 18:32:17.354454 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:17.354414 2564 generic.go:356] "Generic (PLEG): container finished" podID="5247730c-21b7-4b27-b6cf-8aec08b6bb0f" containerID="c80d83e16662699498b7a9bae20af17b51ced8b771ade1e4590cf10f6579f3a9" exitCode=0 Jul 23 18:32:17.354890 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:17.354478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" event={"ID":"5247730c-21b7-4b27-b6cf-8aec08b6bb0f","Type":"ContainerDied","Data":"c80d83e16662699498b7a9bae20af17b51ced8b771ade1e4590cf10f6579f3a9"} Jul 23 18:32:17.354890 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:17.354845 2564 scope.go:117] "RemoveContainer" containerID="c80d83e16662699498b7a9bae20af17b51ced8b771ade1e4590cf10f6579f3a9" Jul 23 18:32:18.023038 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.022987 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" podUID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" containerName="registry" containerID="cri-o://f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a" gracePeriod=30 Jul 23 18:32:18.050811 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.050519 2564 patch_prober.go:28] interesting pod/image-registry-77bb6cb977-mqvvv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jul 23 18:32:18.050811 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.050586 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" podUID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jul 23 18:32:18.303941 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.303916 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:32:18.360581 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.360543 2564 generic.go:356] "Generic (PLEG): container finished" podID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" containerID="f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a" exitCode=0 Jul 23 18:32:18.361006 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.360595 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" Jul 23 18:32:18.361006 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.360629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" event={"ID":"dc51ff15-ec8a-4469-ba0f-653065be6f5c","Type":"ContainerDied","Data":"f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a"} Jul 23 18:32:18.361006 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.360681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bb6cb977-mqvvv" event={"ID":"dc51ff15-ec8a-4469-ba0f-653065be6f5c","Type":"ContainerDied","Data":"fec2295c809ed46bb3e51dd266811319f15e7229ca414ace2f8b6246f4c3724a"} Jul 23 18:32:18.361006 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.360709 2564 scope.go:117] "RemoveContainer" containerID="f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a" Jul 23 18:32:18.362548 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.362524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-c2bhz" event={"ID":"5247730c-21b7-4b27-b6cf-8aec08b6bb0f","Type":"ContainerStarted","Data":"d354dc5ed763e37793f8266128a928de0e023d9b77d38d9bab4bc6f9d2870750"} Jul 23 18:32:18.370840 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.370822 2564 scope.go:117] "RemoveContainer" containerID="f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a" Jul 23 18:32:18.371118 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:18.371096 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a\": container with ID starting with f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a not found: ID does not exist" containerID="f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a" Jul 23 18:32:18.371171 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.371127 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a"} err="failed to get container status \"f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a\": rpc error: code = NotFound desc = could not find container \"f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a\": container with ID starting with f422e535e372b92314f8d8dc35c8aa4f18d629ab431e72f6055c9d792899447a not found: ID does not exist" Jul 23 18:32:18.409298 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409274 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65t9q\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-kube-api-access-65t9q\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409411 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409309 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409411 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409338 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-trusted-ca\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409521 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409470 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-certificates\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409580 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409519 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-image-registry-private-configuration\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409580 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409552 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-bound-sa-token\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409682 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409585 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc51ff15-ec8a-4469-ba0f-653065be6f5c-ca-trust-extracted\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409682 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409631 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-installation-pull-secrets\") pod \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\" (UID: \"dc51ff15-ec8a-4469-ba0f-653065be6f5c\") " Jul 23 18:32:18.409805 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.409746 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:18.410037 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.410012 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:18.410108 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.410022 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-trusted-ca\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.412300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.412277 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:18.412622 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.412598 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:32:18.412715 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.412651 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:18.412813 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.412784 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:32:18.412870 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.412819 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-kube-api-access-65t9q" (OuterVolumeSpecName: "kube-api-access-65t9q") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "kube-api-access-65t9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:18.418649 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.418388 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc51ff15-ec8a-4469-ba0f-653065be6f5c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dc51ff15-ec8a-4469-ba0f-653065be6f5c" (UID: "dc51ff15-ec8a-4469-ba0f-653065be6f5c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:32:18.511222 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511197 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-certificates\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.511222 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511222 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-image-registry-private-configuration\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.511375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511232 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-bound-sa-token\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.511375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511240 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc51ff15-ec8a-4469-ba0f-653065be6f5c-ca-trust-extracted\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.511375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511249 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc51ff15-ec8a-4469-ba0f-653065be6f5c-installation-pull-secrets\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.511375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511260 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65t9q\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-kube-api-access-65t9q\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.511375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.511268 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc51ff15-ec8a-4469-ba0f-653065be6f5c-registry-tls\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:18.684262 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.684241 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bb6cb977-mqvvv"] Jul 23 18:32:18.690223 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.690200 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77bb6cb977-mqvvv"] Jul 23 18:32:18.806252 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:18.806225 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" path="/var/lib/kubelet/pods/dc51ff15-ec8a-4469-ba0f-653065be6f5c/volumes" Jul 23 18:32:19.016397 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:19.016366 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:19.065748 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:19.065721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:19.133561 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:19.133519 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:32:19.368295 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:19.368225 2564 generic.go:356] "Generic (PLEG): container finished" podID="67a0a55e-9638-4aab-9284-945a0e481fa4" containerID="650cce86d8aa030e12fa8a2ad0a39f2c7d59442bdbdddf8061caf50aa4e48223" exitCode=0 Jul 23 18:32:19.368295 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:19.368289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" event={"ID":"67a0a55e-9638-4aab-9284-945a0e481fa4","Type":"ContainerDied","Data":"650cce86d8aa030e12fa8a2ad0a39f2c7d59442bdbdddf8061caf50aa4e48223"} Jul 23 18:32:19.368726 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:19.368602 2564 scope.go:117] "RemoveContainer" containerID="650cce86d8aa030e12fa8a2ad0a39f2c7d59442bdbdddf8061caf50aa4e48223" Jul 23 18:32:20.373822 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:20.373787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-wdpjf" event={"ID":"67a0a55e-9638-4aab-9284-945a0e481fa4","Type":"ContainerStarted","Data":"d25126bceada1569fb544fcd8ed03f1390781c58a71c8ca6d097a2a0c9d3e38c"} Jul 23 18:32:25.515086 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:25.515057 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:27.402169 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:27.402134 2564 generic.go:356] "Generic (PLEG): container finished" podID="92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169" containerID="c6832fd6818e459a94a5560e8ab97ea74a76181df4ef31e8b77f64530facde5e" exitCode=0 Jul 23 18:32:27.402542 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:27.402208 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" event={"ID":"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169","Type":"ContainerDied","Data":"c6832fd6818e459a94a5560e8ab97ea74a76181df4ef31e8b77f64530facde5e"} Jul 23 18:32:27.402542 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:27.402514 2564 scope.go:117] "RemoveContainer" containerID="c6832fd6818e459a94a5560e8ab97ea74a76181df4ef31e8b77f64530facde5e" Jul 23 18:32:28.408720 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:28.408686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-rgsxb" event={"ID":"92e4dd1d-fe7c-4f1c-b2a2-076db1ed2169","Type":"ContainerStarted","Data":"3edcc8005955369cf451ad388976e3719c70003f289fd8d198ea8e179d933d6a"} Jul 23 18:32:29.025343 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:29.025308 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:32.008287 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.008213 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7f6d46d8-fprvc" podUID="9759a85d-fcf8-4b56-804b-9b0556a0e30f" containerName="console" containerID="cri-o://1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb" gracePeriod=15 Jul 23 18:32:32.289631 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.289594 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:32:32.428817 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.428783 2564 generic.go:356] "Generic (PLEG): container finished" podID="9759a85d-fcf8-4b56-804b-9b0556a0e30f" containerID="1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb" exitCode=0 Jul 23 18:32:32.429005 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.428837 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7f6d46d8-fprvc" Jul 23 18:32:32.429005 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.428867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f6d46d8-fprvc" event={"ID":"9759a85d-fcf8-4b56-804b-9b0556a0e30f","Type":"ContainerDied","Data":"1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb"} Jul 23 18:32:32.429005 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.428932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7f6d46d8-fprvc" event={"ID":"9759a85d-fcf8-4b56-804b-9b0556a0e30f","Type":"ContainerDied","Data":"17a3f56b848db4f793485eb7e27024228d10296d1606a527ed08886613c7d522"} Jul 23 18:32:32.429005 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.428955 2564 scope.go:117] "RemoveContainer" containerID="1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb" Jul 23 18:32:32.435466 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435441 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk29f\" (UniqueName: \"kubernetes.io/projected/9759a85d-fcf8-4b56-804b-9b0556a0e30f-kube-api-access-qk29f\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435592 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435507 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-config\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435592 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-service-ca\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435592 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435578 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-oauth-serving-cert\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435751 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435638 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-trusted-ca-bundle\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435751 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435704 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-oauth-config\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435751 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435738 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-serving-cert\") pod \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\" (UID: \"9759a85d-fcf8-4b56-804b-9b0556a0e30f\") " Jul 23 18:32:32.435990 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.435924 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:32.436045 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.436015 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-service-ca\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.436045 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.436020 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:32.436215 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.436188 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:32.436443 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.436421 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-config" (OuterVolumeSpecName: "console-config") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:32.437612 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.437594 2564 scope.go:117] "RemoveContainer" containerID="1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb" Jul 23 18:32:32.437933 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:32.437915 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb\": container with ID starting with 1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb not found: ID does not exist" containerID="1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb" Jul 23 18:32:32.438022 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.437940 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb"} err="failed to get container status \"1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb\": rpc error: code = NotFound desc = could not find container \"1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb\": container with ID starting with 1bd25ba91c113e306e480e572dd4c3e0b11725d8b2de7ca3697fb06c83df75fb not found: ID does not exist" Jul 23 18:32:32.438313 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.438288 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:32:32.438313 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.438303 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:32:32.438733 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.438715 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9759a85d-fcf8-4b56-804b-9b0556a0e30f-kube-api-access-qk29f" (OuterVolumeSpecName: "kube-api-access-qk29f") pod "9759a85d-fcf8-4b56-804b-9b0556a0e30f" (UID: "9759a85d-fcf8-4b56-804b-9b0556a0e30f"). InnerVolumeSpecName "kube-api-access-qk29f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:32.537177 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.537100 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-trusted-ca-bundle\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.537177 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.537131 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-oauth-config\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.537177 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.537141 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-serving-cert\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.537177 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.537151 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk29f\" (UniqueName: \"kubernetes.io/projected/9759a85d-fcf8-4b56-804b-9b0556a0e30f-kube-api-access-qk29f\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.537177 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.537163 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-console-config\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.537177 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.537177 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9759a85d-fcf8-4b56-804b-9b0556a0e30f-oauth-serving-cert\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:32:32.749949 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.749908 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7f6d46d8-fprvc"] Jul 23 18:32:32.753397 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.753372 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7f6d46d8-fprvc"] Jul 23 18:32:32.806151 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:32.806087 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9759a85d-fcf8-4b56-804b-9b0556a0e30f" path="/var/lib/kubelet/pods/9759a85d-fcf8-4b56-804b-9b0556a0e30f/volumes" Jul 23 18:32:39.067483 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:39.067452 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:40.493079 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:40.493039 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:49.110636 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:49.110601 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:54.374874 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:54.374833 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:32:54.395308 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:54.395280 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:32:54.532648 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:32:54.532622 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:32:55.530046 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:55.530015 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:32:59.119230 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:32:59.119155 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:33:03.934472 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:03.934432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:04.024351 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:04.024305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:09.127511 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:33:09.127477 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:33:10.476424 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:33:10.476339 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:33:11.525717 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:33:11.525683 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:33:11.525717 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:33:11.525716 2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc51ff15_ec8a_4469_ba0f_653065be6f5c.slice\": RecentStats: unable to find data in memory cache]" Jul 23 18:33:11.932944 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:11.932846 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:12.030475 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:12.030439 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:15.811850 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:15.811810 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:15.877363 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:15.877333 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:19.069851 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:19.069816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:19.168389 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:19.168351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:22.572396 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:22.572365 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:22.672046 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:22.672007 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:22.727593 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:22.727562 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:47.234056 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:47.234017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:48.370052 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:48.370018 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:33:48.472978 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:33:48.472944 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:34:45.247378 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:34:45.247302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:34:45.342818 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:34:45.342755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:12.021080 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:12.021047 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:12.860381 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:12.860348 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:15.596034 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:15.595998 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:15.696623 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:15.696582 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:17.149780 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:17.149737 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:17.257963 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:17.257931 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:17.372203 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:17.372167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:18.665841 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:18.665814 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 18:35:19.554871 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:19.554830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:19.784776 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:19.784723 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:22.392332 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:22.392298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:24.048017 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:24.047981 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:27.334566 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:27.334532 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:28.439973 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:28.439941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:28.536671 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:28.536640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:35.741820 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:35.741789 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:35.908510 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:35.908471 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:38.221777 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:38.221716 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:41.688741 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:41.688698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:49.604602 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:49.604567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:49.708815 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:49.708783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:50.294802 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.294740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:50.531744 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.531694 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:50.619909 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.619836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:50.649372 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649345 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h"] Jul 23 18:35:50.649681 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649668 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" containerName="registry" Jul 23 18:35:50.649725 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649683 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" containerName="registry" Jul 23 18:35:50.649725 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649692 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d656ae-6f89-47c0-beee-465173dc7a61" containerName="console" Jul 23 18:35:50.649725 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649698 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d656ae-6f89-47c0-beee-465173dc7a61" containerName="console" Jul 23 18:35:50.649725 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649718 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9759a85d-fcf8-4b56-804b-9b0556a0e30f" containerName="console" Jul 23 18:35:50.649725 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649724 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9759a85d-fcf8-4b56-804b-9b0556a0e30f" containerName="console" Jul 23 18:35:50.649899 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649796 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc51ff15-ec8a-4469-ba0f-653065be6f5c" containerName="registry" Jul 23 18:35:50.649899 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649808 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9759a85d-fcf8-4b56-804b-9b0556a0e30f" containerName="console" Jul 23 18:35:50.649899 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.649818 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d656ae-6f89-47c0-beee-465173dc7a61" containerName="console" Jul 23 18:35:50.651617 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.651600 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.654504 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.654475 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 18:35:50.654790 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.654774 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 18:35:50.654885 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.654866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ldd2q\"" Jul 23 18:35:50.655085 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.655073 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 18:35:50.655330 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.655318 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 18:35:50.671449 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.671430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h"] Jul 23 18:35:50.776379 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.776351 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghft9\" (UniqueName: \"kubernetes.io/projected/da4f0214-1b23-43be-8e3d-7d48ef76cb73-kube-api-access-ghft9\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.776538 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.776383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da4f0214-1b23-43be-8e3d-7d48ef76cb73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.776538 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.776410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da4f0214-1b23-43be-8e3d-7d48ef76cb73-tmp\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.776538 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.776452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da4f0214-1b23-43be-8e3d-7d48ef76cb73-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.776538 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.776518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da4f0214-1b23-43be-8e3d-7d48ef76cb73-manifests\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.787384 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.787352 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:50.877895 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.877819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da4f0214-1b23-43be-8e3d-7d48ef76cb73-tmp\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.877895 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.877861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da4f0214-1b23-43be-8e3d-7d48ef76cb73-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.878083 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.877939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da4f0214-1b23-43be-8e3d-7d48ef76cb73-manifests\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.878083 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.877986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghft9\" (UniqueName: \"kubernetes.io/projected/da4f0214-1b23-43be-8e3d-7d48ef76cb73-kube-api-access-ghft9\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.878083 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.878015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da4f0214-1b23-43be-8e3d-7d48ef76cb73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.878308 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.878288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da4f0214-1b23-43be-8e3d-7d48ef76cb73-manifests\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.880151 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.880130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da4f0214-1b23-43be-8e3d-7d48ef76cb73-tmp\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.880345 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.880324 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da4f0214-1b23-43be-8e3d-7d48ef76cb73-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.880419 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.880404 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da4f0214-1b23-43be-8e3d-7d48ef76cb73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.887133 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.887105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:50.887514 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.887488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghft9\" (UniqueName: \"kubernetes.io/projected/da4f0214-1b23-43be-8e3d-7d48ef76cb73-kube-api-access-ghft9\") pod \"opendatahub-operator-controller-manager-b6c6445bc-fbq5h\" (UID: \"da4f0214-1b23-43be-8e3d-7d48ef76cb73\") " pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:50.961771 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:50.961728 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:51.010574 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:51.010537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:51.102273 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:51.102241 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:51.103265 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:51.103244 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h"] Jul 23 18:35:51.107366 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:35:51.107343 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4f0214_1b23_43be_8e3d_7d48ef76cb73.slice/crio-b7bfb94364287a9bde42c8a363aa2cef52eb9bf42da5413cc6eea14276c817e4 WatchSource:0}: Error finding container b7bfb94364287a9bde42c8a363aa2cef52eb9bf42da5413cc6eea14276c817e4: Status 404 returned error can't find the container with id b7bfb94364287a9bde42c8a363aa2cef52eb9bf42da5413cc6eea14276c817e4 Jul 23 18:35:51.109202 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:51.109182 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:35:51.167691 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:51.167628 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:51.182320 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:51.182298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" event={"ID":"da4f0214-1b23-43be-8e3d-7d48ef76cb73","Type":"ContainerStarted","Data":"b7bfb94364287a9bde42c8a363aa2cef52eb9bf42da5413cc6eea14276c817e4"} Jul 23 18:35:54.564170 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:54.564141 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:54.738001 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:54.737961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:35:55.201918 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:55.201887 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" event={"ID":"da4f0214-1b23-43be-8e3d-7d48ef76cb73","Type":"ContainerStarted","Data":"4eddc11148a7a85eb7084af0a7f253e557009cbf023b45c51123257e1e0322cf"} Jul 23 18:35:56.207347 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:56.207312 2564 generic.go:356] "Generic (PLEG): container finished" podID="da4f0214-1b23-43be-8e3d-7d48ef76cb73" containerID="4eddc11148a7a85eb7084af0a7f253e557009cbf023b45c51123257e1e0322cf" exitCode=0 Jul 23 18:35:56.207844 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:56.207397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" event={"ID":"da4f0214-1b23-43be-8e3d-7d48ef76cb73","Type":"ContainerDied","Data":"4eddc11148a7a85eb7084af0a7f253e557009cbf023b45c51123257e1e0322cf"} Jul 23 18:35:57.213809 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:57.213755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" event={"ID":"da4f0214-1b23-43be-8e3d-7d48ef76cb73","Type":"ContainerStarted","Data":"071d227545ce3a01a41274c0e3c0ca1904117b6cbe6c8d2a4df257688729eebb"} Jul 23 18:35:57.214154 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:57.213857 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:35:57.240249 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:35:57.240208 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" podStartSLOduration=2.801124968 podStartE2EDuration="7.240194833s" totalImagesPullingTime="3.34596014s" totalInitContainerRuntime="1.093109725s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:57.237755267 +0000 UTC m=+339.003853085" watchObservedRunningTime="2026-07-23 18:35:57.240194833 +0000 UTC m=+339.006292654" Jul 23 18:36:08.219891 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:08.219858 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b6c6445bc-fbq5h" Jul 23 18:36:10.121502 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.121472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:10.288416 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.288380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:10.704432 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.704395 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:10.777087 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.777054 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8599469554-c9jtv"] Jul 23 18:36:10.780273 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.780252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.784924 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.784905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 18:36:10.785509 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.785489 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 18:36:10.785509 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.785508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 18:36:10.785840 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.785789 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 18:36:10.808089 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.808069 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8599469554-c9jtv"] Jul 23 18:36:10.841075 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.841050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a959e22-acec-471a-bfd5-a5961657604d-tls-certs\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.841175 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.841081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a959e22-acec-471a-bfd5-a5961657604d-tmp\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.841175 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.841108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hv8d\" (UniqueName: \"kubernetes.io/projected/6a959e22-acec-471a-bfd5-a5961657604d-kube-api-access-8hv8d\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.914495 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.914464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:10.941514 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.941492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a959e22-acec-471a-bfd5-a5961657604d-tls-certs\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.941603 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.941521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a959e22-acec-471a-bfd5-a5961657604d-tmp\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.941603 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.941548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hv8d\" (UniqueName: \"kubernetes.io/projected/6a959e22-acec-471a-bfd5-a5961657604d-kube-api-access-8hv8d\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.943788 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.943740 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a959e22-acec-471a-bfd5-a5961657604d-tmp\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.943915 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.943899 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a959e22-acec-471a-bfd5-a5961657604d-tls-certs\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:10.954903 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:10.954855 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hv8d\" (UniqueName: \"kubernetes.io/projected/6a959e22-acec-471a-bfd5-a5961657604d-kube-api-access-8hv8d\") pod \"kube-auth-proxy-8599469554-c9jtv\" (UID: \"6a959e22-acec-471a-bfd5-a5961657604d\") " pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:11.089849 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.089814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" Jul 23 18:36:11.179209 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.179157 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:11.252254 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:36:11.252211 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a959e22_acec_471a_bfd5_a5961657604d.slice/crio-93863a99fd669c4f36a74c85397a366510329328e560e47de1657279f3de8b08 WatchSource:0}: Error finding container 93863a99fd669c4f36a74c85397a366510329328e560e47de1657279f3de8b08: Status 404 returned error can't find the container with id 93863a99fd669c4f36a74c85397a366510329328e560e47de1657279f3de8b08 Jul 23 18:36:11.253523 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.253502 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8599469554-c9jtv"] Jul 23 18:36:11.271027 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.271000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" event={"ID":"6a959e22-acec-471a-bfd5-a5961657604d","Type":"ContainerStarted","Data":"93863a99fd669c4f36a74c85397a366510329328e560e47de1657279f3de8b08"} Jul 23 18:36:11.369411 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.369374 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874"] Jul 23 18:36:11.373694 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.373672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.379304 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.379280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 18:36:11.379422 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.379309 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4lsqt\"" Jul 23 18:36:11.379563 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.379550 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 18:36:11.379937 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.379896 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 18:36:11.386454 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.386434 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:36:11.386678 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.386662 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 18:36:11.399318 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.399295 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874"] Jul 23 18:36:11.445077 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.445056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvtz\" (UniqueName: \"kubernetes.io/projected/5d76c3b7-4762-46a1-afc9-80da1e862c7c-kube-api-access-wqvtz\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.445179 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.445102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d76c3b7-4762-46a1-afc9-80da1e862c7c-metrics-cert\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.445179 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.445162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d76c3b7-4762-46a1-afc9-80da1e862c7c-cert\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.445262 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.445183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d76c3b7-4762-46a1-afc9-80da1e862c7c-manager-config\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.478216 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.478190 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:11.545779 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.545681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d76c3b7-4762-46a1-afc9-80da1e862c7c-metrics-cert\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.545779 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.545733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d76c3b7-4762-46a1-afc9-80da1e862c7c-cert\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.545779 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.545779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d76c3b7-4762-46a1-afc9-80da1e862c7c-manager-config\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.546062 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.545804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvtz\" (UniqueName: \"kubernetes.io/projected/5d76c3b7-4762-46a1-afc9-80da1e862c7c-kube-api-access-wqvtz\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.546489 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.546464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d76c3b7-4762-46a1-afc9-80da1e862c7c-manager-config\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.548180 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.548157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d76c3b7-4762-46a1-afc9-80da1e862c7c-cert\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.548261 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.548236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d76c3b7-4762-46a1-afc9-80da1e862c7c-metrics-cert\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.554150 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.554131 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvtz\" (UniqueName: \"kubernetes.io/projected/5d76c3b7-4762-46a1-afc9-80da1e862c7c-kube-api-access-wqvtz\") pod \"lws-controller-manager-775d4b7f7f-6t874\" (UID: \"5d76c3b7-4762-46a1-afc9-80da1e862c7c\") " pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.566812 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.566782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:11.668448 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.668420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:11.683068 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.683042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:11.835856 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.835776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874"] Jul 23 18:36:11.931313 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:11.931287 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:12.114197 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:12.114120 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:12.277741 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:12.277700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" event={"ID":"5d76c3b7-4762-46a1-afc9-80da1e862c7c","Type":"ContainerStarted","Data":"f457cb22aad289ecfd43503776f1c62d0229788746692054454fc5add6e1f8b2"} Jul 23 18:36:12.348598 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:12.348544 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:12.907360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:12.907284 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:13.051224 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:13.051169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:13.290111 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:13.290067 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:13.420043 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:13.420006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:15.295219 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:15.295131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" event={"ID":"5d76c3b7-4762-46a1-afc9-80da1e862c7c","Type":"ContainerStarted","Data":"3067cae1626f29be8b4fb45e38eee7004ea599e802c8ee9a3087201f3a5c5832"} Jul 23 18:36:15.295639 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:15.295274 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:15.296607 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:15.296586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" event={"ID":"6a959e22-acec-471a-bfd5-a5961657604d","Type":"ContainerStarted","Data":"9fd7abdb1c1f8d38cf35fa9c42c2a2e1aac7e3f3405f0a9466f685417e739b52"} Jul 23 18:36:15.397182 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:15.397121 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8599469554-c9jtv" podStartSLOduration=1.653616765 podStartE2EDuration="5.397103605s" totalImagesPullingTime="3.74348684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:15.396297922 +0000 UTC m=+357.162395744" watchObservedRunningTime="2026-07-23 18:36:15.397103605 +0000 UTC m=+357.163201427" Jul 23 18:36:15.397324 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:15.397232 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" podStartSLOduration=1.183874841 podStartE2EDuration="4.397226504s" totalImagesPullingTime="3.213351663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:15.348100782 +0000 UTC m=+357.114198603" watchObservedRunningTime="2026-07-23 18:36:15.397226504 +0000 UTC m=+357.163324325" Jul 23 18:36:15.446562 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:15.446537 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:20.466470 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:20.466437 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:20.759363 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:20.759274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:22.710365 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:22.710333 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:22.883605 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:22.883567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:23.127821 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:23.127733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:25.537306 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:25.537275 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:25.702407 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:25.702380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:25.898994 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:25.898917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:26.049011 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:26.048978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:26.303872 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:26.303847 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-775d4b7f7f-6t874" Jul 23 18:36:26.943013 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:26.942980 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:27.532442 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:27.532409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:36.474831 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:36.474794 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:36.553377 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:36.553344 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:57.343896 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:57.343861 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:57.443877 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:57.443844 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:57.547796 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:57.547748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:58.077528 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:58.077494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:36:58.178087 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:36:58.178037 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:08.753280 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:08.753243 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:08.853205 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:08.853173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:10.691626 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:10.691589 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:10.796751 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:10.796698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:11.571245 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:11.571215 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:11.672374 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:11.672328 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:11.784496 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:11.784449 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:12.512675 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:12.512642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:12.708910 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:12.708878 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:39.017224 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:39.017189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:39.119143 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:39.119105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:39.703443 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:39.703409 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:40.939024 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:40.938945 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:44.549192 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:44.549156 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:47.586635 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:47.586600 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:49.384961 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:49.384924 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:49.550472 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:49.550438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:49.936194 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:49.936163 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:52.463653 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:52.463620 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:52.598082 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:52.598044 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:53.322987 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:53.322956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:55.249745 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:55.249703 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:56.764862 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:56.764824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:57.019120 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:57.019025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:58.731872 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.731841 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc"] Jul 23 18:37:58.735069 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.735051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:58.737547 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.737526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 18:37:58.737659 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.737526 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kvqqb\"" Jul 23 18:37:58.737659 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.737567 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 18:37:58.738354 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.738334 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 23 18:37:58.738461 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.738336 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 23 18:37:58.751322 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.751294 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:58.755396 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.755373 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc"] Jul 23 18:37:58.843204 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.843173 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:37:58.916315 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.916291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c680fd2-c74e-4385-b16e-1e21c2b98b49-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:58.916433 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.916413 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsxpn\" (UniqueName: \"kubernetes.io/projected/5c680fd2-c74e-4385-b16e-1e21c2b98b49-kube-api-access-jsxpn\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:58.916504 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:58.916479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c680fd2-c74e-4385-b16e-1e21c2b98b49-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.017575 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.017496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c680fd2-c74e-4385-b16e-1e21c2b98b49-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.017575 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.017539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c680fd2-c74e-4385-b16e-1e21c2b98b49-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.017804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.017620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsxpn\" (UniqueName: \"kubernetes.io/projected/5c680fd2-c74e-4385-b16e-1e21c2b98b49-kube-api-access-jsxpn\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.018232 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.018208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c680fd2-c74e-4385-b16e-1e21c2b98b49-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.019919 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.019903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c680fd2-c74e-4385-b16e-1e21c2b98b49-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.033037 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.033017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsxpn\" (UniqueName: \"kubernetes.io/projected/5c680fd2-c74e-4385-b16e-1e21c2b98b49-kube-api-access-jsxpn\") pod \"kuadrant-console-plugin-66b5774985-8rwnc\" (UID: \"5c680fd2-c74e-4385-b16e-1e21c2b98b49\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.044912 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.044894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" Jul 23 18:37:59.188382 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.188354 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc"] Jul 23 18:37:59.192183 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:37:59.192148 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c680fd2_c74e_4385_b16e_1e21c2b98b49.slice/crio-a269dc45d3de9936bddc165e1ffaf7418aa5a0a7d1c6ab0541c34f56821d97eb WatchSource:0}: Error finding container a269dc45d3de9936bddc165e1ffaf7418aa5a0a7d1c6ab0541c34f56821d97eb: Status 404 returned error can't find the container with id a269dc45d3de9936bddc165e1ffaf7418aa5a0a7d1c6ab0541c34f56821d97eb Jul 23 18:37:59.748461 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:37:59.748426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" event={"ID":"5c680fd2-c74e-4385-b16e-1e21c2b98b49","Type":"ContainerStarted","Data":"a269dc45d3de9936bddc165e1ffaf7418aa5a0a7d1c6ab0541c34f56821d97eb"} Jul 23 18:38:00.521733 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:00.521703 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:00.586977 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:00.586942 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:09.184968 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:09.184926 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:09.321022 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:09.320987 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:09.486953 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:09.486894 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:12.290890 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:12.290848 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:12.535210 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:12.535164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:15.624520 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:15.624461 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:16.532802 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:16.532736 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:18.879870 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:18.879832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:18.987009 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:18.986977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:19.391828 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:19.391790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:19.532201 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:19.532162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:22.874566 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:22.874526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" event={"ID":"5c680fd2-c74e-4385-b16e-1e21c2b98b49","Type":"ContainerStarted","Data":"4b8998a29474945cceb529bfc29e1b38796d4bccacc3932799c92e1f6b05fbe5"} Jul 23 18:38:22.917734 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:22.917688 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8rwnc" podStartSLOduration=2.130777844 podStartE2EDuration="24.917664696s" totalImagesPullingTime="22.786886852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:38:22.917637739 +0000 UTC m=+484.683735560" watchObservedRunningTime="2026-07-23 18:38:22.917664696 +0000 UTC m=+484.683762520" Jul 23 18:38:29.012017 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:29.011978 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:29.122538 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:29.122511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:32.091284 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:32.091254 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:32.270255 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:32.270221 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:38.287571 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:38.287536 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:38.458276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:38.458247 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:40.339842 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:40.339809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:40.525848 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:40.525813 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:41.050487 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.050456 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:38:41.054740 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.054724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.060228 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.060206 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 18:38:41.070100 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.070082 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:38:41.125097 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.125076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:38:41.189475 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.189447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdf9\" (UniqueName: \"kubernetes.io/projected/f51182d2-7673-49b4-915d-3aa38c429ec6-kube-api-access-6fdf9\") pod \"limitador-limitador-54d6d988d5-kn6fj\" (UID: \"f51182d2-7673-49b4-915d-3aa38c429ec6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.189597 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.189508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f51182d2-7673-49b4-915d-3aa38c429ec6-config-file\") pod \"limitador-limitador-54d6d988d5-kn6fj\" (UID: \"f51182d2-7673-49b4-915d-3aa38c429ec6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.290978 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.290947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdf9\" (UniqueName: \"kubernetes.io/projected/f51182d2-7673-49b4-915d-3aa38c429ec6-kube-api-access-6fdf9\") pod \"limitador-limitador-54d6d988d5-kn6fj\" (UID: \"f51182d2-7673-49b4-915d-3aa38c429ec6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.291098 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.290999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f51182d2-7673-49b4-915d-3aa38c429ec6-config-file\") pod \"limitador-limitador-54d6d988d5-kn6fj\" (UID: \"f51182d2-7673-49b4-915d-3aa38c429ec6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.291661 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.291641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f51182d2-7673-49b4-915d-3aa38c429ec6-config-file\") pod \"limitador-limitador-54d6d988d5-kn6fj\" (UID: \"f51182d2-7673-49b4-915d-3aa38c429ec6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.310375 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.310309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdf9\" (UniqueName: \"kubernetes.io/projected/f51182d2-7673-49b4-915d-3aa38c429ec6-kube-api-access-6fdf9\") pod \"limitador-limitador-54d6d988d5-kn6fj\" (UID: \"f51182d2-7673-49b4-915d-3aa38c429ec6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.328812 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.328789 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r5vsp"] Jul 23 18:38:41.332199 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.332182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:41.335020 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.335005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-khzqt\"" Jul 23 18:38:41.353875 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.353850 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r5vsp"] Jul 23 18:38:41.364476 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.364458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:41.384259 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.384231 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:41.493442 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.493400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9g4\" (UniqueName: \"kubernetes.io/projected/d4f586e7-b04c-4701-aa45-ff73f376ee92-kube-api-access-bs9g4\") pod \"authorino-58cd955675-r5vsp\" (UID: \"d4f586e7-b04c-4701-aa45-ff73f376ee92\") " pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:41.511542 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.511512 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:38:41.512851 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.512820 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:38:41.594449 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.594387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9g4\" (UniqueName: \"kubernetes.io/projected/d4f586e7-b04c-4701-aa45-ff73f376ee92-kube-api-access-bs9g4\") pod \"authorino-58cd955675-r5vsp\" (UID: \"d4f586e7-b04c-4701-aa45-ff73f376ee92\") " pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:41.603171 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.603144 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9g4\" (UniqueName: \"kubernetes.io/projected/d4f586e7-b04c-4701-aa45-ff73f376ee92-kube-api-access-bs9g4\") pod \"authorino-58cd955675-r5vsp\" (UID: \"d4f586e7-b04c-4701-aa45-ff73f376ee92\") " pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:41.641206 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.641176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:41.788108 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.788072 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r5vsp"] Jul 23 18:38:41.792010 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:38:41.791979 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4f586e7_b04c_4701_aa45_ff73f376ee92.slice/crio-66c051d138bfa2eddf203c567c7f752f0c924dd985a4e9d9cfb506fc4439735d WatchSource:0}: Error finding container 66c051d138bfa2eddf203c567c7f752f0c924dd985a4e9d9cfb506fc4439735d: Status 404 returned error can't find the container with id 66c051d138bfa2eddf203c567c7f752f0c924dd985a4e9d9cfb506fc4439735d Jul 23 18:38:41.955910 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.955875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" event={"ID":"f51182d2-7673-49b4-915d-3aa38c429ec6","Type":"ContainerStarted","Data":"0b04b4fd8d945bd8529848e4a40915f813378d2d6155f0dc897783a7cf3afd3e"} Jul 23 18:38:41.957072 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:41.957049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r5vsp" event={"ID":"d4f586e7-b04c-4701-aa45-ff73f376ee92","Type":"ContainerStarted","Data":"66c051d138bfa2eddf203c567c7f752f0c924dd985a4e9d9cfb506fc4439735d"} Jul 23 18:38:46.139388 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:46.139356 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r5vsp"] Jul 23 18:38:47.990026 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:47.989992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" event={"ID":"f51182d2-7673-49b4-915d-3aa38c429ec6","Type":"ContainerStarted","Data":"82f68a570dc11a8425ed5d98f254b360f60827b2e1a022e3a29f51d5a571517a"} Jul 23 18:38:47.990461 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:47.990139 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:38:47.991514 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:47.991494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r5vsp" event={"ID":"d4f586e7-b04c-4701-aa45-ff73f376ee92","Type":"ContainerStarted","Data":"4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5"} Jul 23 18:38:47.991593 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:47.991550 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r5vsp" podUID="d4f586e7-b04c-4701-aa45-ff73f376ee92" containerName="authorino" containerID="cri-o://4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5" gracePeriod=30 Jul 23 18:38:48.014098 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.014054 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" podStartSLOduration=1.355436644 podStartE2EDuration="7.014040315s" totalImagesPullingTime="5.658603671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:38:48.011697818 +0000 UTC m=+509.777795642" watchObservedRunningTime="2026-07-23 18:38:48.014040315 +0000 UTC m=+509.780138197" Jul 23 18:38:48.034474 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.034429 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r5vsp" podStartSLOduration=1.6488928619999998 podStartE2EDuration="7.034414869s" totalImagesPullingTime="5.385522007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:38:48.033892693 +0000 UTC m=+509.799990515" watchObservedRunningTime="2026-07-23 18:38:48.034414869 +0000 UTC m=+509.800512689" Jul 23 18:38:48.233289 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.233263 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:48.359183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.359121 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs9g4\" (UniqueName: \"kubernetes.io/projected/d4f586e7-b04c-4701-aa45-ff73f376ee92-kube-api-access-bs9g4\") pod \"d4f586e7-b04c-4701-aa45-ff73f376ee92\" (UID: \"d4f586e7-b04c-4701-aa45-ff73f376ee92\") " Jul 23 18:38:48.361205 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.361171 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f586e7-b04c-4701-aa45-ff73f376ee92-kube-api-access-bs9g4" (OuterVolumeSpecName: "kube-api-access-bs9g4") pod "d4f586e7-b04c-4701-aa45-ff73f376ee92" (UID: "d4f586e7-b04c-4701-aa45-ff73f376ee92"). InnerVolumeSpecName "kube-api-access-bs9g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:38:48.460408 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.460381 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs9g4\" (UniqueName: \"kubernetes.io/projected/d4f586e7-b04c-4701-aa45-ff73f376ee92-kube-api-access-bs9g4\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:38:48.997019 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.996988 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4f586e7-b04c-4701-aa45-ff73f376ee92" containerID="4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5" exitCode=0 Jul 23 18:38:48.997486 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.997033 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r5vsp" Jul 23 18:38:48.997486 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.997078 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r5vsp" event={"ID":"d4f586e7-b04c-4701-aa45-ff73f376ee92","Type":"ContainerDied","Data":"4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5"} Jul 23 18:38:48.997486 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.997120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r5vsp" event={"ID":"d4f586e7-b04c-4701-aa45-ff73f376ee92","Type":"ContainerDied","Data":"66c051d138bfa2eddf203c567c7f752f0c924dd985a4e9d9cfb506fc4439735d"} Jul 23 18:38:48.997486 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:48.997137 2564 scope.go:117] "RemoveContainer" containerID="4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5" Jul 23 18:38:49.005211 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:49.005185 2564 scope.go:117] "RemoveContainer" containerID="4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5" Jul 23 18:38:49.005484 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:38:49.005463 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5\": container with ID starting with 4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5 not found: ID does not exist" containerID="4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5" Jul 23 18:38:49.005546 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:49.005491 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5"} err="failed to get container status \"4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5\": rpc error: code = NotFound desc = could not find container \"4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5\": container with ID starting with 4f982b5dfa871fde5456e1254135f9a622c810cee958f290cde6724cc6faffc5 not found: ID does not exist" Jul 23 18:38:49.040399 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:49.040373 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r5vsp"] Jul 23 18:38:49.048360 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:49.048340 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r5vsp"] Jul 23 18:38:50.806504 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:50.806471 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f586e7-b04c-4701-aa45-ff73f376ee92" path="/var/lib/kubelet/pods/d4f586e7-b04c-4701-aa45-ff73f376ee92/volumes" Jul 23 18:38:58.999574 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:38:58.999546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kn6fj" Jul 23 18:39:01.668192 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:01.668140 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:02.020831 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:02.020754 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:02.314343 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:02.314250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:15.127000 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.126934 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:15.347208 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.347177 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nddnj"] Jul 23 18:39:15.347515 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.347504 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f586e7-b04c-4701-aa45-ff73f376ee92" containerName="authorino" Jul 23 18:39:15.347558 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.347517 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f586e7-b04c-4701-aa45-ff73f376ee92" containerName="authorino" Jul 23 18:39:15.347596 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.347587 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f586e7-b04c-4701-aa45-ff73f376ee92" containerName="authorino" Jul 23 18:39:15.355611 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.355589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:15.358671 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.358644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nddnj"] Jul 23 18:39:15.359193 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.359175 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-khzqt\"" Jul 23 18:39:15.469665 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.469641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmqr\" (UniqueName: \"kubernetes.io/projected/4d57da87-2a20-45ab-adb0-5a46ec93ca3f-kube-api-access-pcmqr\") pod \"authorino-5d4b67c446-nddnj\" (UID: \"4d57da87-2a20-45ab-adb0-5a46ec93ca3f\") " pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:15.570497 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.570465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmqr\" (UniqueName: \"kubernetes.io/projected/4d57da87-2a20-45ab-adb0-5a46ec93ca3f-kube-api-access-pcmqr\") pod \"authorino-5d4b67c446-nddnj\" (UID: \"4d57da87-2a20-45ab-adb0-5a46ec93ca3f\") " pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:15.575327 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.575303 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nddnj"] Jul 23 18:39:15.575524 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:39:15.575505 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pcmqr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-nddnj" podUID="4d57da87-2a20-45ab-adb0-5a46ec93ca3f" Jul 23 18:39:15.582991 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.582968 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmqr\" (UniqueName: \"kubernetes.io/projected/4d57da87-2a20-45ab-adb0-5a46ec93ca3f-kube-api-access-pcmqr\") pod \"authorino-5d4b67c446-nddnj\" (UID: \"4d57da87-2a20-45ab-adb0-5a46ec93ca3f\") " pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:15.602671 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.602646 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bc6868686-pptpp"] Jul 23 18:39:15.636664 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.636644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bc6868686-pptpp"] Jul 23 18:39:15.636781 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.636727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:15.671433 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.671411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7sl\" (UniqueName: \"kubernetes.io/projected/810167a4-6f2a-4bf2-8995-b6fa84f33154-kube-api-access-pq7sl\") pod \"authorino-5bc6868686-pptpp\" (UID: \"810167a4-6f2a-4bf2-8995-b6fa84f33154\") " pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:15.723133 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.723058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:15.772055 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.772024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7sl\" (UniqueName: \"kubernetes.io/projected/810167a4-6f2a-4bf2-8995-b6fa84f33154-kube-api-access-pq7sl\") pod \"authorino-5bc6868686-pptpp\" (UID: \"810167a4-6f2a-4bf2-8995-b6fa84f33154\") " pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:15.781800 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.781755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7sl\" (UniqueName: \"kubernetes.io/projected/810167a4-6f2a-4bf2-8995-b6fa84f33154-kube-api-access-pq7sl\") pod \"authorino-5bc6868686-pptpp\" (UID: \"810167a4-6f2a-4bf2-8995-b6fa84f33154\") " pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:15.945674 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:15.945644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:16.109657 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.109576 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bc6868686-pptpp"] Jul 23 18:39:16.111968 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:39:16.111941 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod810167a4_6f2a_4bf2_8995_b6fa84f33154.slice/crio-6bbb7d997fcc1bb785ee4b176986c5fd1c57e56222f56e83bf34613f50544e96 WatchSource:0}: Error finding container 6bbb7d997fcc1bb785ee4b176986c5fd1c57e56222f56e83bf34613f50544e96: Status 404 returned error can't find the container with id 6bbb7d997fcc1bb785ee4b176986c5fd1c57e56222f56e83bf34613f50544e96 Jul 23 18:39:16.116583 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.116562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:16.154437 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.154413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:16.275958 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.275881 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcmqr\" (UniqueName: \"kubernetes.io/projected/4d57da87-2a20-45ab-adb0-5a46ec93ca3f-kube-api-access-pcmqr\") pod \"4d57da87-2a20-45ab-adb0-5a46ec93ca3f\" (UID: \"4d57da87-2a20-45ab-adb0-5a46ec93ca3f\") " Jul 23 18:39:16.277932 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.277907 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d57da87-2a20-45ab-adb0-5a46ec93ca3f-kube-api-access-pcmqr" (OuterVolumeSpecName: "kube-api-access-pcmqr") pod "4d57da87-2a20-45ab-adb0-5a46ec93ca3f" (UID: "4d57da87-2a20-45ab-adb0-5a46ec93ca3f"). InnerVolumeSpecName "kube-api-access-pcmqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:39:16.377074 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.377048 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcmqr\" (UniqueName: \"kubernetes.io/projected/4d57da87-2a20-45ab-adb0-5a46ec93ca3f-kube-api-access-pcmqr\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:39:16.445046 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.445020 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bc6868686-pptpp"] Jul 23 18:39:16.507445 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.507415 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cb466655d-r6746"] Jul 23 18:39:16.534444 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.534384 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb466655d-r6746"] Jul 23 18:39:16.534545 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.534466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.536973 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.536956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 18:39:16.578343 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.578326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-tls-cert\") pod \"authorino-5cb466655d-r6746\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.578448 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.578359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppxhf\" (UniqueName: \"kubernetes.io/projected/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-kube-api-access-ppxhf\") pod \"authorino-5cb466655d-r6746\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.678928 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.678896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxhf\" (UniqueName: \"kubernetes.io/projected/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-kube-api-access-ppxhf\") pod \"authorino-5cb466655d-r6746\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.679061 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.679005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-tls-cert\") pod \"authorino-5cb466655d-r6746\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.681423 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.681401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-tls-cert\") pod \"authorino-5cb466655d-r6746\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.687695 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.687666 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppxhf\" (UniqueName: \"kubernetes.io/projected/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-kube-api-access-ppxhf\") pod \"authorino-5cb466655d-r6746\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:16.846091 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:16.846066 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:39:17.011912 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.011888 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cb466655d-r6746"] Jul 23 18:39:17.013596 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:39:17.013566 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbeda2fe_f6cb_4aaf_83f2_ff748726c28a.slice/crio-a3f2ac7fe86e5693e3bdbf7cb15b9c0117ecebb4e7ef95c36fade73f7af062ef WatchSource:0}: Error finding container a3f2ac7fe86e5693e3bdbf7cb15b9c0117ecebb4e7ef95c36fade73f7af062ef: Status 404 returned error can't find the container with id a3f2ac7fe86e5693e3bdbf7cb15b9c0117ecebb4e7ef95c36fade73f7af062ef Jul 23 18:39:17.123485 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.123423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb466655d-r6746" event={"ID":"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a","Type":"ContainerStarted","Data":"a3f2ac7fe86e5693e3bdbf7cb15b9c0117ecebb4e7ef95c36fade73f7af062ef"} Jul 23 18:39:17.125027 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.125001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc6868686-pptpp" event={"ID":"810167a4-6f2a-4bf2-8995-b6fa84f33154","Type":"ContainerStarted","Data":"ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249"} Jul 23 18:39:17.125139 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.125034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nddnj" Jul 23 18:39:17.125185 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.125036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc6868686-pptpp" event={"ID":"810167a4-6f2a-4bf2-8995-b6fa84f33154","Type":"ContainerStarted","Data":"6bbb7d997fcc1bb785ee4b176986c5fd1c57e56222f56e83bf34613f50544e96"} Jul 23 18:39:17.125185 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.125034 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5bc6868686-pptpp" podUID="810167a4-6f2a-4bf2-8995-b6fa84f33154" containerName="authorino" containerID="cri-o://ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249" gracePeriod=30 Jul 23 18:39:17.173236 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.173176 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bc6868686-pptpp" podStartSLOduration=1.470077747 podStartE2EDuration="2.17315609s" totalImagesPullingTime="703.078343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:17.149521613 +0000 UTC m=+538.915619436" watchObservedRunningTime="2026-07-23 18:39:17.17315609 +0000 UTC m=+538.939253911" Jul 23 18:39:17.199300 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.198725 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nddnj"] Jul 23 18:39:17.201598 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.201555 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nddnj"] Jul 23 18:39:17.405664 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.405633 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:17.486956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.486923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq7sl\" (UniqueName: \"kubernetes.io/projected/810167a4-6f2a-4bf2-8995-b6fa84f33154-kube-api-access-pq7sl\") pod \"810167a4-6f2a-4bf2-8995-b6fa84f33154\" (UID: \"810167a4-6f2a-4bf2-8995-b6fa84f33154\") " Jul 23 18:39:17.488927 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.488899 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/810167a4-6f2a-4bf2-8995-b6fa84f33154-kube-api-access-pq7sl" (OuterVolumeSpecName: "kube-api-access-pq7sl") pod "810167a4-6f2a-4bf2-8995-b6fa84f33154" (UID: "810167a4-6f2a-4bf2-8995-b6fa84f33154"). InnerVolumeSpecName "kube-api-access-pq7sl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:39:17.587607 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:17.587564 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq7sl\" (UniqueName: \"kubernetes.io/projected/810167a4-6f2a-4bf2-8995-b6fa84f33154-kube-api-access-pq7sl\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:39:18.131273 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.131234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb466655d-r6746" event={"ID":"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a","Type":"ContainerStarted","Data":"5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050"} Jul 23 18:39:18.132374 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.132347 2564 generic.go:356] "Generic (PLEG): container finished" podID="810167a4-6f2a-4bf2-8995-b6fa84f33154" containerID="ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249" exitCode=0 Jul 23 18:39:18.132498 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.132387 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc6868686-pptpp" Jul 23 18:39:18.132498 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.132417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc6868686-pptpp" event={"ID":"810167a4-6f2a-4bf2-8995-b6fa84f33154","Type":"ContainerDied","Data":"ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249"} Jul 23 18:39:18.132498 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.132449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc6868686-pptpp" event={"ID":"810167a4-6f2a-4bf2-8995-b6fa84f33154","Type":"ContainerDied","Data":"6bbb7d997fcc1bb785ee4b176986c5fd1c57e56222f56e83bf34613f50544e96"} Jul 23 18:39:18.132498 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.132468 2564 scope.go:117] "RemoveContainer" containerID="ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249" Jul 23 18:39:18.142094 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.142076 2564 scope.go:117] "RemoveContainer" containerID="ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249" Jul 23 18:39:18.142328 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:39:18.142310 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249\": container with ID starting with ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249 not found: ID does not exist" containerID="ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249" Jul 23 18:39:18.142371 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.142337 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249"} err="failed to get container status \"ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249\": rpc error: code = NotFound desc = could not find container \"ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249\": container with ID starting with ee3b547e301af5df2ddfeb43d98ab1a58c8834a9c803b19537f3f54edbe4c249 not found: ID does not exist" Jul 23 18:39:18.150198 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.150160 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cb466655d-r6746" podStartSLOduration=1.542498003 podStartE2EDuration="2.150146412s" totalImagesPullingTime="607.648409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:18.14884656 +0000 UTC m=+539.914944404" watchObservedRunningTime="2026-07-23 18:39:18.150146412 +0000 UTC m=+539.916244232" Jul 23 18:39:18.169412 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.169391 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bc6868686-pptpp"] Jul 23 18:39:18.173347 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.173329 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bc6868686-pptpp"] Jul 23 18:39:18.806454 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.806423 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d57da87-2a20-45ab-adb0-5a46ec93ca3f" path="/var/lib/kubelet/pods/4d57da87-2a20-45ab-adb0-5a46ec93ca3f/volumes" Jul 23 18:39:18.806715 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:18.806698 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="810167a4-6f2a-4bf2-8995-b6fa84f33154" path="/var/lib/kubelet/pods/810167a4-6f2a-4bf2-8995-b6fa84f33154/volumes" Jul 23 18:39:23.083919 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:23.083880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:23.266107 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:23.266070 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:23.448996 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:23.448914 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:26.429178 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:26.429145 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:26.545834 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:26.545803 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:40.270509 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:40.270475 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:59.089256 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:59.089160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:59.187832 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:59.187801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:59.588060 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:59.588026 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:39:59.767701 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:39:59.767652 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:00.106133 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:00.106097 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:00.203246 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:00.203219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:00.366085 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:00.366016 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:40:09.614718 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:09.614674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:09.718385 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:09.718344 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:16.694805 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:16.694745 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:17.777378 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:17.777335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:18.405742 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:18.405704 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:40:31.057366 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.057333 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq"] Jul 23 18:40:31.059676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.057655 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="810167a4-6f2a-4bf2-8995-b6fa84f33154" containerName="authorino" Jul 23 18:40:31.059676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.057665 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="810167a4-6f2a-4bf2-8995-b6fa84f33154" containerName="authorino" Jul 23 18:40:31.059676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.057747 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="810167a4-6f2a-4bf2-8995-b6fa84f33154" containerName="authorino" Jul 23 18:40:31.060555 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.060540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.063514 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.063494 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 18:40:31.063755 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.063736 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 18:40:31.063860 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.063830 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m5z8w\"" Jul 23 18:40:31.063919 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.063894 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 23 18:40:31.071804 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.071782 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq"] Jul 23 18:40:31.092086 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.092064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:31.179034 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.179012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.179148 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.179043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.179148 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.179066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.179148 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.179119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrrf\" (UniqueName: \"kubernetes.io/projected/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-kube-api-access-gjrrf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.179317 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.179222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.179317 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.179287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280394 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280549 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280549 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrrf\" (UniqueName: \"kubernetes.io/projected/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-kube-api-access-gjrrf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280800 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280863 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280863 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280846 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.280972 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.280943 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.282683 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.282660 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.283052 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.283033 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.291922 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.291901 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrrf\" (UniqueName: \"kubernetes.io/projected/0d18257b-c188-4cf1-9c4e-9c13e28b5ca1-kube-api-access-gjrrf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q6ktq\" (UID: \"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.370296 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.370245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:31.508479 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.508455 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq"] Jul 23 18:40:31.510363 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:40:31.510340 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d18257b_c188_4cf1_9c4e_9c13e28b5ca1.slice/crio-fc79bc83d1351875236235c5a2db30618cfac47d57df319171090063a003aa87 WatchSource:0}: Error finding container fc79bc83d1351875236235c5a2db30618cfac47d57df319171090063a003aa87: Status 404 returned error can't find the container with id fc79bc83d1351875236235c5a2db30618cfac47d57df319171090063a003aa87 Jul 23 18:40:31.945001 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:31.944973 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:40:32.454365 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:32.454295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" event={"ID":"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1","Type":"ContainerStarted","Data":"fc79bc83d1351875236235c5a2db30618cfac47d57df319171090063a003aa87"} Jul 23 18:40:33.460683 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:33.460646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" event={"ID":"0d18257b-c188-4cf1-9c4e-9c13e28b5ca1","Type":"ContainerStarted","Data":"df28609f3e4c0ee9436acaa8cb7e9163ebf0c13395292ffba3575dc5f18d9fa7"} Jul 23 18:40:41.371440 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:41.371351 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:41.371440 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:41.371407 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:41.383701 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:41.383678 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:41.403902 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:41.403852 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" podStartSLOduration=9.274516324 podStartE2EDuration="10.403839053s" totalImagesPullingTime="1.129322729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:33.506684018 +0000 UTC m=+615.272781863" watchObservedRunningTime="2026-07-23 18:40:41.403839053 +0000 UTC m=+623.169936874" Jul 23 18:40:41.508474 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:41.508447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q6ktq" Jul 23 18:40:43.559984 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:43.559950 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:40:44.759342 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:40:44.759309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:41:01.083014 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:01.082975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:41:02.763746 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:02.763705 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:41:06.149203 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.149166 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7"] Jul 23 18:41:06.154167 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.154149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.157342 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.157320 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 23 18:41:06.164279 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.164254 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7"] Jul 23 18:41:06.201782 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.201726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:41:06.269732 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.269699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.269732 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.269733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.269949 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.269799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.269949 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.269829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzl5\" (UniqueName: \"kubernetes.io/projected/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-kube-api-access-zrzl5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.269949 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.269855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.269949 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.269870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371225 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzl5\" (UniqueName: \"kubernetes.io/projected/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-kube-api-access-zrzl5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371371 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371371 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371482 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371482 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371584 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371652 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371741 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371724 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.371842 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.371827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.373652 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.373629 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.373857 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.373842 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.383527 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.383498 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzl5\" (UniqueName: \"kubernetes.io/projected/db02a8c2-a6a6-468d-b38f-9df8f3de1bfc-kube-api-access-zrzl5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhfd7\" (UID: \"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.464929 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.464908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:06.591252 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.591222 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7"] Jul 23 18:41:06.593460 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:41:06.593436 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb02a8c2_a6a6_468d_b38f_9df8f3de1bfc.slice/crio-eb9ba033f11c6a2a9de68d46b3b4bed3c539b25637e00ad1e1229fd5e22ce10c WatchSource:0}: Error finding container eb9ba033f11c6a2a9de68d46b3b4bed3c539b25637e00ad1e1229fd5e22ce10c: Status 404 returned error can't find the container with id eb9ba033f11c6a2a9de68d46b3b4bed3c539b25637e00ad1e1229fd5e22ce10c Jul 23 18:41:06.594716 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.594699 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:41:06.607490 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:06.607466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" event={"ID":"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc","Type":"ContainerStarted","Data":"eb9ba033f11c6a2a9de68d46b3b4bed3c539b25637e00ad1e1229fd5e22ce10c"} Jul 23 18:41:07.613622 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:07.613587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" event={"ID":"db02a8c2-a6a6-468d-b38f-9df8f3de1bfc","Type":"ContainerStarted","Data":"74944d1e283cbd12d8500e8b5c88ccd6f8d3cb5d2876f3e3b5aa74c5d2740082"} Jul 23 18:41:07.632421 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:07.632375 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" podStartSLOduration=1.4388017849999999 podStartE2EDuration="1.632359331s" totalImagesPullingTime="193.557546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:07.63041167 +0000 UTC m=+649.396509514" watchObservedRunningTime="2026-07-23 18:41:07.632359331 +0000 UTC m=+649.398457149" Jul 23 18:41:07.844433 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:07.844395 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:41:16.465832 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:16.465786 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:16.466329 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:16.465860 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:16.478185 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:16.478155 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:16.668401 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:16.668371 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhfd7" Jul 23 18:41:42.922772 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:42.922730 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:41:45.261462 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:45.261431 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:41:45.383576 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:41:45.383546 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kn6fj"] Jul 23 18:42:06.442955 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:06.442917 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:42.421623 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:42.421583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:42.521995 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:42.521965 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:53.236272 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:53.236233 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:53.306925 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:53.306883 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:54.310493 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:54.310453 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:54.403981 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:54.403947 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:55.489610 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.489567 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cb466655d-r6746"] Jul 23 18:42:55.490136 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.489770 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5cb466655d-r6746" podUID="cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" containerName="authorino" containerID="cri-o://5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050" gracePeriod=30 Jul 23 18:42:55.553421 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.553390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:55.674290 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.674250 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:42:55.732755 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.732734 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:42:55.752209 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.752148 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppxhf\" (UniqueName: \"kubernetes.io/projected/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-kube-api-access-ppxhf\") pod \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " Jul 23 18:42:55.752332 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.752211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-tls-cert\") pod \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\" (UID: \"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a\") " Jul 23 18:42:55.754088 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.754061 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-kube-api-access-ppxhf" (OuterVolumeSpecName: "kube-api-access-ppxhf") pod "cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" (UID: "cbeda2fe-f6cb-4aaf-83f2-ff748726c28a"). InnerVolumeSpecName "kube-api-access-ppxhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:42:55.763677 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.763649 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" (UID: "cbeda2fe-f6cb-4aaf-83f2-ff748726c28a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:42:55.853238 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.853215 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppxhf\" (UniqueName: \"kubernetes.io/projected/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-kube-api-access-ppxhf\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:42:55.853238 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:55.853238 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a-tls-cert\") on node \"ip-10-0-142-38.ec2.internal\" DevicePath \"\"" Jul 23 18:42:56.110676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.110593 2564 generic.go:356] "Generic (PLEG): container finished" podID="cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" containerID="5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050" exitCode=0 Jul 23 18:42:56.110676 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.110634 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cb466655d-r6746" Jul 23 18:42:56.110891 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.110682 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb466655d-r6746" event={"ID":"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a","Type":"ContainerDied","Data":"5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050"} Jul 23 18:42:56.110891 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.110718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cb466655d-r6746" event={"ID":"cbeda2fe-f6cb-4aaf-83f2-ff748726c28a","Type":"ContainerDied","Data":"a3f2ac7fe86e5693e3bdbf7cb15b9c0117ecebb4e7ef95c36fade73f7af062ef"} Jul 23 18:42:56.110891 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.110735 2564 scope.go:117] "RemoveContainer" containerID="5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050" Jul 23 18:42:56.119841 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.119815 2564 scope.go:117] "RemoveContainer" containerID="5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050" Jul 23 18:42:56.120052 ip-10-0-142-38 kubenswrapper[2564]: E0723 18:42:56.120032 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050\": container with ID starting with 5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050 not found: ID does not exist" containerID="5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050" Jul 23 18:42:56.120108 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.120061 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050"} err="failed to get container status \"5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050\": rpc error: code = NotFound desc = could not find container \"5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050\": container with ID starting with 5145e4059c623d0add53cf3a66c6913aaf163b362cfc0f579b531394a444a050 not found: ID does not exist" Jul 23 18:42:56.147489 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.147468 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cb466655d-r6746"] Jul 23 18:42:56.149520 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.149501 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cb466655d-r6746"] Jul 23 18:42:56.807121 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:42:56.807047 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" path="/var/lib/kubelet/pods/cbeda2fe-f6cb-4aaf-83f2-ff748726c28a/volumes" Jul 23 18:43:16.889735 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:16.889706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-fbq5h_da4f0214-1b23-43be-8e3d-7d48ef76cb73/copy-manifests/0.log" Jul 23 18:43:16.898624 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:16.898600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-fbq5h_da4f0214-1b23-43be-8e3d-7d48ef76cb73/manager/0.log" Jul 23 18:43:19.168472 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:19.168400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8rwnc_5c680fd2-c74e-4385-b16e-1e21c2b98b49/kuadrant-console-plugin/0.log" Jul 23 18:43:19.539661 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:19.539635 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kn6fj_f51182d2-7673-49b4-915d-3aa38c429ec6/limitador/0.log" Jul 23 18:43:20.408678 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:20.408642 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-c9jtv_6a959e22-acec-471a-bfd5-a5961657604d/kube-auth-proxy/0.log" Jul 23 18:43:21.356344 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:21.356312 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-q6ktq_0d18257b-c188-4cf1-9c4e-9c13e28b5ca1/main/0.log" Jul 23 18:43:21.705753 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:21.705722 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xhfd7_db02a8c2-a6a6-468d-b38f-9df8f3de1bfc/main/0.log" Jul 23 18:43:27.056005 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.055973 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n64gl/must-gather-zvwbj"] Jul 23 18:43:27.056362 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.056325 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" containerName="authorino" Jul 23 18:43:27.056362 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.056336 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" containerName="authorino" Jul 23 18:43:27.056430 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.056408 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbeda2fe-f6cb-4aaf-83f2-ff748726c28a" containerName="authorino" Jul 23 18:43:27.059796 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.059746 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:43:27.060904 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.060885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.063481 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.063459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n64gl\"/\"kube-root-ca.crt\"" Jul 23 18:43:27.064349 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.064329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n64gl\"/\"default-dockercfg-692r6\"" Jul 23 18:43:27.064448 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.064346 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n64gl\"/\"openshift-service-ca.crt\"" Jul 23 18:43:27.070789 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.070754 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n64gl/must-gather-zvwbj"] Jul 23 18:43:27.106441 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.106421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ac76c4ff-7edc-4a2b-a03d-f578fa05e67a-must-gather-output\") pod \"must-gather-zvwbj\" (UID: \"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a\") " pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.106536 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.106459 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtvtq\" (UniqueName: \"kubernetes.io/projected/ac76c4ff-7edc-4a2b-a03d-f578fa05e67a-kube-api-access-xtvtq\") pod \"must-gather-zvwbj\" (UID: \"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a\") " pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.158572 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.158544 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" limit=1024 Jul 23 18:43:27.207899 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.207872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtvtq\" (UniqueName: \"kubernetes.io/projected/ac76c4ff-7edc-4a2b-a03d-f578fa05e67a-kube-api-access-xtvtq\") pod \"must-gather-zvwbj\" (UID: \"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a\") " pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.208051 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.208031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ac76c4ff-7edc-4a2b-a03d-f578fa05e67a-must-gather-output\") pod \"must-gather-zvwbj\" (UID: \"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a\") " pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.208319 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.208300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ac76c4ff-7edc-4a2b-a03d-f578fa05e67a-must-gather-output\") pod \"must-gather-zvwbj\" (UID: \"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a\") " pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.216175 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.216149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtvtq\" (UniqueName: \"kubernetes.io/projected/ac76c4ff-7edc-4a2b-a03d-f578fa05e67a-kube-api-access-xtvtq\") pod \"must-gather-zvwbj\" (UID: \"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a\") " pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.369708 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.369644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n64gl/must-gather-zvwbj" Jul 23 18:43:27.499176 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:27.499149 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n64gl/must-gather-zvwbj"] Jul 23 18:43:27.501893 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:43:27.501868 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac76c4ff_7edc_4a2b_a03d_f578fa05e67a.slice/crio-2c0d11d59f39cbe623ede20b3367fd185be26126072898155d7575e88b20c3ef WatchSource:0}: Error finding container 2c0d11d59f39cbe623ede20b3367fd185be26126072898155d7575e88b20c3ef: Status 404 returned error can't find the container with id 2c0d11d59f39cbe623ede20b3367fd185be26126072898155d7575e88b20c3ef Jul 23 18:43:28.257967 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:28.257928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/must-gather-zvwbj" event={"ID":"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a","Type":"ContainerStarted","Data":"2c0d11d59f39cbe623ede20b3367fd185be26126072898155d7575e88b20c3ef"} Jul 23 18:43:29.264509 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:29.264469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/must-gather-zvwbj" event={"ID":"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a","Type":"ContainerStarted","Data":"ac104c5e85363c45bc2d0565c142bd0360452ebcd6ff52de3917338e1cfcf5b5"} Jul 23 18:43:29.264509 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:29.264517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/must-gather-zvwbj" event={"ID":"ac76c4ff-7edc-4a2b-a03d-f578fa05e67a","Type":"ContainerStarted","Data":"df746546bc849be0a4481c06c2234b6159c85cafcb1b93e37c57ff3e2dc06fa0"} Jul 23 18:43:29.285569 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:29.285434 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n64gl/must-gather-zvwbj" podStartSLOduration=1.405832754 podStartE2EDuration="2.285415934s" totalImagesPullingTime="879.58318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:29.284880547 +0000 UTC m=+791.050978391" watchObservedRunningTime="2026-07-23 18:43:29.285415934 +0000 UTC m=+791.051513759" Jul 23 18:43:30.188627 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:30.188563 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lpcrz_5a827359-4b90-490e-9d8a-7511934a486c/global-pull-secret-syncer/0.log" Jul 23 18:43:30.247172 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:30.247146 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bdq22_440d15a8-0698-4f25-b465-6abe1bc7b33a/konnectivity-agent/0.log" Jul 23 18:43:30.351194 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:30.351158 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-38.ec2.internal_fa994f2ba01c45573160a315348131e9/haproxy/0.log" Jul 23 18:43:35.136738 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:35.136703 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8rwnc_5c680fd2-c74e-4385-b16e-1e21c2b98b49/kuadrant-console-plugin/0.log" Jul 23 18:43:35.283158 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:35.283128 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kn6fj_f51182d2-7673-49b4-915d-3aa38c429ec6/limitador/0.log" Jul 23 18:43:37.376276 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:37.376232 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-l2s9p_3bb37e5a-9abd-404b-b75a-dabdd26c88ce/cluster-monitoring-operator/0.log" Jul 23 18:43:37.540008 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:37.539984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-jhlkz_2d329e36-2cf7-42c9-b9ad-ca8255e92768/monitoring-plugin/0.log" Jul 23 18:43:37.680387 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:37.680352 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6j8s_ebd30fd9-7722-4276-83c2-d88e1740fd0b/node-exporter/0.log" Jul 23 18:43:37.707455 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:37.707421 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6j8s_ebd30fd9-7722-4276-83c2-d88e1740fd0b/kube-rbac-proxy/0.log" Jul 23 18:43:37.739941 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:37.739907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6j8s_ebd30fd9-7722-4276-83c2-d88e1740fd0b/init-textfile/0.log" Jul 23 18:43:37.973583 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:37.973550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hfjz6_35f82158-3567-4336-b8dc-f9654b49e451/kube-rbac-proxy-main/0.log" Jul 23 18:43:38.004465 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.004422 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hfjz6_35f82158-3567-4336-b8dc-f9654b49e451/kube-rbac-proxy-self/0.log" Jul 23 18:43:38.033698 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.033657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-hfjz6_35f82158-3567-4336-b8dc-f9654b49e451/openshift-state-metrics/0.log" Jul 23 18:43:38.077736 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.077710 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/prometheus/0.log" Jul 23 18:43:38.101582 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.101548 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/config-reloader/0.log" Jul 23 18:43:38.126482 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.126452 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/thanos-sidecar/0.log" Jul 23 18:43:38.152270 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.152247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/kube-rbac-proxy-web/0.log" Jul 23 18:43:38.185969 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.185942 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/kube-rbac-proxy/0.log" Jul 23 18:43:38.214215 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.214183 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/kube-rbac-proxy-thanos/0.log" Jul 23 18:43:38.246071 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.245989 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_62f8b1b5-40cf-4401-a3e7-720eaa778f2c/init-config-reloader/0.log" Jul 23 18:43:38.479293 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.479262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d44cfffc5-8nlzz_a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189/thanos-query/0.log" Jul 23 18:43:38.509584 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.509500 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d44cfffc5-8nlzz_a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189/kube-rbac-proxy-web/0.log" Jul 23 18:43:38.535568 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.535538 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d44cfffc5-8nlzz_a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189/kube-rbac-proxy/0.log" Jul 23 18:43:38.564275 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.564246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d44cfffc5-8nlzz_a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189/prom-label-proxy/0.log" Jul 23 18:43:38.604340 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.604310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d44cfffc5-8nlzz_a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189/kube-rbac-proxy-rules/0.log" Jul 23 18:43:38.632397 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:38.632363 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d44cfffc5-8nlzz_a3dbfd97-9d7f-4586-aa6e-09b7b5e6b189/kube-rbac-proxy-metrics/0.log" Jul 23 18:43:39.705181 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.705148 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g"] Jul 23 18:43:39.713045 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.713018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.722866 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.722647 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g"] Jul 23 18:43:39.830936 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.830899 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-wn5hx_245755e1-fe29-4c2d-97f7-9abe911ecfc1/networking-console-plugin/0.log" Jul 23 18:43:39.840687 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.840658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-proc\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.840687 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.840700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2gjj\" (UniqueName: \"kubernetes.io/projected/cea832ea-60bf-4e02-9c25-b8feecc0b142-kube-api-access-d2gjj\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.840944 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.840754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-sys\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.840944 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.840816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-podres\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.840944 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.840894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-lib-modules\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-proc\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2gjj\" (UniqueName: \"kubernetes.io/projected/cea832ea-60bf-4e02-9c25-b8feecc0b142-kube-api-access-d2gjj\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-sys\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-podres\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-lib-modules\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-lib-modules\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.942796 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-proc\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.943381 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-sys\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.943835 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.943480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cea832ea-60bf-4e02-9c25-b8feecc0b142-podres\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:39.952183 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:39.952148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2gjj\" (UniqueName: \"kubernetes.io/projected/cea832ea-60bf-4e02-9c25-b8feecc0b142-kube-api-access-d2gjj\") pod \"perf-node-gather-daemonset-8gx2g\" (UID: \"cea832ea-60bf-4e02-9c25-b8feecc0b142\") " pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:40.030372 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:40.030293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:40.207715 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:40.207626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g"] Jul 23 18:43:40.215215 ip-10-0-142-38 kubenswrapper[2564]: W0723 18:43:40.215183 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcea832ea_60bf_4e02_9c25_b8feecc0b142.slice/crio-597f7345defd5c43b3872322c12c5de5a65175dbeee694029189f27d55beb6b0 WatchSource:0}: Error finding container 597f7345defd5c43b3872322c12c5de5a65175dbeee694029189f27d55beb6b0: Status 404 returned error can't find the container with id 597f7345defd5c43b3872322c12c5de5a65175dbeee694029189f27d55beb6b0 Jul 23 18:43:40.339819 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:40.339411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" event={"ID":"cea832ea-60bf-4e02-9c25-b8feecc0b142","Type":"ContainerStarted","Data":"6c1185a4c6ea22b5f97bb9c3f8d3e24bc74463eb52dbfe6bdf7cda389af17845"} Jul 23 18:43:40.339819 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:40.339474 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" event={"ID":"cea832ea-60bf-4e02-9c25-b8feecc0b142","Type":"ContainerStarted","Data":"597f7345defd5c43b3872322c12c5de5a65175dbeee694029189f27d55beb6b0"} Jul 23 18:43:40.339819 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:40.339669 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:40.355658 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:40.355605 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" podStartSLOduration=1.355585308 podStartE2EDuration="1.355585308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:40.354499459 +0000 UTC m=+802.120597282" watchObservedRunningTime="2026-07-23 18:43:40.355585308 +0000 UTC m=+802.121683130" Jul 23 18:43:41.010956 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:41.010922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-hd86s_9ba887d5-1060-4f80-807a-8a837e3d695a/download-server/0.log" Jul 23 18:43:42.748076 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:42.748050 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxvdl_c607df59-9c4a-40be-9d9e-3f17b7b88121/dns/0.log" Jul 23 18:43:42.770843 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:42.770814 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxvdl_c607df59-9c4a-40be-9d9e-3f17b7b88121/kube-rbac-proxy/0.log" Jul 23 18:43:42.856193 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:42.856162 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5455h_d37c033d-4733-4410-a3bf-24a873b07bd4/dns-node-resolver/0.log" Jul 23 18:43:43.580077 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:43.580049 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lvgnl_50969230-2d01-40fb-858d-2cb6d2a8d640/node-ca/0.log" Jul 23 18:43:44.634671 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:44.634645 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-c9jtv_6a959e22-acec-471a-bfd5-a5961657604d/kube-auth-proxy/0.log" Jul 23 18:43:45.369544 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:45.369509 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6hdcj_32d2153a-203e-4e9d-8e25-673697985337/serve-healthcheck-canary/0.log" Jul 23 18:43:45.923706 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:45.923657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-c2bhz_5247730c-21b7-4b27-b6cf-8aec08b6bb0f/insights-operator/0.log" Jul 23 18:43:45.924153 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:45.923865 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-c2bhz_5247730c-21b7-4b27-b6cf-8aec08b6bb0f/insights-operator/1.log" Jul 23 18:43:45.946955 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:45.946915 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5gp4w_10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8/kube-rbac-proxy/0.log" Jul 23 18:43:45.972272 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:45.972247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5gp4w_10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8/exporter/0.log" Jul 23 18:43:45.999142 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:45.999111 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5gp4w_10ee2b22-4d00-49e3-8ff6-3ca2a9fda3d8/extractor/0.log" Jul 23 18:43:46.355979 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:46.355950 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n64gl/perf-node-gather-daemonset-8gx2g" Jul 23 18:43:48.732060 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:48.732025 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-fbq5h_da4f0214-1b23-43be-8e3d-7d48ef76cb73/manager/0.log" Jul 23 18:43:48.755110 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:48.755073 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6c6445bc-fbq5h_da4f0214-1b23-43be-8e3d-7d48ef76cb73/copy-manifests/0.log" Jul 23 18:43:50.229309 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:50.229278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-775d4b7f7f-6t874_5d76c3b7-4762-46a1-afc9-80da1e862c7c/manager/0.log" Jul 23 18:43:50.267966 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:50.267938 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-c9jtv_6a959e22-acec-471a-bfd5-a5961657604d/kube-auth-proxy/0.log" Jul 23 18:43:51.581817 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:51.581785 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8599469554-c9jtv_6a959e22-acec-471a-bfd5-a5961657604d/kube-auth-proxy/0.log" Jul 23 18:43:55.607677 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:55.607645 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-wdpjf_67a0a55e-9638-4aab-9284-945a0e481fa4/kube-storage-version-migrator-operator/1.log" Jul 23 18:43:55.609309 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:55.609285 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-wdpjf_67a0a55e-9638-4aab-9284-945a0e481fa4/kube-storage-version-migrator-operator/0.log" Jul 23 18:43:56.665828 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:56.665801 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-45ssf_3c7790a6-2103-4fb6-a41d-fa438a1d2eb3/kube-multus/0.log" Jul 23 18:43:57.023117 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:57.023092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkzdr_96f4ebc2-1e82-4254-a81c-0062319b2880/kube-multus-additional-cni-plugins/0.log" Jul 23 18:43:57.048514 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:57.048482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkzdr_96f4ebc2-1e82-4254-a81c-0062319b2880/egress-router-binary-copy/0.log" Jul 23 18:43:57.075922 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:57.075899 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkzdr_96f4ebc2-1e82-4254-a81c-0062319b2880/cni-plugins/0.log" Jul 23 18:43:57.101241 ip-10-0-142-38 kubenswrapper[2564]: I0723 18:43:57.101221 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hkzdr_96f4ebc2-1e82-4254-a81c-0062319b2880/bond-cni-plugin/0.log"