Aug 01 03:44:35.292613 ip-10-0-143-175 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 01 03:44:35.292625 ip-10-0-143-175 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 01 03:44:35.292631 ip-10-0-143-175 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 01 03:44:35.292876 ip-10-0-143-175 systemd[1]: Failed to start Kubernetes Kubelet. Aug 01 03:44:45.471234 ip-10-0-143-175 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 01 03:44:45.471256 ip-10-0-143-175 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9d9b8eb7072a4a24807b0cfaaaac7ac2 -- Aug 01 03:46:20.227792 ip-10-0-143-175 systemd[1]: Starting Kubernetes Kubelet... Aug 01 03:46:20.671403 ip-10-0-143-175 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 01 03:46:20.671403 ip-10-0-143-175 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 01 03:46:20.671403 ip-10-0-143-175 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 01 03:46:20.671403 ip-10-0-143-175 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 01 03:46:20.671403 ip-10-0-143-175 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 01 03:46:20.674278 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.674196 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683004 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683024 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683030 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683034 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683037 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683039 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683043 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 03:46:20.683033 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683045 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683048 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683051 2551 feature_gate.go:328] unrecognized feature gate: Example Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683054 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683057 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683060 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683062 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683065 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683067 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683070 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683072 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683075 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683079 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683083 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683086 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683089 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683091 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683094 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683096 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683099 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 03:46:20.683317 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683101 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683104 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683107 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683116 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683118 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683121 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683124 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683126 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683129 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683132 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683139 2551 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683142 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683145 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683148 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683150 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683153 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683156 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683158 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683161 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683164 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 03:46:20.683903 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683166 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683169 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683171 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683174 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683176 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683179 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683182 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683184 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683187 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683189 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683192 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683194 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683197 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683199 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683202 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683204 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683207 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683209 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683212 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683214 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 03:46:20.684384 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683217 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683220 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683224 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683228 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683233 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683236 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683239 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683243 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683246 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683249 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683252 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683255 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683258 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683260 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683263 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683266 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683269 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683271 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683274 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 03:46:20.684910 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683278 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683281 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683284 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683286 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683289 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683291 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683294 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683296 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683299 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683302 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683304 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683307 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.683309 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684024 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684031 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684034 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684036 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684040 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684043 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 03:46:20.685374 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684046 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684049 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684051 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684054 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684057 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684060 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684063 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684066 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684069 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684071 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684074 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684077 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684080 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684083 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684085 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684088 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684091 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684094 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684096 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684099 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 03:46:20.685868 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684101 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684107 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684110 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684113 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684117 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684120 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684122 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684125 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684128 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684130 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684133 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684137 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684140 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684143 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684145 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684147 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684150 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684153 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684155 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 03:46:20.686360 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684158 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684160 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684162 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684165 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684167 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684170 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684173 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684175 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684178 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684181 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684184 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684186 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684189 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684192 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684196 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684199 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684203 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684205 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684208 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 03:46:20.686866 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684211 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684213 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684216 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684218 2551 feature_gate.go:328] unrecognized feature gate: Example Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684222 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684225 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684227 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684230 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684232 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684235 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684238 2551 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684240 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684242 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684245 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684247 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684250 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684252 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684255 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684257 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684261 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684263 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 03:46:20.687321 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684266 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684268 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684272 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684276 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684278 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684281 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684283 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684286 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684289 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684291 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684294 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684296 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684298 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684301 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684688 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684693 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684696 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684699 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684702 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684705 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 03:46:20.687828 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684708 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684712 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684716 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684719 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684722 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684725 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684728 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684730 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684733 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684735 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684741 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684744 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684747 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684749 2551 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684752 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684755 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684757 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684760 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684762 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 03:46:20.688316 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684765 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684768 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684770 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684773 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684775 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684778 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684780 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684783 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684785 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684788 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684791 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684793 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684796 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684799 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684802 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684804 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684806 2551 feature_gate.go:328] unrecognized feature gate: Example Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684809 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684812 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684814 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 03:46:20.688780 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684817 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684819 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684821 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684826 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684832 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684835 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684837 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684840 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684843 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684845 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684848 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684850 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684859 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684861 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684864 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684867 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684869 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684872 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684874 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684876 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 03:46:20.689286 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684879 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684882 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684885 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684887 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684891 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684895 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684898 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684901 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684904 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684907 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684909 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684912 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684915 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684918 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684922 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684925 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684928 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684939 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684942 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 03:46:20.689786 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684945 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684947 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684950 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684952 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684955 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684957 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684960 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684962 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684965 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684967 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684970 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684972 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684975 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684978 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.684981 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685051 2551 flags.go:64] FLAG: --address="0.0.0.0" Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685058 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685064 2551 flags.go:64] FLAG: --anonymous-auth="true" Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685068 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685072 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685076 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 01 03:46:20.690269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685081 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685085 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685088 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685091 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685094 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685097 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685100 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685104 2551 flags.go:64] FLAG: --cgroup-root="" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685107 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685113 2551 flags.go:64] FLAG: --client-ca-file="" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685117 2551 flags.go:64] FLAG: --cloud-provider="external" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685121 2551 flags.go:64] FLAG: --cluster-dns="[]" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685125 2551 flags.go:64] FLAG: --cluster-domain="" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685128 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685131 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685134 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685138 2551 flags.go:64] FLAG: --container-log-max-files="5" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685142 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685144 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685147 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685151 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685154 2551 flags.go:64] FLAG: --contention-profiling="false" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685157 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685160 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 01 03:46:20.690780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685163 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685165 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685170 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685173 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685176 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685179 2551 flags.go:64] FLAG: --enable-load-reader="false" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685182 2551 flags.go:64] FLAG: --enable-server="true" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685185 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685189 2551 flags.go:64] FLAG: --event-burst="100" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685192 2551 flags.go:64] FLAG: --event-qps="50" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685195 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685198 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685201 2551 flags.go:64] FLAG: --eviction-hard="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685205 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685208 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685211 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685214 2551 flags.go:64] FLAG: --eviction-soft="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685218 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685221 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685225 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685228 2551 flags.go:64] FLAG: --experimental-mounter-path="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685231 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685234 2551 flags.go:64] FLAG: --fail-swap-on="true" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685236 2551 flags.go:64] FLAG: --feature-gates="" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685240 2551 flags.go:64] FLAG: --file-check-frequency="20s" Aug 01 03:46:20.691345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685243 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685246 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685249 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685252 2551 flags.go:64] FLAG: --healthz-port="10248" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685256 2551 flags.go:64] FLAG: --help="false" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685259 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-143-175.ec2.internal" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685262 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685265 2551 flags.go:64] FLAG: --http-check-frequency="20s" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685268 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685271 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685274 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685277 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685280 2551 flags.go:64] FLAG: --image-service-endpoint="" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685283 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685286 2551 flags.go:64] FLAG: --kube-api-burst="100" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685289 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685292 2551 flags.go:64] FLAG: --kube-api-qps="50" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685295 2551 flags.go:64] FLAG: --kube-reserved="" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685298 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685300 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685303 2551 flags.go:64] FLAG: --kubelet-cgroups="" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685306 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685309 2551 flags.go:64] FLAG: --lock-file="" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685312 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 01 03:46:20.692004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685317 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685320 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685325 2551 flags.go:64] FLAG: --log-json-split-stream="false" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685328 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685331 2551 flags.go:64] FLAG: --log-text-split-stream="false" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685334 2551 flags.go:64] FLAG: --logging-format="text" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685337 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685340 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685343 2551 flags.go:64] FLAG: --manifest-url="" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685345 2551 flags.go:64] FLAG: --manifest-url-header="" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685350 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685353 2551 flags.go:64] FLAG: --max-open-files="1000000" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685356 2551 flags.go:64] FLAG: --max-pods="110" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685359 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685362 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685365 2551 flags.go:64] FLAG: --memory-manager-policy="None" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685368 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685371 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685374 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685377 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685384 2551 flags.go:64] FLAG: --node-status-max-images="50" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685387 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685390 2551 flags.go:64] FLAG: --oom-score-adj="-999" Aug 01 03:46:20.692922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685393 2551 flags.go:64] FLAG: --pod-cidr="" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685396 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685401 2551 flags.go:64] FLAG: --pod-manifest-path="" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685403 2551 flags.go:64] FLAG: --pod-max-pids="-1" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685407 2551 flags.go:64] FLAG: --pods-per-core="0" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685409 2551 flags.go:64] FLAG: --port="10250" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685414 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685416 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0689ea5a3fcc3fcf7" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685420 2551 flags.go:64] FLAG: --qos-reserved="" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685425 2551 flags.go:64] FLAG: --read-only-port="10255" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685428 2551 flags.go:64] FLAG: --register-node="true" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685430 2551 flags.go:64] FLAG: --register-with-taints="" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685434 2551 flags.go:64] FLAG: --registry-burst="10" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685437 2551 flags.go:64] FLAG: --registry-qps="5" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685440 2551 flags.go:64] FLAG: --reserved-cpus="" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685443 2551 flags.go:64] FLAG: --reserved-memory="" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685447 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685450 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685453 2551 flags.go:64] FLAG: --rotate-certificates="false" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685455 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685458 2551 flags.go:64] FLAG: --runonce="false" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685461 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685464 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685467 2551 flags.go:64] FLAG: --seccomp-default="false" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685470 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 01 03:46:20.693929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685473 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685476 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685479 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685482 2551 flags.go:64] FLAG: --storage-driver-password="root" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685484 2551 flags.go:64] FLAG: --storage-driver-secure="false" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685487 2551 flags.go:64] FLAG: --storage-driver-table="stats" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685490 2551 flags.go:64] FLAG: --storage-driver-user="root" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685493 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685496 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685499 2551 flags.go:64] FLAG: --system-cgroups="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685501 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685506 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685521 2551 flags.go:64] FLAG: --tls-cert-file="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685526 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685530 2551 flags.go:64] FLAG: --tls-min-version="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685533 2551 flags.go:64] FLAG: --tls-private-key-file="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685537 2551 flags.go:64] FLAG: --topology-manager-policy="none" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685540 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685543 2551 flags.go:64] FLAG: --topology-manager-scope="container" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685546 2551 flags.go:64] FLAG: --v="2" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685550 2551 flags.go:64] FLAG: --version="false" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685554 2551 flags.go:64] FLAG: --vmodule="" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685557 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.685561 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685672 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 03:46:20.694996 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685676 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685679 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685682 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685685 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685688 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685691 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685694 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685696 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685699 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685701 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685704 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685707 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685710 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685712 2551 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685715 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685717 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685722 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685725 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685728 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 03:46:20.696067 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685731 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685735 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685738 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685740 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685744 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685746 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685749 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685751 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685754 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685756 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685760 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685762 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685765 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685768 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685770 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685773 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685775 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685778 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685781 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685783 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 03:46:20.696610 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685785 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685788 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685790 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685793 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685796 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685798 2551 feature_gate.go:328] unrecognized feature gate: Example Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685800 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685803 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685806 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685808 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685810 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685813 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685816 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685819 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685822 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685825 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685829 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685831 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685834 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685837 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 03:46:20.697270 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685839 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685842 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685845 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685847 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685850 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685852 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685855 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685858 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685860 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685863 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685866 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685868 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685871 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685873 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685876 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685879 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685882 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685884 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685887 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 03:46:20.698159 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685891 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685894 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685897 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685900 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685902 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685905 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685909 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685912 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685915 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685920 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685922 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685925 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685928 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685930 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685933 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685937 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685940 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685944 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685947 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 03:46:20.698936 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.685949 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.686718 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.694563 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.694590 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.694616 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.694626 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694715 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694724 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694729 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694734 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694738 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694743 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694747 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694751 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694755 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 03:46:20.699548 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694759 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694764 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694770 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694776 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694781 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694786 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694790 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694795 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694800 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694804 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694809 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694813 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694817 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694821 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694826 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694830 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694834 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694838 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694843 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694847 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 03:46:20.699935 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694860 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694864 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694869 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694873 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694877 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694881 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694886 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694890 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694894 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694898 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694911 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694915 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694920 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694924 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694928 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694933 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694939 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694944 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694948 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694952 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 03:46:20.700460 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694956 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694961 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694965 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694969 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694973 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694978 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694982 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694986 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694990 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694994 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.694998 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695003 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695010 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695022 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695027 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695032 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695038 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695042 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695047 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 03:46:20.700970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695052 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695056 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695060 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695064 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695068 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695072 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695076 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695080 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695085 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695089 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695093 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695097 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695102 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695106 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695110 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695114 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695119 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695123 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695127 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695131 2551 feature_gate.go:328] unrecognized feature gate: Example Aug 01 03:46:20.701491 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695136 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695140 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695144 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695148 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695152 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695157 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695161 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695173 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695177 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695182 2551 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695186 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.695194 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695411 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695419 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695423 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 03:46:20.702014 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695428 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695432 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695436 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695441 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695445 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695449 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695453 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695457 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695462 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695466 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695470 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695474 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695478 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695482 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695487 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695491 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695495 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695499 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695503 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695508 2551 feature_gate.go:328] unrecognized feature gate: Example Aug 01 03:46:20.702466 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695529 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695536 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695542 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695547 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695551 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695563 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695568 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695572 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695576 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695580 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695584 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695590 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695595 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695600 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695605 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695609 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695613 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695617 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695622 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 03:46:20.702956 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695626 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695630 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695634 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695638 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695643 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695647 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695651 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695655 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695659 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695663 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695668 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695672 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695676 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695680 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695684 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695688 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695692 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695697 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695701 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695713 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 03:46:20.703454 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695718 2551 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695722 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695726 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695730 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695735 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695741 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695745 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695749 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695753 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695758 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695762 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695766 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695770 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695774 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695778 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695783 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695787 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695791 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695795 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 03:46:20.704120 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695799 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695804 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695808 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695812 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695816 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695820 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695824 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695828 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695833 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695837 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695841 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695845 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695850 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695862 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695866 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695870 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695874 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 03:46:20.704900 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:20.695878 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.695887 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.696062 2551 server.go:962] "Client rotation is on, will bootstrap in background" Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.699311 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.701164 2551 server.go:1019] "Starting client certificate rotation" Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.701288 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.701329 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 01 03:46:20.705607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.704532 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 01 03:46:20.709556 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.709490 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 01 03:46:20.715940 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.715924 2551 log.go:25] "Validated CRI v1 runtime API" Aug 01 03:46:20.718142 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.718130 2551 log.go:25] "Validated CRI v1 image API" Aug 01 03:46:20.719628 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.719608 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 01 03:46:20.722144 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.722118 2551 fs.go:135] Filesystem UUIDs: map[1fd62c03-de8d-4a14-a8e6-b2da3449a19c:/dev/nvme0n1p4 55d5d861-1bf5-4259-812b-90a46e36b5a0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Aug 01 03:46:20.722225 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.722142 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 01 03:46:20.727660 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.727539 2551 manager.go:216] Machine: {Timestamp:2026-08-01 03:46:20.726078239 +0000 UTC m=+0.367125713 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100643 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e7c30055c1e2c104201595002514d SystemUUID:ec2e7c30-055c-1e2c-1042-01595002514d BootID:9d9b8eb7-072a-4a24-807b-0cfaaaac7ac2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:14:74:e7:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:14:74:e7:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:bc:28:a4:c6:19 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 01 03:46:20.727660 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.727648 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 01 03:46:20.727835 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.727757 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 01 03:46:20.731158 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.731129 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 01 03:46:20.731294 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.731163 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 01 03:46:20.732605 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.732591 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 01 03:46:20.732647 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.732639 2551 topology_manager.go:138] "Creating topology manager with none policy" Aug 01 03:46:20.732687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.732659 2551 container_manager_linux.go:309] "Creating device plugin manager" Aug 01 03:46:20.732687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.732669 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 01 03:46:20.732687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.732684 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 01 03:46:20.733917 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.733906 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 01 03:46:20.738154 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738143 2551 state_mem.go:36] "Initialized new in-memory state store" Aug 01 03:46:20.738273 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738264 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 01 03:46:20.738302 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738292 2551 kubelet.go:486] "Attempting to sync node with API server" Aug 01 03:46:20.738340 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738305 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 01 03:46:20.738340 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738328 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 01 03:46:20.738340 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738340 2551 kubelet.go:398] "Adding apiserver pod source" Aug 01 03:46:20.738464 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738353 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 01 03:46:20.738759 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738746 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 01 03:46:20.738807 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.738771 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 01 03:46:20.741177 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.741160 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 01 03:46:20.743165 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.743150 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 01 03:46:20.743241 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.743183 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 01 03:46:20.744607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744595 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 01 03:46:20.744649 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744617 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 01 03:46:20.744649 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744627 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 01 03:46:20.744649 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744636 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 01 03:46:20.744649 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744649 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744656 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744676 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744686 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744696 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744704 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744712 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 01 03:46:20.744754 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.744717 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 01 03:46:20.745590 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.745581 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 01 03:46:20.745629 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.745593 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 01 03:46:20.751011 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.750987 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 01 03:46:20.751011 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.750997 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 01 03:46:20.751011 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.751004 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 01 03:46:20.751815 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.751802 2551 server.go:1268] "Started kubelet" Aug 01 03:46:20.751873 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.751854 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 01 03:46:20.751925 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.751872 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 01 03:46:20.751997 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.751984 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 01 03:46:20.752490 ip-10-0-143-175 systemd[1]: Started Kubernetes Kubelet. Aug 01 03:46:20.753483 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.753463 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 01 03:46:20.754079 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.754030 2551 server.go:310] "Adding debug handlers to kubelet server" Aug 01 03:46:20.757728 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.757704 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 01 03:46:20.760493 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.760478 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 01 03:46:20.760493 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.760490 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 01 03:46:20.760680 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.760656 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:20.761218 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761202 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 01 03:46:20.761321 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761207 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 01 03:46:20.761414 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761395 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 01 03:46:20.761573 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761556 2551 factory.go:55] Registering systemd factory Aug 01 03:46:20.761573 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761574 2551 factory.go:223] Registration of the systemd container factory successfully Aug 01 03:46:20.761699 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761558 2551 reconstruct.go:97] "Volume reconstruction finished" Aug 01 03:46:20.761699 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761621 2551 reconciler.go:29] "Reconciler: start to sync state" Aug 01 03:46:20.761848 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761834 2551 factory.go:153] Registering CRI-O factory Aug 01 03:46:20.761893 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761850 2551 factory.go:223] Registration of the crio container factory successfully Aug 01 03:46:20.761936 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761898 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 01 03:46:20.761936 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761921 2551 factory.go:103] Registering Raw factory Aug 01 03:46:20.761936 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.761936 2551 manager.go:1196] Started watching for new ooms in manager Aug 01 03:46:20.762321 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.761044 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-175.ec2.internal.18c791b447489957 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-175.ec2.internal,UID:ip-10-0-143-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-175.ec2.internal,},FirstTimestamp:2026-08-01 03:46:20.751771991 +0000 UTC m=+0.392819466,LastTimestamp:2026-08-01 03:46:20.751771991 +0000 UTC m=+0.392819466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-175.ec2.internal,}" Aug 01 03:46:20.762458 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.762447 2551 manager.go:349] Starting recovery of all containers Aug 01 03:46:20.764418 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.764393 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 01 03:46:20.764492 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.764439 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 01 03:46:20.772037 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.772022 2551 manager.go:354] Recovery completed Aug 01 03:46:20.777566 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.777550 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:20.777989 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.777972 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t86lz" Aug 01 03:46:20.779374 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.779357 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:20.779443 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.779386 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:20.779443 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.779396 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:20.779974 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.779956 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 01 03:46:20.779974 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.779971 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 01 03:46:20.780111 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.779988 2551 state_mem.go:36] "Initialized new in-memory state store" Aug 01 03:46:20.780111 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.780022 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:20.780894 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.780878 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:20.780984 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.780908 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:20.780984 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.780922 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:20.781152 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.781107 2551 policy_none.go:49] "None policy: Start" Aug 01 03:46:20.781152 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.781120 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 01 03:46:20.781152 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.781130 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 01 03:46:20.781791 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.781722 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-175.ec2.internal.18c791b448edc1e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-175.ec2.internal,UID:ip-10-0-143-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-175.ec2.internal,},FirstTimestamp:2026-08-01 03:46:20.779373033 +0000 UTC m=+0.420420510,LastTimestamp:2026-08-01 03:46:20.779373033 +0000 UTC m=+0.420420510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-175.ec2.internal,}" Aug 01 03:46:20.782091 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.782079 2551 policy_none.go:47] "Start" Aug 01 03:46:20.783387 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.783369 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t86lz" Aug 01 03:46:20.810320 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810156 2551 manager.go:337] "Starting Device Plugin manager" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.810343 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810356 2551 server.go:87] "Starting device plugin registration server" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810603 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810615 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810708 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810831 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.810842 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.811278 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 01 03:46:20.824058 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.811330 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:20.902670 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.902640 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 01 03:46:20.903813 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.903788 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 01 03:46:20.903922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.903834 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 01 03:46:20.903922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.903860 2551 kubelet.go:2448] "Starting kubelet main sync loop" Aug 01 03:46:20.903922 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.903899 2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 01 03:46:20.906483 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.906461 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 03:46:20.911518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.911495 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:20.915035 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.915019 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:20.915125 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.915050 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:20.915125 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.915066 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:20.915125 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.915094 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-175.ec2.internal" Aug 01 03:46:20.921332 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:20.921318 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-175.ec2.internal" Aug 01 03:46:20.921436 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.921338 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-175.ec2.internal\": node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:20.946773 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:20.946754 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:21.004271 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.004248 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal"] Aug 01 03:46:21.004352 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.004329 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:21.005146 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.005127 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:21.005233 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.005153 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:21.005233 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.005163 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:21.006275 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.006264 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:21.006388 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.006374 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.006427 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.006408 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:21.007850 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.007829 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:21.007850 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.007854 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:21.007975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.007863 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:21.007975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.007835 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:21.007975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.007922 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:21.007975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.007932 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:21.009051 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.009035 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.009092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.009065 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 03:46:21.009755 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.009739 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientMemory" Aug 01 03:46:21.009834 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.009760 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 03:46:21.009834 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.009769 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeHasSufficientPID" Aug 01 03:46:21.034091 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:21.034073 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-175.ec2.internal\" not found" node="ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.038331 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:21.038316 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-175.ec2.internal\" not found" node="ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.046981 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:21.046968 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:21.062521 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.062482 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6edb0e0c6ef1e704dd14dea72699cfa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal\" (UID: \"e6edb0e0c6ef1e704dd14dea72699cfa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.062589 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.062528 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6edb0e0c6ef1e704dd14dea72699cfa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal\" (UID: \"e6edb0e0c6ef1e704dd14dea72699cfa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.062589 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.062543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7af8bc9cf8fd0a7a7e70bdaef42f76a1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-175.ec2.internal\" (UID: \"7af8bc9cf8fd0a7a7e70bdaef42f76a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.147195 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:21.147170 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:21.163555 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.163537 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6edb0e0c6ef1e704dd14dea72699cfa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal\" (UID: \"e6edb0e0c6ef1e704dd14dea72699cfa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.163613 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.163559 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6edb0e0c6ef1e704dd14dea72699cfa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal\" (UID: \"e6edb0e0c6ef1e704dd14dea72699cfa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.163613 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.163576 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7af8bc9cf8fd0a7a7e70bdaef42f76a1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-175.ec2.internal\" (UID: \"7af8bc9cf8fd0a7a7e70bdaef42f76a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.163683 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.163615 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7af8bc9cf8fd0a7a7e70bdaef42f76a1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-175.ec2.internal\" (UID: \"7af8bc9cf8fd0a7a7e70bdaef42f76a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.163683 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.163654 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6edb0e0c6ef1e704dd14dea72699cfa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal\" (UID: \"e6edb0e0c6ef1e704dd14dea72699cfa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.163757 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.163654 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6edb0e0c6ef1e704dd14dea72699cfa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal\" (UID: \"e6edb0e0c6ef1e704dd14dea72699cfa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.247949 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:21.247925 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:21.336451 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.336423 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.340990 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:21.340972 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" Aug 01 03:46:21.348112 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:21.348093 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:22.953024 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:22.952999 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:23.053637 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:23.053572 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:23.090345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.090325 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 03:46:23.154381 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:23.154357 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:23.204910 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.204892 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 01 03:46:23.205289 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.205005 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 01 03:46:23.205289 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.205047 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 01 03:46:23.255437 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:23.255414 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:23.292663 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.292629 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-31 03:41:22 +0000 UTC" deadline="2028-03-01 10:13:19.711766094 +0000 UTC" Aug 01 03:46:23.292663 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.292661 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13878h26m56.419108339s" Aug 01 03:46:23.326687 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:23.326657 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af8bc9cf8fd0a7a7e70bdaef42f76a1.slice/crio-2ba8b73bf4151c0713c5bb0d9568c367ab9f4ef732162df234db93565fbbd128 WatchSource:0}: Error finding container 2ba8b73bf4151c0713c5bb0d9568c367ab9f4ef732162df234db93565fbbd128: Status 404 returned error can't find the container with id 2ba8b73bf4151c0713c5bb0d9568c367ab9f4ef732162df234db93565fbbd128 Aug 01 03:46:23.330207 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:23.330183 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6edb0e0c6ef1e704dd14dea72699cfa.slice/crio-82c4e15c67d8399c8dd5967e22fd129ba43fbda59b3bbe17dd68d4c3f855086a WatchSource:0}: Error finding container 82c4e15c67d8399c8dd5967e22fd129ba43fbda59b3bbe17dd68d4c3f855086a: Status 404 returned error can't find the container with id 82c4e15c67d8399c8dd5967e22fd129ba43fbda59b3bbe17dd68d4c3f855086a Aug 01 03:46:23.332012 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.331996 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 03:46:23.355666 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:23.355645 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:23.412074 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.412029 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" event={"ID":"7af8bc9cf8fd0a7a7e70bdaef42f76a1","Type":"ContainerStarted","Data":"2ba8b73bf4151c0713c5bb0d9568c367ab9f4ef732162df234db93565fbbd128"} Aug 01 03:46:23.412963 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.412943 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" event={"ID":"e6edb0e0c6ef1e704dd14dea72699cfa","Type":"ContainerStarted","Data":"82c4e15c67d8399c8dd5967e22fd129ba43fbda59b3bbe17dd68d4c3f855086a"} Aug 01 03:46:23.456092 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:23.456073 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-175.ec2.internal\" not found" Aug 01 03:46:23.553108 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.553085 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 03:46:23.565810 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.565793 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" Aug 01 03:46:23.575056 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.575009 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 01 03:46:23.575985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.575972 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" Aug 01 03:46:23.585923 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.585905 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 01 03:46:23.689881 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:23.689843 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 03:46:24.243554 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.243527 2551 apiserver.go:52] "Watching apiserver" Aug 01 03:46:24.251467 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.251444 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 01 03:46:24.251875 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.251836 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-8j2vw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal","openshift-multus/multus-additional-cni-plugins-st7xq","openshift-multus/network-metrics-daemon-drdqf","openshift-network-operator/iptables-alerter-nrsnc","kube-system/global-pull-secret-syncer-4dzmp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668","openshift-dns/node-resolver-wxxsx","openshift-multus/multus-ft6ws","openshift-network-diagnostics/network-check-target-qgv49","openshift-ovn-kubernetes/ovnkube-node-sjdln","kube-system/konnectivity-agent-zxh2s","kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lzb5r"] Aug 01 03:46:24.253287 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.253257 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.254460 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.254434 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.255561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.255540 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5skvb\"" Aug 01 03:46:24.255667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.255593 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.256076 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.255744 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 01 03:46:24.256076 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.255795 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.256076 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.255841 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.256675 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.256655 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.256764 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.256721 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vft2s\"" Aug 01 03:46:24.257041 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.257026 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.257143 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.257120 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:24.257612 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.257587 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 01 03:46:24.257747 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.257732 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 01 03:46:24.257811 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.257778 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 01 03:46:24.257999 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.257982 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 01 03:46:24.258093 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.258012 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.258478 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.258461 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.258852 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.258832 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 01 03:46:24.258951 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.258897 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wdhsf\"" Aug 01 03:46:24.258951 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.258939 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 01 03:46:24.259078 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.259031 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.259078 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.259058 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 01 03:46:24.259192 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.259081 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.259673 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.259658 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.259775 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.259725 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:24.260677 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.260656 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.261000 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.260984 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.261524 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.261449 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.261524 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.261455 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 01 03:46:24.261916 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.261785 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d6x5q\"" Aug 01 03:46:24.262277 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.262246 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.263397 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.263377 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6ch9k\"" Aug 01 03:46:24.263788 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.263769 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 01 03:46:24.263971 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.263955 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.264488 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.264470 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.264855 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.264834 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.264948 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.264834 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7tdq8\"" Aug 01 03:46:24.265109 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.265061 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 01 03:46:24.265248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.265221 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:24.265345 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.265325 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:24.266647 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.266630 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.266782 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.266763 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.268807 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.267259 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.268807 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.267839 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89g96\"" Aug 01 03:46:24.268994 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.268848 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.270793 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.269829 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 01 03:46:24.270793 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.269980 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 01 03:46:24.270793 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.270217 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 01 03:46:24.270793 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.270218 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p5hrx\"" Aug 01 03:46:24.271441 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.271422 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 01 03:46:24.271571 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.271553 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 01 03:46:24.272156 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.272135 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvnl5\"" Aug 01 03:46:24.275382 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275362 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e606418-4d64-4a3f-b0d9-9ca33852fffd-cni-binary-copy\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.275479 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275386 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-etc-selinux\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.275479 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275401 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-host\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.275479 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275425 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovnkube-config\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.275479 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275446 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-hostroot\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275486 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-var-lib-kubelet\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275521 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/345ef099-5968-4f54-bad1-1861c9ca47da-etc-tuned\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-device-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275580 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275614 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275632 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-k8s-cni-cncf-io\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.275667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-registration-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275688 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-serviceca\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275720 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vn2c\" (UniqueName: \"kubernetes.io/projected/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-kube-api-access-8vn2c\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275763 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-systemd\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275802 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275852 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-multus-certs\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275891 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm44q\" (UniqueName: \"kubernetes.io/projected/9b077824-7dc9-4c9d-90f7-fa316a428ed8-kube-api-access-pm44q\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275923 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbb9551d-b961-4e27-b5d8-a91579f5515d-hosts-file\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275947 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275972 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-kubelet\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.275994 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-env-overrides\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276009 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276041 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ef099-5968-4f54-bad1-1861c9ca47da-tmp\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276062 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x87h\" (UniqueName: \"kubernetes.io/projected/84674235-fda6-4aa7-a7e8-4b1ff3109194-kube-api-access-7x87h\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.276080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276077 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysconfig\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276093 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysctl-conf\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-etc-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276138 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-netns\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276181 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf767701-eecb-43af-9d53-914dd86cd5a7-dbus\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276208 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276223 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-node-log\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276241 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-etc-kubernetes\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276262 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf767701-eecb-43af-9d53-914dd86cd5a7-kubelet-config\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276284 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-log-socket\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-run-netns\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276325 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-ovn\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276358 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-cni-bin\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276382 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-cni-netd\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276402 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qfg\" (UniqueName: \"kubernetes.io/projected/2e606418-4d64-4a3f-b0d9-9ca33852fffd-kube-api-access-v6qfg\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276419 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-socket-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.276710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276441 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6bg9\" (UniqueName: \"kubernetes.io/projected/d403f0a7-92b9-4a38-9228-c1d62c700a7c-kube-api-access-t6bg9\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276463 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-slash\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276485 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-var-lib-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276506 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-cnibin\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276526 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2a8f9e4-bfac-4310-b820-994597255ab2-iptables-alerter-script\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276559 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-sys\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276596 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovnkube-script-lib\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276616 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276617 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-system-cni-dir\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276670 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276694 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-cni-multus\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276716 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-systemd\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-cni-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276759 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-conf-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276790 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysctl-d\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276829 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-lib-modules\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.277491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276893 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276925 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbwzl\" (UniqueName: \"kubernetes.io/projected/d2a8f9e4-bfac-4310-b820-994597255ab2-kube-api-access-qbwzl\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276946 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb9551d-b961-4e27-b5d8-a91579f5515d-tmp-dir\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.276993 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277014 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4hhw\" (UniqueName: \"kubernetes.io/projected/345ef099-5968-4f54-bad1-1861c9ca47da-kube-api-access-j4hhw\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277049 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-run\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277091 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cnibin\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277131 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-os-release\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277154 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277176 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-system-cni-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277196 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-os-release\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277219 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-cni-bin\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277331 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-sys-fs\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277356 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-kubelet\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277377 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-daemon-config\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277398 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-modprobe-d\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.278311 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277419 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-host\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277442 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2a8f9e4-bfac-4310-b820-994597255ab2-host-slash\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277463 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqxf5\" (UniqueName: \"kubernetes.io/projected/cbb9551d-b961-4e27-b5d8-a91579f5515d-kube-api-access-dqxf5\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277491 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-systemd-units\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277521 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovn-node-metrics-cert\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277544 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hc8r\" (UniqueName: \"kubernetes.io/projected/acf6d1fa-9c69-4c0e-b093-8004856b35ec-kube-api-access-6hc8r\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277567 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-socket-dir-parent\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.278985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.277590 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-kubernetes\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.301336 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.301313 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vq56d" Aug 01 03:46:24.306684 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.306666 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vq56d" Aug 01 03:46:24.367318 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.367289 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 01 03:46:24.378393 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378372 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-kubelet\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378398 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-env-overrides\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378416 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378432 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ef099-5968-4f54-bad1-1861c9ca47da-tmp\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378450 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x87h\" (UniqueName: \"kubernetes.io/projected/84674235-fda6-4aa7-a7e8-4b1ff3109194-kube-api-access-7x87h\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378474 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysconfig\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378496 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysctl-conf\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.378518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378510 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-kubelet\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378583 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysconfig\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378631 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysctl-conf\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378712 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-etc-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378750 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-netns\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378776 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf767701-eecb-43af-9d53-914dd86cd5a7-dbus\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378803 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-netns\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378810 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378811 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-etc-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.378849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378851 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-node-log\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378892 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-etc-kubernetes\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378915 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf767701-eecb-43af-9d53-914dd86cd5a7-kubelet-config\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378890 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378934 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-log-socket\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.378915 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378950 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-etc-kubernetes\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378991 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-log-socket\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.379002 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:24.878981544 +0000 UTC m=+3.015676414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379004 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf767701-eecb-43af-9d53-914dd86cd5a7-dbus\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378999 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-run-netns\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378957 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-run-netns\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.378935 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-node-log\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379040 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-ovn\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379044 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf767701-eecb-43af-9d53-914dd86cd5a7-kubelet-config\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379064 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-cni-bin\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379085 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-ovn\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379087 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-cni-netd\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.379285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379124 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qfg\" (UniqueName: \"kubernetes.io/projected/2e606418-4d64-4a3f-b0d9-9ca33852fffd-kube-api-access-v6qfg\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379119 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-cni-netd\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379157 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-env-overrides\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379163 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-socket-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379190 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bg9\" (UniqueName: \"kubernetes.io/projected/d403f0a7-92b9-4a38-9228-c1d62c700a7c-kube-api-access-t6bg9\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379493 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379585 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-cni-bin\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379717 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-slash\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379734 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-socket-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379749 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-var-lib-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379777 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-cnibin\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379786 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-slash\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379822 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2a8f9e4-bfac-4310-b820-994597255ab2-iptables-alerter-script\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379848 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-sys\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379891 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovnkube-script-lib\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379905 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-cnibin\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379925 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-system-cni-dir\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.380092 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379952 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379955 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-sys\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379999 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-system-cni-dir\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380010 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-cni-multus\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380051 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-cni-multus\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380054 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-systemd\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.379835 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-var-lib-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380091 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-cni-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380117 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-conf-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380142 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysctl-d\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380152 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-conf-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380152 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-cni-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380165 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-lib-modules\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380094 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-systemd\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380210 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380235 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380252 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-sysctl-d\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380259 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbwzl\" (UniqueName: \"kubernetes.io/projected/d2a8f9e4-bfac-4310-b820-994597255ab2-kube-api-access-qbwzl\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.381002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380282 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb9551d-b961-4e27-b5d8-a91579f5515d-tmp-dir\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380301 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380309 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-lib-modules\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380338 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.380380 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380385 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2a8f9e4-bfac-4310-b820-994597255ab2-iptables-alerter-script\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380305 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-openvswitch\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380411 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.380427 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:24.880410344 +0000 UTC m=+3.017105234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380440 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovnkube-script-lib\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4hhw\" (UniqueName: \"kubernetes.io/projected/345ef099-5968-4f54-bad1-1861c9ca47da-kube-api-access-j4hhw\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380483 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-run\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380505 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cnibin\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380525 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-os-release\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380545 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380558 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-run\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380566 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-system-cni-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.381858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380608 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-cnibin\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380612 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-os-release\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380624 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbb9551d-b961-4e27-b5d8-a91579f5515d-tmp-dir\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380666 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-os-release\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380675 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-system-cni-dir\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380629 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-os-release\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380705 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acf6d1fa-9c69-4c0e-b093-8004856b35ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380710 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-cni-bin\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380745 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-sys-fs\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380772 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-kubelet\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380775 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-cni-bin\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380796 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-daemon-config\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380812 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-sys-fs\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380828 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-var-lib-kubelet\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380828 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-modprobe-d\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380886 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-host\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380912 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2a8f9e4-bfac-4310-b820-994597255ab2-host-slash\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380921 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-modprobe-d\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.382658 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380938 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqxf5\" (UniqueName: \"kubernetes.io/projected/cbb9551d-b961-4e27-b5d8-a91579f5515d-kube-api-access-dqxf5\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380965 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-systemd-units\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380970 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2a8f9e4-bfac-4310-b820-994597255ab2-host-slash\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380974 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-host\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.380989 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovn-node-metrics-cert\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381022 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-systemd-units\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381023 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hc8r\" (UniqueName: \"kubernetes.io/projected/acf6d1fa-9c69-4c0e-b093-8004856b35ec-kube-api-access-6hc8r\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381056 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-socket-dir-parent\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381081 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-kubernetes\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381106 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e606418-4d64-4a3f-b0d9-9ca33852fffd-cni-binary-copy\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381128 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-etc-selinux\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381164 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-host\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381179 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-etc-kubernetes\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381219 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc-konnectivity-ca\") pod \"konnectivity-agent-zxh2s\" (UID: \"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc\") " pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381257 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovnkube-config\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381268 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-daemon-config\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381289 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-hostroot\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.383659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381271 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-etc-selinux\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381317 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-var-lib-kubelet\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381317 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-multus-socket-dir-parent\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381326 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-host\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381358 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/345ef099-5968-4f54-bad1-1861c9ca47da-etc-tuned\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381376 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-hostroot\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381381 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/345ef099-5968-4f54-bad1-1861c9ca47da-var-lib-kubelet\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381384 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-device-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381413 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc-agent-certs\") pod \"konnectivity-agent-zxh2s\" (UID: \"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc\") " pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381437 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381496 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381510 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-device-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381555 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e606418-4d64-4a3f-b0d9-9ca33852fffd-cni-binary-copy\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381561 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-k8s-cni-cncf-io\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381589 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-registration-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381601 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-k8s-cni-cncf-io\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.384525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381612 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-serviceca\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381639 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vn2c\" (UniqueName: \"kubernetes.io/projected/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-kube-api-access-8vn2c\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381660 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84674235-fda6-4aa7-a7e8-4b1ff3109194-registration-dir\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381698 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-systemd\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381663 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-run-systemd\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381733 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381763 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-multus-certs\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381789 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm44q\" (UniqueName: \"kubernetes.io/projected/9b077824-7dc9-4c9d-90f7-fa316a428ed8-kube-api-access-pm44q\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381813 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbb9551d-b961-4e27-b5d8-a91579f5515d-hosts-file\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381839 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.381763 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovnkube-config\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.382012 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d403f0a7-92b9-4a38-9228-c1d62c700a7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.382057 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e606418-4d64-4a3f-b0d9-9ca33852fffd-host-run-multus-certs\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.382082 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acf6d1fa-9c69-4c0e-b093-8004856b35ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.382113 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbb9551d-b961-4e27-b5d8-a91579f5515d-hosts-file\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.382124 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-serviceca\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.382849 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/345ef099-5968-4f54-bad1-1861c9ca47da-tmp\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.385442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.383598 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d403f0a7-92b9-4a38-9228-c1d62c700a7c-ovn-node-metrics-cert\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.386283 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.383704 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/345ef099-5968-4f54-bad1-1861c9ca47da-etc-tuned\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.388327 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.387710 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:24.388327 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.387735 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:24.388327 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.387748 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:24.388327 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.387878 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:24.887845562 +0000 UTC m=+3.024540448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:24.389492 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.389466 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x87h\" (UniqueName: \"kubernetes.io/projected/84674235-fda6-4aa7-a7e8-4b1ff3109194-kube-api-access-7x87h\") pod \"aws-ebs-csi-driver-node-4s668\" (UID: \"84674235-fda6-4aa7-a7e8-4b1ff3109194\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.390224 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.390199 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbwzl\" (UniqueName: \"kubernetes.io/projected/d2a8f9e4-bfac-4310-b820-994597255ab2-kube-api-access-qbwzl\") pod \"iptables-alerter-nrsnc\" (UID: \"d2a8f9e4-bfac-4310-b820-994597255ab2\") " pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.391320 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.391281 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qfg\" (UniqueName: \"kubernetes.io/projected/2e606418-4d64-4a3f-b0d9-9ca33852fffd-kube-api-access-v6qfg\") pod \"multus-ft6ws\" (UID: \"2e606418-4d64-4a3f-b0d9-9ca33852fffd\") " pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.392588 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.391643 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bg9\" (UniqueName: \"kubernetes.io/projected/d403f0a7-92b9-4a38-9228-c1d62c700a7c-kube-api-access-t6bg9\") pod \"ovnkube-node-sjdln\" (UID: \"d403f0a7-92b9-4a38-9228-c1d62c700a7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.392588 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.391890 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm44q\" (UniqueName: \"kubernetes.io/projected/9b077824-7dc9-4c9d-90f7-fa316a428ed8-kube-api-access-pm44q\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.392588 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.392002 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hc8r\" (UniqueName: \"kubernetes.io/projected/acf6d1fa-9c69-4c0e-b093-8004856b35ec-kube-api-access-6hc8r\") pod \"multus-additional-cni-plugins-st7xq\" (UID: \"acf6d1fa-9c69-4c0e-b093-8004856b35ec\") " pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.392588 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.392056 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vn2c\" (UniqueName: \"kubernetes.io/projected/4269d1c8-5d35-4410-b7b2-ba3ee5fac652-kube-api-access-8vn2c\") pod \"node-ca-8j2vw\" (UID: \"4269d1c8-5d35-4410-b7b2-ba3ee5fac652\") " pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.392588 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.392077 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4hhw\" (UniqueName: \"kubernetes.io/projected/345ef099-5968-4f54-bad1-1861c9ca47da-kube-api-access-j4hhw\") pod \"tuned-lzb5r\" (UID: \"345ef099-5968-4f54-bad1-1861c9ca47da\") " pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.393570 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.393087 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqxf5\" (UniqueName: \"kubernetes.io/projected/cbb9551d-b961-4e27-b5d8-a91579f5515d-kube-api-access-dqxf5\") pod \"node-resolver-wxxsx\" (UID: \"cbb9551d-b961-4e27-b5d8-a91579f5515d\") " pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.483108 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.483075 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc-konnectivity-ca\") pod \"konnectivity-agent-zxh2s\" (UID: \"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc\") " pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.483108 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.483108 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc-agent-certs\") pod \"konnectivity-agent-zxh2s\" (UID: \"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc\") " pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.483739 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.483713 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc-konnectivity-ca\") pod \"konnectivity-agent-zxh2s\" (UID: \"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc\") " pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.486054 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.486030 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc-agent-certs\") pod \"konnectivity-agent-zxh2s\" (UID: \"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc\") " pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.541721 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.541654 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 03:46:24.566774 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.566747 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" Aug 01 03:46:24.574164 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.574142 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:24.581878 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.581837 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-st7xq" Aug 01 03:46:24.587533 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.587517 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nrsnc" Aug 01 03:46:24.594150 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.594132 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ft6ws" Aug 01 03:46:24.601717 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.601700 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" Aug 01 03:46:24.608245 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.608228 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wxxsx" Aug 01 03:46:24.614793 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.614778 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8j2vw" Aug 01 03:46:24.619294 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.619275 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:24.885454 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.885382 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:24.885454 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.885421 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:24.885673 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.885527 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:24.885673 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.885587 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:25.885570657 +0000 UTC m=+4.022265527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:24.885673 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.885528 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:24.885673 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.885668 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:25.885652543 +0000 UTC m=+4.022347413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:24.986594 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:24.986568 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:24.986755 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.986698 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:24.986755 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.986717 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:24.986755 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.986728 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:24.986856 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:24.986773 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:25.986761969 +0000 UTC m=+4.123456839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:25.028760 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.028737 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4269d1c8_5d35_4410_b7b2_ba3ee5fac652.slice/crio-30d3e075be32ca75b0deb33e7338a90d4ee30c0aa9dc380fda2ce2458a5aa3ea WatchSource:0}: Error finding container 30d3e075be32ca75b0deb33e7338a90d4ee30c0aa9dc380fda2ce2458a5aa3ea: Status 404 returned error can't find the container with id 30d3e075be32ca75b0deb33e7338a90d4ee30c0aa9dc380fda2ce2458a5aa3ea Aug 01 03:46:25.030561 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.030529 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a8f9e4_bfac_4310_b820_994597255ab2.slice/crio-f910f457211135bf351ea1fc6207fe65e02094acc97981e7ee698eef1ee762db WatchSource:0}: Error finding container f910f457211135bf351ea1fc6207fe65e02094acc97981e7ee698eef1ee762db: Status 404 returned error can't find the container with id f910f457211135bf351ea1fc6207fe65e02094acc97981e7ee698eef1ee762db Aug 01 03:46:25.032196 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.032104 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84674235_fda6_4aa7_a7e8_4b1ff3109194.slice/crio-8cb4af7ae5128532794e5833eb0b595bee88b77a853952903ff4443f1f3eae4d WatchSource:0}: Error finding container 8cb4af7ae5128532794e5833eb0b595bee88b77a853952903ff4443f1f3eae4d: Status 404 returned error can't find the container with id 8cb4af7ae5128532794e5833eb0b595bee88b77a853952903ff4443f1f3eae4d Aug 01 03:46:25.033931 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.033911 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e606418_4d64_4a3f_b0d9_9ca33852fffd.slice/crio-9cdce449987e81303917993a425192fb60a0ef06338dff236c8863f61f82f769 WatchSource:0}: Error finding container 9cdce449987e81303917993a425192fb60a0ef06338dff236c8863f61f82f769: Status 404 returned error can't find the container with id 9cdce449987e81303917993a425192fb60a0ef06338dff236c8863f61f82f769 Aug 01 03:46:25.035349 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.035247 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345ef099_5968_4f54_bad1_1861c9ca47da.slice/crio-54ad0c1738ed8b4dfa6cb2ba47fcc6bda19350a6afb021492c9380983c210735 WatchSource:0}: Error finding container 54ad0c1738ed8b4dfa6cb2ba47fcc6bda19350a6afb021492c9380983c210735: Status 404 returned error can't find the container with id 54ad0c1738ed8b4dfa6cb2ba47fcc6bda19350a6afb021492c9380983c210735 Aug 01 03:46:25.035951 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.035907 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd403f0a7_92b9_4a38_9228_c1d62c700a7c.slice/crio-697d9c52824fb3d699569f7db1f68b3df1dc5c9af9386e354363cb86d37e90c4 WatchSource:0}: Error finding container 697d9c52824fb3d699569f7db1f68b3df1dc5c9af9386e354363cb86d37e90c4: Status 404 returned error can't find the container with id 697d9c52824fb3d699569f7db1f68b3df1dc5c9af9386e354363cb86d37e90c4 Aug 01 03:46:25.037257 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.037239 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf6d1fa_9c69_4c0e_b093_8004856b35ec.slice/crio-59aee67f705e8e2802d15e8fb7cd36798734c678f2a4bd4aafb6e395eec2f494 WatchSource:0}: Error finding container 59aee67f705e8e2802d15e8fb7cd36798734c678f2a4bd4aafb6e395eec2f494: Status 404 returned error can't find the container with id 59aee67f705e8e2802d15e8fb7cd36798734c678f2a4bd4aafb6e395eec2f494 Aug 01 03:46:25.038114 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:25.038082 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb9551d_b961_4e27_b5d8_a91579f5515d.slice/crio-03fbe02b2d99c883df8c64656b5ad4d21b597795d4c20948fe73deace1058272 WatchSource:0}: Error finding container 03fbe02b2d99c883df8c64656b5ad4d21b597795d4c20948fe73deace1058272: Status 404 returned error can't find the container with id 03fbe02b2d99c883df8c64656b5ad4d21b597795d4c20948fe73deace1058272 Aug 01 03:46:25.309060 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.308917 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-31 03:41:24 +0000 UTC" deadline="2028-02-23 09:48:42.566297165 +0000 UTC" Aug 01 03:46:25.309060 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.309058 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13710h2m17.257242169s" Aug 01 03:46:25.409306 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.409269 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:25.409462 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.409424 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:25.425643 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.425613 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nrsnc" event={"ID":"d2a8f9e4-bfac-4310-b820-994597255ab2","Type":"ContainerStarted","Data":"f910f457211135bf351ea1fc6207fe65e02094acc97981e7ee698eef1ee762db"} Aug 01 03:46:25.427882 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.427844 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8j2vw" event={"ID":"4269d1c8-5d35-4410-b7b2-ba3ee5fac652","Type":"ContainerStarted","Data":"30d3e075be32ca75b0deb33e7338a90d4ee30c0aa9dc380fda2ce2458a5aa3ea"} Aug 01 03:46:25.431536 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.431509 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" event={"ID":"7af8bc9cf8fd0a7a7e70bdaef42f76a1","Type":"ContainerStarted","Data":"17d721231ae8c5cf6f11a4892da483873e7d7618f16b3ec249d320d47da09d7d"} Aug 01 03:46:25.434133 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.433726 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wxxsx" event={"ID":"cbb9551d-b961-4e27-b5d8-a91579f5515d","Type":"ContainerStarted","Data":"03fbe02b2d99c883df8c64656b5ad4d21b597795d4c20948fe73deace1058272"} Aug 01 03:46:25.444702 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.444325 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" event={"ID":"345ef099-5968-4f54-bad1-1861c9ca47da","Type":"ContainerStarted","Data":"54ad0c1738ed8b4dfa6cb2ba47fcc6bda19350a6afb021492c9380983c210735"} Aug 01 03:46:25.447992 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.447966 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ft6ws" event={"ID":"2e606418-4d64-4a3f-b0d9-9ca33852fffd","Type":"ContainerStarted","Data":"9cdce449987e81303917993a425192fb60a0ef06338dff236c8863f61f82f769"} Aug 01 03:46:25.449510 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.449484 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" event={"ID":"84674235-fda6-4aa7-a7e8-4b1ff3109194","Type":"ContainerStarted","Data":"8cb4af7ae5128532794e5833eb0b595bee88b77a853952903ff4443f1f3eae4d"} Aug 01 03:46:25.451950 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.451399 2551 generic.go:356] "Generic (PLEG): container finished" podID="e6edb0e0c6ef1e704dd14dea72699cfa" containerID="43a22a9a1e95e0f3f080b25796b57d35ff88e527d66b63c35e0e274132d11e37" exitCode=0 Aug 01 03:46:25.451950 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.451500 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" event={"ID":"e6edb0e0c6ef1e704dd14dea72699cfa","Type":"ContainerDied","Data":"43a22a9a1e95e0f3f080b25796b57d35ff88e527d66b63c35e0e274132d11e37"} Aug 01 03:46:25.459239 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.459186 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zxh2s" event={"ID":"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc","Type":"ContainerStarted","Data":"59944d6ecce51ab9599a690ff13679e3fc01e93783ae7237e81822cd51334f23"} Aug 01 03:46:25.461678 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.461622 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerStarted","Data":"59aee67f705e8e2802d15e8fb7cd36798734c678f2a4bd4aafb6e395eec2f494"} Aug 01 03:46:25.463333 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.463118 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"697d9c52824fb3d699569f7db1f68b3df1dc5c9af9386e354363cb86d37e90c4"} Aug 01 03:46:25.467776 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.467729 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-175.ec2.internal" podStartSLOduration=2.467712429 podStartE2EDuration="2.467712429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:25.453436827 +0000 UTC m=+3.590131719" watchObservedRunningTime="2026-08-01 03:46:25.467712429 +0000 UTC m=+3.604407322" Aug 01 03:46:25.892519 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.892438 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:25.892519 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.892506 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:25.892730 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.892666 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:25.892730 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.892727 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:27.892708751 +0000 UTC m=+6.029403624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:25.893147 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.893126 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:25.893227 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.893184 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:27.893169534 +0000 UTC m=+6.029864409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:25.993898 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:25.993847 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:25.994058 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.994028 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:25.994058 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.994046 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:25.994058 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.994059 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:25.994252 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:25.994115 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:27.994098205 +0000 UTC m=+6.130793077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:26.304113 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:26.304081 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 03:46:26.310024 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:26.309927 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-31 03:41:24 +0000 UTC" deadline="2028-04-07 00:11:40.895648545 +0000 UTC" Aug 01 03:46:26.310024 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:26.309974 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14756h25m14.585678317s" Aug 01 03:46:26.409016 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:26.408985 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:26.409192 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:26.409102 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:26.409470 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:26.409338 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:26.409470 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:26.409438 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:26.494522 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:26.494482 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" event={"ID":"e6edb0e0c6ef1e704dd14dea72699cfa","Type":"ContainerStarted","Data":"638624f548487432102160ec06c54a78ef7fb502390df1c5eb5f31b2d08f6201"} Aug 01 03:46:27.408734 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:27.408660 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:27.409170 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:27.408797 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:27.912730 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:27.912472 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:27.912730 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:27.912546 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:27.912730 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:27.912637 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:27.912730 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:27.912678 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:27.912730 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:27.912710 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:31.912690575 +0000 UTC m=+10.049385455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:27.912730 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:27.912730 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:31.912719356 +0000 UTC m=+10.049414227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:28.013914 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:28.013832 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:28.014141 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:28.014085 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:28.014141 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:28.014109 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:28.014141 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:28.014122 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:28.014310 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:28.014185 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:32.014166142 +0000 UTC m=+10.150861015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:28.409461 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:28.408951 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:28.409461 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:28.409082 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:28.410293 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:28.410128 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:28.410293 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:28.410246 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:29.409071 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:29.409038 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:29.409253 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:29.409173 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:30.408960 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:30.408928 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:30.408960 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:30.408949 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:30.409580 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:30.409067 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:30.409580 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:30.409157 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:31.409139 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:31.408665 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:31.409139 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:31.408849 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:31.949842 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:31.949801 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:31.950026 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:31.949914 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:31.950075 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:31.950051 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:31.950620 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:31.950116 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:39.950095869 +0000 UTC m=+18.086790753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:31.950620 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:31.950526 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:31.950620 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:31.950584 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:39.950565685 +0000 UTC m=+18.087260558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:32.050487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:32.050394 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:32.050659 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:32.050531 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:32.050659 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:32.050552 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:32.050659 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:32.050564 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:32.050659 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:32.050621 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:40.050605206 +0000 UTC m=+18.187300088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:32.409479 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:32.409449 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:32.410008 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:32.409560 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:32.410008 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:32.409611 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:32.410008 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:32.409674 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:33.408860 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:33.408816 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:33.409061 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:33.408984 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:34.409446 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:34.409411 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:34.409880 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:34.409450 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:34.409880 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:34.409551 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:34.409880 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:34.409701 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:35.408835 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:35.408816 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:35.408956 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:35.408938 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:36.408835 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:36.408798 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:36.409298 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:36.408940 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:36.409298 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:36.409020 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:36.409298 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:36.409102 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:37.409138 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:37.409106 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:37.409525 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:37.409221 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:38.409489 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:38.409186 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:38.409489 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:38.409338 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:38.409489 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:38.409383 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:38.409489 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:38.409455 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:39.409114 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:39.409084 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:39.409304 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:39.409205 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:40.013907 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:40.013846 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:40.014373 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:40.013923 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:40.014373 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.014033 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:40.014373 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.014036 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:40.014373 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.014095 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:56.014076858 +0000 UTC m=+34.150771729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:40.014373 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.014109 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:56.014103542 +0000 UTC m=+34.150798413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:40.115251 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:40.115207 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:40.115434 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.115412 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:40.115494 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.115447 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:40.115494 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.115461 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:40.115567 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.115526 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:56.115507915 +0000 UTC m=+34.252202793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:40.408913 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:40.408825 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:40.408913 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:40.408838 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:40.409078 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.408983 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:40.409148 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:40.409124 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:41.408808 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:41.408777 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:41.409326 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:41.408920 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:42.410035 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:42.409996 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:42.410505 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:42.410101 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:42.410505 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:42.410154 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:42.410505 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:42.410261 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:43.409424 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:43.409399 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:43.409564 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:43.409521 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:44.409640 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.409294 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:44.410533 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.409346 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:44.410533 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:44.409680 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:44.410533 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:44.409780 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:44.534683 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.534647 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ft6ws" event={"ID":"2e606418-4d64-4a3f-b0d9-9ca33852fffd","Type":"ContainerStarted","Data":"6db8354f975928db193f2a4b408c86aa2e05c3293d798b0870fa05879ff150b4"} Aug 01 03:46:44.536119 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.536093 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" event={"ID":"84674235-fda6-4aa7-a7e8-4b1ff3109194","Type":"ContainerStarted","Data":"809d10208b0cf3ee813be659b6def09ef4d8164c2a5617a5d194703f529791a8"} Aug 01 03:46:44.537354 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.537330 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zxh2s" event={"ID":"8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc","Type":"ContainerStarted","Data":"72111646b7d04ef74e901270ea47e2a0d018bc913554735d90643b340565ce85"} Aug 01 03:46:44.538742 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.538707 2551 generic.go:356] "Generic (PLEG): container finished" podID="acf6d1fa-9c69-4c0e-b093-8004856b35ec" containerID="6d655aa2d4ff2cdc9d45287ad7e89210bfbdd9787009952abff81aae36191f6a" exitCode=0 Aug 01 03:46:44.538842 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.538778 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerDied","Data":"6d655aa2d4ff2cdc9d45287ad7e89210bfbdd9787009952abff81aae36191f6a"} Aug 01 03:46:44.541684 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.541668 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:46:44.542016 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.541993 2551 generic.go:356] "Generic (PLEG): container finished" podID="d403f0a7-92b9-4a38-9228-c1d62c700a7c" containerID="fcdcbfea633b6b10f715edf0a54ca6316254f9134ef25eb6922d1ed95e7ca2c1" exitCode=1 Aug 01 03:46:44.542085 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.542057 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"ec96e242e511ff0cf61d356d3cdb6ab69aed4a9eb4be317c4e7b6516e0d5d336"} Aug 01 03:46:44.542130 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.542109 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"5c2f82cee9f9605155dfff43b0a10f8f04f33c2167c11ce3fe57d0fbdf8739ee"} Aug 01 03:46:44.542171 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.542160 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"5e3f2eb4c9a82bf0e86f0864a53876c0fd4963377a3d850c88f76235e6d48e18"} Aug 01 03:46:44.542206 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.542191 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"315209824ac729c626385c26b1af282b3dd50c350de469593cdbbac701f05908"} Aug 01 03:46:44.542242 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.542224 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerDied","Data":"fcdcbfea633b6b10f715edf0a54ca6316254f9134ef25eb6922d1ed95e7ca2c1"} Aug 01 03:46:44.542273 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.542259 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"bc87ad2ec0ed29447a2ed938a4aace87f0398b0566c9ee82226f730efc47f0ac"} Aug 01 03:46:44.543288 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.543268 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8j2vw" event={"ID":"4269d1c8-5d35-4410-b7b2-ba3ee5fac652","Type":"ContainerStarted","Data":"fab926b011eed4bcecc0b141166f2bcf33b7215c8551ff8aae778dd11ff7ce85"} Aug 01 03:46:44.544512 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.544492 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wxxsx" event={"ID":"cbb9551d-b961-4e27-b5d8-a91579f5515d","Type":"ContainerStarted","Data":"5c02bcde833b0d30ae397d7c7f347b38238286cfa90ce59fb484f1df9385f85e"} Aug 01 03:46:44.545690 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.545671 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" event={"ID":"345ef099-5968-4f54-bad1-1861c9ca47da","Type":"ContainerStarted","Data":"2d4faad9eb969a62fc857c77b063b879f3c792c7e56aaa43d4c66061099bdbd4"} Aug 01 03:46:44.552427 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.552385 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ft6ws" podStartSLOduration=3.555654906 podStartE2EDuration="22.552369558s" totalImagesPullingTime="18.996714652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:44.552022811 +0000 UTC m=+22.688717697" watchObservedRunningTime="2026-08-01 03:46:44.552369558 +0000 UTC m=+22.689064456" Aug 01 03:46:44.552816 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.552788 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-175.ec2.internal" podStartSLOduration=21.552782554 podStartE2EDuration="21.552782554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:26.509724361 +0000 UTC m=+4.646419255" watchObservedRunningTime="2026-08-01 03:46:44.552782554 +0000 UTC m=+22.689477446" Aug 01 03:46:44.566017 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.565987 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wxxsx" podStartSLOduration=4.10246182 podStartE2EDuration="22.56597665s" totalImagesPullingTime="18.46351483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:44.565893429 +0000 UTC m=+22.702588321" watchObservedRunningTime="2026-08-01 03:46:44.56597665 +0000 UTC m=+22.702671542" Aug 01 03:46:44.583638 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.583603 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zxh2s" podStartSLOduration=8.040006823 podStartE2EDuration="22.583592396s" totalImagesPullingTime="14.543585573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:44.583017749 +0000 UTC m=+22.719712640" watchObservedRunningTime="2026-08-01 03:46:44.583592396 +0000 UTC m=+22.720287287" Aug 01 03:46:44.621922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.621886 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lzb5r" podStartSLOduration=4.15306954 podStartE2EDuration="22.621855931s" totalImagesPullingTime="18.468786391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:44.621592799 +0000 UTC m=+22.758287691" watchObservedRunningTime="2026-08-01 03:46:44.621855931 +0000 UTC m=+22.758550820" Aug 01 03:46:44.636976 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:44.636944 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8j2vw" podStartSLOduration=4.162395514 podStartE2EDuration="22.636932199s" totalImagesPullingTime="18.474536685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:44.636486804 +0000 UTC m=+22.773181696" watchObservedRunningTime="2026-08-01 03:46:44.636932199 +0000 UTC m=+22.773627091" Aug 01 03:46:45.043040 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.043014 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 01 03:46:45.328874 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.328561 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-01T03:46:45.043035558Z","UUID":"f1142e3d-07ae-4faa-8e09-2739f0ea05e8","Handler":null,"Name":"","Endpoint":""} Aug 01 03:46:45.330366 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.330343 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 01 03:46:45.330499 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.330386 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 01 03:46:45.409108 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.409073 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:45.409275 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:45.409209 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:45.550625 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.550590 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" event={"ID":"84674235-fda6-4aa7-a7e8-4b1ff3109194","Type":"ContainerStarted","Data":"259b8cbe88caf0c56959b92571426a389abcf26213e83a9c83cac4b0e06a9b74"} Aug 01 03:46:45.552949 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.552921 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nrsnc" event={"ID":"d2a8f9e4-bfac-4310-b820-994597255ab2","Type":"ContainerStarted","Data":"a55c9bc9840efb093be95be60ce4ec07673a0923df35cda8ef792b12d39c3cdf"} Aug 01 03:46:45.567923 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:45.567884 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nrsnc" podStartSLOduration=5.095859462 podStartE2EDuration="23.56785178s" totalImagesPullingTime="18.471992318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:45.567078713 +0000 UTC m=+23.703773606" watchObservedRunningTime="2026-08-01 03:46:45.56785178 +0000 UTC m=+23.704546676" Aug 01 03:46:46.363037 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.363010 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:46.363535 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.363516 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:46.409278 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.409249 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:46.409396 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:46.409377 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:46.409472 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.409446 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:46.409568 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:46.409546 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:46.557935 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.557906 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:46:46.558442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.558303 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"389e68d0f158aa2ac03574ec4c9e74f8a4a56099ffdfca58eba5a96a027170e2"} Aug 01 03:46:46.560554 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.560519 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" event={"ID":"84674235-fda6-4aa7-a7e8-4b1ff3109194","Type":"ContainerStarted","Data":"0df36e9c88e106829ce342fa518b6cffcf516dcc9e437db5ba23cd774eace13e"} Aug 01 03:46:46.560766 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.560748 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:46.561227 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.561209 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zxh2s" Aug 01 03:46:46.578541 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:46.578502 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4s668" podStartSLOduration=4.000966227 podStartE2EDuration="24.578481528s" totalImagesPullingTime="20.577515301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:46.578005013 +0000 UTC m=+24.714699906" watchObservedRunningTime="2026-08-01 03:46:46.578481528 +0000 UTC m=+24.715176513" Aug 01 03:46:47.408671 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:47.408636 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:47.408825 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:47.408757 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:48.409402 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:48.409364 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:48.410121 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:48.409364 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:48.410121 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:48.409497 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:48.410121 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:48.409533 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:49.409281 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.409111 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:49.409488 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:49.409358 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:49.568633 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.568598 2551 generic.go:356] "Generic (PLEG): container finished" podID="acf6d1fa-9c69-4c0e-b093-8004856b35ec" containerID="37c0b2219b6166ef4c39bf5ab681429d6167c4c50ff0183ef521e6f23530d5d3" exitCode=0 Aug 01 03:46:49.568826 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.568677 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerDied","Data":"37c0b2219b6166ef4c39bf5ab681429d6167c4c50ff0183ef521e6f23530d5d3"} Aug 01 03:46:49.572229 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.572208 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:46:49.572558 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.572540 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"c0ebd196e1c9916a7ac950583f58b8e78cbb9f60b3e753a0c3a316ef28d6c23c"} Aug 01 03:46:49.573004 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.572991 2551 scope.go:117] "RemoveContainer" containerID="fcdcbfea633b6b10f715edf0a54ca6316254f9134ef25eb6922d1ed95e7ca2c1" Aug 01 03:46:49.573338 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.573324 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:49.573415 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.573405 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:49.589356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.589335 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:49.589448 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:49.589442 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:50.408601 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.408570 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:50.408740 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:50.408703 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:50.408797 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.408774 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:50.408901 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:50.408884 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:50.549823 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.549645 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dzmp"] Aug 01 03:46:50.552727 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.552701 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgv49"] Aug 01 03:46:50.553401 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.553377 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drdqf"] Aug 01 03:46:50.553545 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.553493 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:50.553643 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:50.553615 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:50.579559 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.579538 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:46:50.579967 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.579948 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:50.580074 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.579956 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" event={"ID":"d403f0a7-92b9-4a38-9228-c1d62c700a7c","Type":"ContainerStarted","Data":"ac90f1348f407a1fc87e1e8adef8ce279899f8bcf479f89c8ccad0e883c927c5"} Aug 01 03:46:50.580074 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.579982 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 01 03:46:50.580074 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:50.580050 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:50.580074 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.580056 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:50.580328 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:50.580288 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:50.608747 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:50.608698 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" podStartSLOduration=10.100581501 podStartE2EDuration="28.608680352s" totalImagesPullingTime="18.508098851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:46:50.607301566 +0000 UTC m=+28.743996458" watchObservedRunningTime="2026-08-01 03:46:50.608680352 +0000 UTC m=+28.745375246" Aug 01 03:46:51.586419 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:51.586385 2551 generic.go:356] "Generic (PLEG): container finished" podID="acf6d1fa-9c69-4c0e-b093-8004856b35ec" containerID="246030ca96c7b46ad74fa6949eea71ee424b13c63fbc808f322c5b4cb62942b0" exitCode=0 Aug 01 03:46:51.586811 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:51.586472 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerDied","Data":"246030ca96c7b46ad74fa6949eea71ee424b13c63fbc808f322c5b4cb62942b0"} Aug 01 03:46:51.586811 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:51.586532 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 01 03:46:52.412510 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:52.411906 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:52.412725 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:52.412594 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:52.412725 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:52.412648 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:52.413185 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:52.413169 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:52.413619 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:52.413597 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:52.413706 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:52.413677 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:53.470040 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:53.470019 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:46:53.470812 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:53.470212 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 01 03:46:53.488376 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:53.488345 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" podUID="d403f0a7-92b9-4a38-9228-c1d62c700a7c" containerName="ovnkube-controller" probeResult="failure" output="" Aug 01 03:46:53.496165 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:53.496142 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" podUID="d403f0a7-92b9-4a38-9228-c1d62c700a7c" containerName="ovnkube-controller" probeResult="failure" output="" Aug 01 03:46:53.592598 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:53.592576 2551 generic.go:356] "Generic (PLEG): container finished" podID="acf6d1fa-9c69-4c0e-b093-8004856b35ec" containerID="bfc916a8e0dbf6833f28203a1d221db0d7d3d512072fd6ab330c2aa401630faa" exitCode=0 Aug 01 03:46:53.592714 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:53.592620 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerDied","Data":"bfc916a8e0dbf6833f28203a1d221db0d7d3d512072fd6ab330c2aa401630faa"} Aug 01 03:46:54.409080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:54.409051 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:54.409080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:54.409084 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:54.409334 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:54.409053 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:54.409334 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:54.409187 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:54.409334 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:54.409270 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:54.409487 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:54.409343 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:56.038385 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.038347 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:56.038965 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.038499 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:56.038965 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.038567 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret podName:bf767701-eecb-43af-9d53-914dd86cd5a7 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.038546996 +0000 UTC m=+66.175241870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret") pod "global-pull-secret-syncer-4dzmp" (UID: "bf767701-eecb-43af-9d53-914dd86cd5a7") : object "kube-system"/"original-pull-secret" not registered Aug 01 03:46:56.038965 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.038506 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:56.038965 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.038590 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:56.038965 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.038643 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs podName:9b077824-7dc9-4c9d-90f7-fa316a428ed8 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.038626222 +0000 UTC m=+66.175321093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs") pod "network-metrics-daemon-drdqf" (UID: "9b077824-7dc9-4c9d-90f7-fa316a428ed8") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 03:46:56.139316 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.139285 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:56.139482 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.139443 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 03:46:56.139482 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.139461 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 03:46:56.139482 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.139471 2551 projected.go:196] Error preparing data for projected volume kube-api-access-p2jgt for pod openshift-network-diagnostics/network-check-target-qgv49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:56.139604 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.139531 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt podName:b815631a-7938-46e6-b36b-26afc52fd391 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.139510466 +0000 UTC m=+66.276205360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p2jgt" (UniqueName: "kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt") pod "network-check-target-qgv49" (UID: "b815631a-7938-46e6-b36b-26afc52fd391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 03:46:56.409163 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.409086 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:56.409332 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.409086 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:56.409332 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.409218 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drdqf" podUID="9b077824-7dc9-4c9d-90f7-fa316a428ed8" Aug 01 03:46:56.409332 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.409290 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qgv49" podUID="b815631a-7938-46e6-b36b-26afc52fd391" Aug 01 03:46:56.409332 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.409086 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:56.409515 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.409381 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dzmp" podUID="bf767701-eecb-43af-9d53-914dd86cd5a7" Aug 01 03:46:56.685191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.685116 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-175.ec2.internal" event="NodeReady" Aug 01 03:46:56.685359 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.685248 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 01 03:46:56.726674 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.726644 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-42n7j"] Aug 01 03:46:56.728663 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.728644 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.731417 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.731231 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.731533 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.731416 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 01 03:46:56.731533 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.731357 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 01 03:46:56.731533 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.731368 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s7z87\"" Aug 01 03:46:56.731533 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.731387 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.735431 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.735411 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr"] Aug 01 03:46:56.737196 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.737176 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8667677bb4-4p75c"] Aug 01 03:46:56.738104 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.737629 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.738104 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.737749 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 01 03:46:56.740047 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.740027 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh"] Aug 01 03:46:56.740237 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.740222 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.743082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.742327 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.743082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.742341 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.743082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.742619 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 01 03:46:56.743082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.742977 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hc9pw\"" Aug 01 03:46:56.743346 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.743330 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 01 03:46:56.745175 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.745147 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt"] Aug 01 03:46:56.745741 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.745723 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" Aug 01 03:46:56.746945 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.746926 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-gc6tf"] Aug 01 03:46:56.747045 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.747003 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:56.748247 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.748222 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Aug 01 03:46:56.748348 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.748272 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Aug 01 03:46:56.748489 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.748471 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Aug 01 03:46:56.748554 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.748490 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m44mr\"" Aug 01 03:46:56.748815 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.748797 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz"] Aug 01 03:46:56.750699 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.749404 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.750699 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.750078 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.751112 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751042 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 01 03:46:56.751112 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751079 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.751112 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751101 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jpfqc\"" Aug 01 03:46:56.751370 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751354 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.751427 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751397 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.751617 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751595 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8gjsg\"" Aug 01 03:46:56.751953 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751842 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.751953 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.751857 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d"] Aug 01 03:46:56.752118 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.752095 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Aug 01 03:46:56.752118 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.752106 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.752254 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.752231 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.752330 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.752259 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.753285 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.753265 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 01 03:46:56.753684 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.753666 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cc45b48f7-kvhsq"] Aug 01 03:46:56.753787 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.753750 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6t96w\"" Aug 01 03:46:56.754060 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.754043 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.755256 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.755226 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.755466 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.755441 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.755652 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.755636 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 01 03:46:56.756000 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.755982 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Aug 01 03:46:56.756378 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.756360 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-42n7j"] Aug 01 03:46:56.756510 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.756491 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh"] Aug 01 03:46:56.756609 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.756581 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.757297 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.757272 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Aug 01 03:46:56.757558 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.757539 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.757659 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.757612 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6mcl2\"" Aug 01 03:46:56.760212 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.760195 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.760462 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.760446 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.760558 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.760513 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-g884h\"" Aug 01 03:46:56.760620 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.760269 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Aug 01 03:46:56.760846 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.760830 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Aug 01 03:46:56.761175 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.760969 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h8ffs\"" Aug 01 03:46:56.763710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.763693 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d"] Aug 01 03:46:56.763856 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.763844 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr"] Aug 01 03:46:56.763983 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.763973 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz"] Aug 01 03:46:56.764506 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.764484 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 01 03:46:56.765167 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.765149 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-gc6tf"] Aug 01 03:46:56.766070 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.766051 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 01 03:46:56.766388 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.766355 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 01 03:46:56.766767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.766742 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8667677bb4-4p75c"] Aug 01 03:46:56.767569 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.767553 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 01 03:46:56.767724 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.767627 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sxb52"] Aug 01 03:46:56.769985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.769964 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 01 03:46:56.776953 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.775223 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cc45b48f7-kvhsq"] Aug 01 03:46:56.776953 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.775326 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:56.778367 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.777287 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vbpgv"] Aug 01 03:46:56.779905 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.779888 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.780281 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.780266 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.780384 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.780279 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-drl4f\"" Aug 01 03:46:56.781126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.780828 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 01 03:46:56.783858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.783840 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7"] Aug 01 03:46:56.784274 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.783981 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:56.786158 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.786140 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt"] Aug 01 03:46:56.786399 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.786372 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sxb52"] Aug 01 03:46:56.786399 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.786232 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" Aug 01 03:46:56.787450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.787432 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 01 03:46:56.787450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.787447 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 01 03:46:56.788217 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.788203 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xd9zx\"" Aug 01 03:46:56.788649 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.788632 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 01 03:46:56.789377 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.789361 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zz7sk\"" Aug 01 03:46:56.789550 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.789402 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 01 03:46:56.794451 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.794432 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vbpgv"] Aug 01 03:46:56.798101 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.798080 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7"] Aug 01 03:46:56.844099 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844078 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.844211 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844112 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.844211 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844136 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ch57\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-kube-api-access-4ch57\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.844211 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844166 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa83b609-4013-49b9-8e15-96baea198202-trusted-ca\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.844211 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844188 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0df5cb39-debb-4d1b-842f-622c5a03f694-ca-trust-extracted\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.844392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844211 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6t9\" (UniqueName: \"kubernetes.io/projected/db5cce20-153a-4b78-a13c-d2ccec37733b-kube-api-access-bq6t9\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.844392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844237 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-installation-pull-secrets\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.844392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844281 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpf85\" (UniqueName: \"kubernetes.io/projected/aa83b609-4013-49b9-8e15-96baea198202-kube-api-access-fpf85\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.844392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844326 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76502bb9-609e-4bd2-9be9-16c4d04b7c35-config\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.844392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844350 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa83b609-4013-49b9-8e15-96baea198202-serving-cert\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844392 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-snapshots\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844415 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa83b609-4013-49b9-8e15-96baea198202-config\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844431 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd7z2\" (UniqueName: \"kubernetes.io/projected/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-kube-api-access-jd7z2\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844448 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8w6q\" (UniqueName: \"kubernetes.io/projected/76502bb9-609e-4bd2-9be9-16c4d04b7c35-kube-api-access-v8w6q\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844469 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844491 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db5cce20-153a-4b78-a13c-d2ccec37733b-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.844607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844556 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-tmp\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844639 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675lb\" (UniqueName: \"kubernetes.io/projected/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-kube-api-access-675lb\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844662 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-stats-auth\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844681 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7kkm\" (UniqueName: \"kubernetes.io/projected/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-kube-api-access-c7kkm\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844700 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-serving-cert\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844737 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-trusted-ca\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844795 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-service-ca-bundle\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.844840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844823 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76502bb9-609e-4bd2-9be9-16c4d04b7c35-serving-cert\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844851 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-default-certificate\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844890 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844914 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-image-registry-private-configuration\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.844963 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-trusted-ca-bundle\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.845005 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.845032 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.845082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.845066 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99jg5\" (UniqueName: \"kubernetes.io/projected/9fdb4e9d-da57-424b-bb79-d64a3433cdae-kube-api-access-99jg5\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.845356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.845092 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f9vg\" (UniqueName: \"kubernetes.io/projected/2beeb1cd-95df-4440-b939-1b9ab91fe9db-kube-api-access-7f9vg\") pod \"volume-data-source-validator-5b8776669-wb5bh\" (UID: \"2beeb1cd-95df-4440-b939-1b9ab91fe9db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" Aug 01 03:46:56.845356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.845118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-certificates\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.845356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.845142 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-bound-sa-token\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946328 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946248 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnt5p\" (UniqueName: \"kubernetes.io/projected/899240e5-73dd-4598-a795-da0780772b80-kube-api-access-lnt5p\") pod \"network-check-source-65bdbbff45-lbbp7\" (UID: \"899240e5-73dd-4598-a795-da0780772b80\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" Aug 01 03:46:56.946328 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946289 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-service-ca-bundle\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.946328 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946317 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76502bb9-609e-4bd2-9be9-16c4d04b7c35-serving-cert\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946376 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-default-certificate\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946416 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946443 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946491 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-image-registry-private-configuration\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946523 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-trusted-ca-bundle\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946546 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946572 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.946595 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946597 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a67a604a-ccf6-4870-aa1c-69bc9342ccb2-cert\") pod \"ingress-canary-sxb52\" (UID: \"a67a604a-ccf6-4870-aa1c-69bc9342ccb2\") " pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946626 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99jg5\" (UniqueName: \"kubernetes.io/projected/9fdb4e9d-da57-424b-bb79-d64a3433cdae-kube-api-access-99jg5\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946653 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zm7\" (UniqueName: \"kubernetes.io/projected/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-kube-api-access-29zm7\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946681 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f9vg\" (UniqueName: \"kubernetes.io/projected/2beeb1cd-95df-4440-b939-1b9ab91fe9db-kube-api-access-7f9vg\") pod \"volume-data-source-validator-5b8776669-wb5bh\" (UID: \"2beeb1cd-95df-4440-b939-1b9ab91fe9db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946709 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-config-volume\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946733 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-certificates\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946756 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-bound-sa-token\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946783 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946804 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946829 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946852 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ch57\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-kube-api-access-4ch57\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946901 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa83b609-4013-49b9-8e15-96baea198202-trusted-ca\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946928 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0df5cb39-debb-4d1b-842f-622c5a03f694-ca-trust-extracted\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.946954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946949 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-service-ca-bundle\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.946953 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6t9\" (UniqueName: \"kubernetes.io/projected/db5cce20-153a-4b78-a13c-d2ccec37733b-kube-api-access-bq6t9\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947061 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-installation-pull-secrets\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947090 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpf85\" (UniqueName: \"kubernetes.io/projected/aa83b609-4013-49b9-8e15-96baea198202-kube-api-access-fpf85\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947120 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76502bb9-609e-4bd2-9be9-16c4d04b7c35-config\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947155 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssgcb\" (UniqueName: \"kubernetes.io/projected/a67a604a-ccf6-4870-aa1c-69bc9342ccb2-kube-api-access-ssgcb\") pod \"ingress-canary-sxb52\" (UID: \"a67a604a-ccf6-4870-aa1c-69bc9342ccb2\") " pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.947181 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947191 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa83b609-4013-49b9-8e15-96baea198202-serving-cert\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.947205 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc45b48f7-kvhsq: secret "image-registry-tls" not found Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947252 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-snapshots\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.947282 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls podName:0df5cb39-debb-4d1b-842f-622c5a03f694 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:57.447255643 +0000 UTC m=+35.583950513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls") pod "image-registry-cc45b48f7-kvhsq" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694") : secret "image-registry-tls" not found Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947315 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa83b609-4013-49b9-8e15-96baea198202-config\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947343 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd7z2\" (UniqueName: \"kubernetes.io/projected/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-kube-api-access-jd7z2\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947369 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-tmp-dir\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:56.947487 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.947389 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:46:57.447373171 +0000 UTC m=+35.584068061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : configmap references non-existent config key: service-ca.crt Aug 01 03:46:56.948138 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947628 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-certificates\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.948138 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.947717 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-snapshots\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.948721 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948263 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.948721 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948539 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0df5cb39-debb-4d1b-842f-622c5a03f694-ca-trust-extracted\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.948721 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948545 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-trusted-ca-bundle\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.948721 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948578 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa83b609-4013-49b9-8e15-96baea198202-trusted-ca\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.948721 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.948637 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 01 03:46:56.948721 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.948683 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:46:57.448669363 +0000 UTC m=+35.585364232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : secret "router-metrics-certs-default" not found Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.948736 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.948774 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls podName:db5cce20-153a-4b78-a13c-d2ccec37733b nodeName:}" failed. No retries permitted until 2026-08-01 03:46:57.448762571 +0000 UTC m=+35.585457462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-wt4cr" (UID: "db5cce20-153a-4b78-a13c-d2ccec37733b") : secret "cluster-monitoring-operator-tls" not found Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948615 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8w6q\" (UniqueName: \"kubernetes.io/projected/76502bb9-609e-4bd2-9be9-16c4d04b7c35-kube-api-access-v8w6q\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948819 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948850 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db5cce20-153a-4b78-a13c-d2ccec37733b-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948901 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-tmp\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948964 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675lb\" (UniqueName: \"kubernetes.io/projected/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-kube-api-access-675lb\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.948988 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-stats-auth\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.949018 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7kkm\" (UniqueName: \"kubernetes.io/projected/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-kube-api-access-c7kkm\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.949043 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-serving-cert\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.949095 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.949067 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-trusted-ca\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.949626 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.949310 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/76502bb9-609e-4bd2-9be9-16c4d04b7c35-config\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.949626 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.949533 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa83b609-4013-49b9-8e15-96baea198202-config\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.949626 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.949584 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 01 03:46:56.949769 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:56.949629 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls podName:f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb nodeName:}" failed. No retries permitted until 2026-08-01 03:46:57.44961549 +0000 UTC m=+35.586310363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jmbpt" (UID: "f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb") : secret "samples-operator-tls" not found Aug 01 03:46:56.950030 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.950004 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-trusted-ca\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.950379 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.950335 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/db5cce20-153a-4b78-a13c-d2ccec37733b-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.950472 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.950447 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-tmp\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.951437 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.951415 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76502bb9-609e-4bd2-9be9-16c4d04b7c35-serving-cert\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.952491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.952465 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-serving-cert\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.952623 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.952597 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-installation-pull-secrets\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.952686 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.952631 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-default-certificate\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.952686 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.952661 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.953115 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.953077 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-image-registry-private-configuration\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.953834 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.953814 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa83b609-4013-49b9-8e15-96baea198202-serving-cert\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.954234 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.954215 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-stats-auth\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.963974 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.963950 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ch57\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-kube-api-access-4ch57\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.964633 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.964587 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpf85\" (UniqueName: \"kubernetes.io/projected/aa83b609-4013-49b9-8e15-96baea198202-kube-api-access-fpf85\") pod \"console-operator-5ccd6b445f-gc6tf\" (UID: \"aa83b609-4013-49b9-8e15-96baea198202\") " pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:56.966208 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.965896 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-bound-sa-token\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:56.966208 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.966018 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99jg5\" (UniqueName: \"kubernetes.io/projected/9fdb4e9d-da57-424b-bb79-d64a3433cdae-kube-api-access-99jg5\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:56.966208 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.966162 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-675lb\" (UniqueName: \"kubernetes.io/projected/fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68-kube-api-access-675lb\") pod \"insights-operator-77696685b-42n7j\" (UID: \"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68\") " pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:56.966399 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.966353 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6t9\" (UniqueName: \"kubernetes.io/projected/db5cce20-153a-4b78-a13c-d2ccec37733b-kube-api-access-bq6t9\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:56.967343 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.966856 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8w6q\" (UniqueName: \"kubernetes.io/projected/76502bb9-609e-4bd2-9be9-16c4d04b7c35-kube-api-access-v8w6q\") pod \"service-ca-operator-784f97bcf6-gc5wz\" (UID: \"76502bb9-609e-4bd2-9be9-16c4d04b7c35\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:56.967343 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.966880 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd7z2\" (UniqueName: \"kubernetes.io/projected/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-kube-api-access-jd7z2\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:56.967532 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.967512 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7kkm\" (UniqueName: \"kubernetes.io/projected/7ad4ff14-ea4e-4145-b166-5e806cd41fb6-kube-api-access-c7kkm\") pod \"kube-storage-version-migrator-operator-7878f4b88c-9mm6d\" (UID: \"7ad4ff14-ea4e-4145-b166-5e806cd41fb6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:56.968185 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:56.968168 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f9vg\" (UniqueName: \"kubernetes.io/projected/2beeb1cd-95df-4440-b939-1b9ab91fe9db-kube-api-access-7f9vg\") pod \"volume-data-source-validator-5b8776669-wb5bh\" (UID: \"2beeb1cd-95df-4440-b939-1b9ab91fe9db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" Aug 01 03:46:57.041926 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.041893 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-42n7j" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051147 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssgcb\" (UniqueName: \"kubernetes.io/projected/a67a604a-ccf6-4870-aa1c-69bc9342ccb2-kube-api-access-ssgcb\") pod \"ingress-canary-sxb52\" (UID: \"a67a604a-ccf6-4870-aa1c-69bc9342ccb2\") " pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051198 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-tmp-dir\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051284 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnt5p\" (UniqueName: \"kubernetes.io/projected/899240e5-73dd-4598-a795-da0780772b80-kube-api-access-lnt5p\") pod \"network-check-source-65bdbbff45-lbbp7\" (UID: \"899240e5-73dd-4598-a795-da0780772b80\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051342 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a67a604a-ccf6-4870-aa1c-69bc9342ccb2-cert\") pod \"ingress-canary-sxb52\" (UID: \"a67a604a-ccf6-4870-aa1c-69bc9342ccb2\") " pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051365 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zm7\" (UniqueName: \"kubernetes.io/projected/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-kube-api-access-29zm7\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051388 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-config-volume\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.051413 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.051531 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.051590 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls podName:aa565f1b-1f89-46a2-b11a-34f9d02cbc43 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:57.551573651 +0000 UTC m=+35.688268524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls") pod "dns-default-vbpgv" (UID: "aa565f1b-1f89-46a2-b11a-34f9d02cbc43") : secret "dns-default-metrics-tls" not found Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.052253 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-tmp-dir\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.061450 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.053341 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-config-volume\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.066477 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.062215 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a67a604a-ccf6-4870-aa1c-69bc9342ccb2-cert\") pod \"ingress-canary-sxb52\" (UID: \"a67a604a-ccf6-4870-aa1c-69bc9342ccb2\") " pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:57.067579 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.067548 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnt5p\" (UniqueName: \"kubernetes.io/projected/899240e5-73dd-4598-a795-da0780772b80-kube-api-access-lnt5p\") pod \"network-check-source-65bdbbff45-lbbp7\" (UID: \"899240e5-73dd-4598-a795-da0780772b80\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" Aug 01 03:46:57.067911 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.067885 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zm7\" (UniqueName: \"kubernetes.io/projected/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-kube-api-access-29zm7\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.068948 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.068925 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssgcb\" (UniqueName: \"kubernetes.io/projected/a67a604a-ccf6-4870-aa1c-69bc9342ccb2-kube-api-access-ssgcb\") pod \"ingress-canary-sxb52\" (UID: \"a67a604a-ccf6-4870-aa1c-69bc9342ccb2\") " pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:57.076705 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.076688 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" Aug 01 03:46:57.086115 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.086100 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" Aug 01 03:46:57.101897 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.101877 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:46:57.107561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.107542 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" Aug 01 03:46:57.122458 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.122436 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sxb52" Aug 01 03:46:57.133203 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.133188 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" Aug 01 03:46:57.454587 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.454550 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.454607 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.454662 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454727 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:46:58.454704134 +0000 UTC m=+36.591399024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : configmap references non-existent config key: service-ca.crt Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454752 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454763 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc45b48f7-kvhsq: secret "image-registry-tls" not found Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.454777 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:57.454795 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454785 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454811 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls podName:0df5cb39-debb-4d1b-842f-622c5a03f694 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:58.454796292 +0000 UTC m=+36.591491162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls") pod "image-registry-cc45b48f7-kvhsq" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694") : secret "image-registry-tls" not found Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.454827 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454839 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls podName:f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb nodeName:}" failed. No retries permitted until 2026-08-01 03:46:58.454822374 +0000 UTC m=+36.591517248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jmbpt" (UID: "f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb") : secret "samples-operator-tls" not found Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454850 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454902 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454911 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:46:58.454893396 +0000 UTC m=+36.591588293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : secret "router-metrics-certs-default" not found Aug 01 03:46:57.455117 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.454945 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls podName:db5cce20-153a-4b78-a13c-d2ccec37733b nodeName:}" failed. No retries permitted until 2026-08-01 03:46:58.454932717 +0000 UTC m=+36.591627587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-wt4cr" (UID: "db5cce20-153a-4b78-a13c-d2ccec37733b") : secret "cluster-monitoring-operator-tls" not found Aug 01 03:46:57.555860 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:57.555825 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:57.556040 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.555980 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 01 03:46:57.556040 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:57.556038 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls podName:aa565f1b-1f89-46a2-b11a-34f9d02cbc43 nodeName:}" failed. No retries permitted until 2026-08-01 03:46:58.556019399 +0000 UTC m=+36.692714269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls") pod "dns-default-vbpgv" (UID: "aa565f1b-1f89-46a2-b11a-34f9d02cbc43") : secret "dns-default-metrics-tls" not found Aug 01 03:46:58.335534 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.335387 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh"] Aug 01 03:46:58.341611 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.341584 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sxb52"] Aug 01 03:46:58.348807 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.348746 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz"] Aug 01 03:46:58.354437 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.354414 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7"] Aug 01 03:46:58.357746 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.357713 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-42n7j"] Aug 01 03:46:58.358848 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.358827 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d"] Aug 01 03:46:58.360407 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.360386 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-gc6tf"] Aug 01 03:46:58.364267 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.364231 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2beeb1cd_95df_4440_b939_1b9ab91fe9db.slice/crio-79e074d2d370f92ab3d9c2c108729c223a4b478de9c458187a6f5a1af1446fc7 WatchSource:0}: Error finding container 79e074d2d370f92ab3d9c2c108729c223a4b478de9c458187a6f5a1af1446fc7: Status 404 returned error can't find the container with id 79e074d2d370f92ab3d9c2c108729c223a4b478de9c458187a6f5a1af1446fc7 Aug 01 03:46:58.364723 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.364685 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899240e5_73dd_4598_a795_da0780772b80.slice/crio-22d25e4b1cf3a6bbddba217a306eb127244dd01b0ae4bf031b180123df633cac WatchSource:0}: Error finding container 22d25e4b1cf3a6bbddba217a306eb127244dd01b0ae4bf031b180123df633cac: Status 404 returned error can't find the container with id 22d25e4b1cf3a6bbddba217a306eb127244dd01b0ae4bf031b180123df633cac Aug 01 03:46:58.366126 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.366032 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76502bb9_609e_4bd2_9be9_16c4d04b7c35.slice/crio-d49c500b4adc337182d9cc7d292b357092e0cf13648f538aba175ccb8dae3061 WatchSource:0}: Error finding container d49c500b4adc337182d9cc7d292b357092e0cf13648f538aba175ccb8dae3061: Status 404 returned error can't find the container with id d49c500b4adc337182d9cc7d292b357092e0cf13648f538aba175ccb8dae3061 Aug 01 03:46:58.366538 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.366517 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad4ff14_ea4e_4145_b166_5e806cd41fb6.slice/crio-3e16957766d427c99858d325335cb681c4599914e9af2d2bf6189c51da835fa3 WatchSource:0}: Error finding container 3e16957766d427c99858d325335cb681c4599914e9af2d2bf6189c51da835fa3: Status 404 returned error can't find the container with id 3e16957766d427c99858d325335cb681c4599914e9af2d2bf6189c51da835fa3 Aug 01 03:46:58.368970 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.368313 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa83b609_4013_49b9_8e15_96baea198202.slice/crio-8fa79ef45b59e965168fa1aacbd3a26de9e23566bed76ecd097f025045b8f6d8 WatchSource:0}: Error finding container 8fa79ef45b59e965168fa1aacbd3a26de9e23566bed76ecd097f025045b8f6d8: Status 404 returned error can't find the container with id 8fa79ef45b59e965168fa1aacbd3a26de9e23566bed76ecd097f025045b8f6d8 Aug 01 03:46:58.371094 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.370314 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67a604a_ccf6_4870_aa1c_69bc9342ccb2.slice/crio-638c16907ab89b6b520fd2d9639ca946f245378a16631635944230f431a1ef38 WatchSource:0}: Error finding container 638c16907ab89b6b520fd2d9639ca946f245378a16631635944230f431a1ef38: Status 404 returned error can't find the container with id 638c16907ab89b6b520fd2d9639ca946f245378a16631635944230f431a1ef38 Aug 01 03:46:58.371484 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:46:58.371462 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6799ce_b06d_42ae_8f46_9bf6e2dc6b68.slice/crio-d5b0805d977e75fcb4ae7b4f7a9ca579c7524121dc433c55cf6764fb25143864 WatchSource:0}: Error finding container d5b0805d977e75fcb4ae7b4f7a9ca579c7524121dc433c55cf6764fb25143864: Status 404 returned error can't find the container with id d5b0805d977e75fcb4ae7b4f7a9ca579c7524121dc433c55cf6764fb25143864 Aug 01 03:46:58.409231 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.409208 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:46:58.409310 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.409220 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:46:58.409360 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.409342 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:46:58.411648 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.411630 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 01 03:46:58.411765 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.411659 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 01 03:46:58.411995 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.411673 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5kk5q\"" Aug 01 03:46:58.411995 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.411676 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cmc5v\"" Aug 01 03:46:58.465376 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.465349 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:46:58.465463 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.465428 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:46:58.465463 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.465451 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:58.465570 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465451 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 01 03:46:58.465570 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465514 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 01 03:46:58.465570 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465528 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc45b48f7-kvhsq: secret "image-registry-tls" not found Aug 01 03:46:58.465570 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465541 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls podName:f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb nodeName:}" failed. No retries permitted until 2026-08-01 03:47:00.465521625 +0000 UTC m=+38.602216508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jmbpt" (UID: "f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb") : secret "samples-operator-tls" not found Aug 01 03:46:58.465570 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465548 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 01 03:46:58.465570 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.465473 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:46:58.465833 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465572 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls podName:0df5cb39-debb-4d1b-842f-622c5a03f694 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:00.46555477 +0000 UTC m=+38.602249648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls") pod "image-registry-cc45b48f7-kvhsq" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694") : secret "image-registry-tls" not found Aug 01 03:46:58.465833 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465594 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 01 03:46:58.465833 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465597 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls podName:db5cce20-153a-4b78-a13c-d2ccec37733b nodeName:}" failed. No retries permitted until 2026-08-01 03:47:00.465583745 +0000 UTC m=+38.602278627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-wt4cr" (UID: "db5cce20-153a-4b78-a13c-d2ccec37733b") : secret "cluster-monitoring-operator-tls" not found Aug 01 03:46:58.465833 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465653 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:00.4656394 +0000 UTC m=+38.602334271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : secret "router-metrics-certs-default" not found Aug 01 03:46:58.465833 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.465714 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:46:58.465833 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.465811 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:00.465801379 +0000 UTC m=+38.602496250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : configmap references non-existent config key: service-ca.crt Aug 01 03:46:58.566532 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.566511 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:46:58.566628 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.566583 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 01 03:46:58.566662 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:46:58.566629 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls podName:aa565f1b-1f89-46a2-b11a-34f9d02cbc43 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:00.566616753 +0000 UTC m=+38.703311623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls") pod "dns-default-vbpgv" (UID: "aa565f1b-1f89-46a2-b11a-34f9d02cbc43") : secret "dns-default-metrics-tls" not found Aug 01 03:46:58.606345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.606280 2551 generic.go:356] "Generic (PLEG): container finished" podID="acf6d1fa-9c69-4c0e-b093-8004856b35ec" containerID="5624e5f679118dc1ef91cc707b876e9df690cfdbbdd1b10e9042d2d6886b69fe" exitCode=0 Aug 01 03:46:58.606459 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.606359 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerDied","Data":"5624e5f679118dc1ef91cc707b876e9df690cfdbbdd1b10e9042d2d6886b69fe"} Aug 01 03:46:58.607490 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.607468 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" event={"ID":"aa83b609-4013-49b9-8e15-96baea198202","Type":"ContainerStarted","Data":"8fa79ef45b59e965168fa1aacbd3a26de9e23566bed76ecd097f025045b8f6d8"} Aug 01 03:46:58.608550 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.608531 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-42n7j" event={"ID":"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68","Type":"ContainerStarted","Data":"d5b0805d977e75fcb4ae7b4f7a9ca579c7524121dc433c55cf6764fb25143864"} Aug 01 03:46:58.609633 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.609612 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" event={"ID":"76502bb9-609e-4bd2-9be9-16c4d04b7c35","Type":"ContainerStarted","Data":"d49c500b4adc337182d9cc7d292b357092e0cf13648f538aba175ccb8dae3061"} Aug 01 03:46:58.610734 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.610707 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" event={"ID":"2beeb1cd-95df-4440-b939-1b9ab91fe9db","Type":"ContainerStarted","Data":"79e074d2d370f92ab3d9c2c108729c223a4b478de9c458187a6f5a1af1446fc7"} Aug 01 03:46:58.611819 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.611797 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" event={"ID":"7ad4ff14-ea4e-4145-b166-5e806cd41fb6","Type":"ContainerStarted","Data":"3e16957766d427c99858d325335cb681c4599914e9af2d2bf6189c51da835fa3"} Aug 01 03:46:58.612918 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.612895 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" event={"ID":"899240e5-73dd-4598-a795-da0780772b80","Type":"ContainerStarted","Data":"22d25e4b1cf3a6bbddba217a306eb127244dd01b0ae4bf031b180123df633cac"} Aug 01 03:46:58.614040 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:58.613944 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sxb52" event={"ID":"a67a604a-ccf6-4870-aa1c-69bc9342ccb2","Type":"ContainerStarted","Data":"638c16907ab89b6b520fd2d9639ca946f245378a16631635944230f431a1ef38"} Aug 01 03:46:59.625591 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:59.624829 2551 generic.go:356] "Generic (PLEG): container finished" podID="acf6d1fa-9c69-4c0e-b093-8004856b35ec" containerID="f437dbc66314f061457c4e9ce4adf489504519004b65a65a54f9a9ab44216acc" exitCode=0 Aug 01 03:46:59.625591 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:46:59.624928 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerDied","Data":"f437dbc66314f061457c4e9ce4adf489504519004b65a65a54f9a9ab44216acc"} Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.485262 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.485317 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.485344 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.485397 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.485459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485581 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485635 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485649 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc45b48f7-kvhsq: secret "image-registry-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485641 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls podName:f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb nodeName:}" failed. No retries permitted until 2026-08-01 03:47:04.485623236 +0000 UTC m=+42.622318126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jmbpt" (UID: "f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb") : secret "samples-operator-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485689 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls podName:0df5cb39-debb-4d1b-842f-622c5a03f694 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:04.485678958 +0000 UTC m=+42.622373837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls") pod "image-registry-cc45b48f7-kvhsq" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694") : secret "image-registry-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485750 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:04.485741126 +0000 UTC m=+42.622435996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : configmap references non-existent config key: service-ca.crt Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485801 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485830 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls podName:db5cce20-153a-4b78-a13c-d2ccec37733b nodeName:}" failed. No retries permitted until 2026-08-01 03:47:04.485821132 +0000 UTC m=+42.622516006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-wt4cr" (UID: "db5cce20-153a-4b78-a13c-d2ccec37733b") : secret "cluster-monitoring-operator-tls" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485581 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 01 03:47:00.486014 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.485880 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:04.4858525 +0000 UTC m=+42.622547372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : secret "router-metrics-certs-default" not found Aug 01 03:47:00.586300 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.586268 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:00.586533 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.586514 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 01 03:47:00.586626 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:00.586585 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls podName:aa565f1b-1f89-46a2-b11a-34f9d02cbc43 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:04.58656444 +0000 UTC m=+42.723259315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls") pod "dns-default-vbpgv" (UID: "aa565f1b-1f89-46a2-b11a-34f9d02cbc43") : secret "dns-default-metrics-tls" not found Aug 01 03:47:00.645829 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.645602 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-st7xq" event={"ID":"acf6d1fa-9c69-4c0e-b093-8004856b35ec","Type":"ContainerStarted","Data":"d5b42c927b9240f604d855199529d6bf7d7404fd867caedeaa9074e2c5a11cbf"} Aug 01 03:47:00.670623 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:00.670367 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-st7xq" podStartSLOduration=9.612527234 podStartE2EDuration="38.670346111s" totalImagesPullingTime="29.057818877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:00.668117557 +0000 UTC m=+38.804812462" watchObservedRunningTime="2026-08-01 03:47:00.670346111 +0000 UTC m=+38.807041004" Aug 01 03:47:04.523585 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:04.523544 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:04.523654 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:04.523681 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:04.523698 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523724 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523805 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls podName:f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb nodeName:}" failed. No retries permitted until 2026-08-01 03:47:12.523783346 +0000 UTC m=+50.660478229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jmbpt" (UID: "f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb") : secret "samples-operator-tls" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:04.523737 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523832 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523911 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc45b48f7-kvhsq: secret "image-registry-tls" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523965 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:12.523951881 +0000 UTC m=+50.660646774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : configmap references non-existent config key: service-ca.crt Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523889 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.523988 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls podName:0df5cb39-debb-4d1b-842f-622c5a03f694 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:12.52397795 +0000 UTC m=+50.660672822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls") pod "image-registry-cc45b48f7-kvhsq" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694") : secret "image-registry-tls" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.524030 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:12.524008045 +0000 UTC m=+50.660702958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : secret "router-metrics-certs-default" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.524070 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 01 03:47:04.524267 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.524134 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls podName:db5cce20-153a-4b78-a13c-d2ccec37733b nodeName:}" failed. No retries permitted until 2026-08-01 03:47:12.524121176 +0000 UTC m=+50.660816063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-wt4cr" (UID: "db5cce20-153a-4b78-a13c-d2ccec37733b") : secret "cluster-monitoring-operator-tls" not found Aug 01 03:47:04.624965 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:04.624920 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:04.625124 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.625069 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 01 03:47:04.625179 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:04.625168 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls podName:aa565f1b-1f89-46a2-b11a-34f9d02cbc43 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:12.625151719 +0000 UTC m=+50.761846602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls") pod "dns-default-vbpgv" (UID: "aa565f1b-1f89-46a2-b11a-34f9d02cbc43") : secret "dns-default-metrics-tls" not found Aug 01 03:47:06.664466 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.664426 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" event={"ID":"7ad4ff14-ea4e-4145-b166-5e806cd41fb6","Type":"ContainerStarted","Data":"b3c664e9cc5697e0c0c89aa94400f7df3becd6b07093a0e70267d6889332beab"} Aug 01 03:47:06.666055 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.666027 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" event={"ID":"899240e5-73dd-4598-a795-da0780772b80","Type":"ContainerStarted","Data":"b03b0a9cf7dfb65ceb550279d03ae4e91eaf9a038a6bf9fe060d682ce17d189c"} Aug 01 03:47:06.667686 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.667646 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sxb52" event={"ID":"a67a604a-ccf6-4870-aa1c-69bc9342ccb2","Type":"ContainerStarted","Data":"e8838f12ff5e0b0d3a9cc71a253fae336181015ec28f97d7ecfd023a36cad9f1"} Aug 01 03:47:06.669502 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.669481 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/0.log" Aug 01 03:47:06.669599 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.669522 2551 generic.go:356] "Generic (PLEG): container finished" podID="aa83b609-4013-49b9-8e15-96baea198202" containerID="636cb3bc65ff5d34dcdbb9420c3daae965867855ab4a1f9f68dcfcfb481c5c2a" exitCode=255 Aug 01 03:47:06.669653 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.669598 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" event={"ID":"aa83b609-4013-49b9-8e15-96baea198202","Type":"ContainerDied","Data":"636cb3bc65ff5d34dcdbb9420c3daae965867855ab4a1f9f68dcfcfb481c5c2a"} Aug 01 03:47:06.669782 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.669761 2551 scope.go:117] "RemoveContainer" containerID="636cb3bc65ff5d34dcdbb9420c3daae965867855ab4a1f9f68dcfcfb481c5c2a" Aug 01 03:47:06.671374 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.671356 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-42n7j" event={"ID":"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68","Type":"ContainerStarted","Data":"cca4cd8020768afc4799ace02ee30a2529555d69e31b9ef255f6e269787ec6d1"} Aug 01 03:47:06.679975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.679952 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" event={"ID":"76502bb9-609e-4bd2-9be9-16c4d04b7c35","Type":"ContainerStarted","Data":"ead1a80a5b1e0bced19a402cc6f1f6796f6a9c552488dfc56a7f75682aeaf27d"} Aug 01 03:47:06.681377 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.681302 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" event={"ID":"2beeb1cd-95df-4440-b939-1b9ab91fe9db","Type":"ContainerStarted","Data":"504675f751cf89dd6de65306dbdb6d67db7bf4bcc7fa83acdb94d932fd87af3e"} Aug 01 03:47:06.683210 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.683149 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" podStartSLOduration=20.171020746 podStartE2EDuration="27.683133436s" totalImagesPullingTime="7.51211269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:06.6829823 +0000 UTC m=+44.819677194" watchObservedRunningTime="2026-08-01 03:47:06.683133436 +0000 UTC m=+44.819828309" Aug 01 03:47:06.697945 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.697777 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sxb52" podStartSLOduration=3.191495519 podStartE2EDuration="10.697761424s" totalImagesPullingTime="7.506265905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:06.697466837 +0000 UTC m=+44.834161730" watchObservedRunningTime="2026-08-01 03:47:06.697761424 +0000 UTC m=+44.834456318" Aug 01 03:47:06.713879 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.713816 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-wb5bh" podStartSLOduration=26.493524432 podStartE2EDuration="33.713799074s" totalImagesPullingTime="7.220274642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:06.712968815 +0000 UTC m=+44.849663732" watchObservedRunningTime="2026-08-01 03:47:06.713799074 +0000 UTC m=+44.850493967" Aug 01 03:47:06.748630 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.748590 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" podStartSLOduration=20.234226659 podStartE2EDuration="27.748572249s" totalImagesPullingTime="7.51434559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:06.747582844 +0000 UTC m=+44.884277750" watchObservedRunningTime="2026-08-01 03:47:06.748572249 +0000 UTC m=+44.885267142" Aug 01 03:47:06.765953 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:06.765908 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-42n7j" podStartSLOduration=30.26022805 podStartE2EDuration="37.765895757s" totalImagesPullingTime="7.505667707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:06.765333204 +0000 UTC m=+44.902028096" watchObservedRunningTime="2026-08-01 03:47:06.765895757 +0000 UTC m=+44.902590643" Aug 01 03:47:07.102133 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.102099 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:47:07.102329 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.102155 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:47:07.382317 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.382223 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-lbbp7" podStartSLOduration=18.854725672 podStartE2EDuration="26.382207412s" totalImagesPullingTime="7.52748174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:06.785476649 +0000 UTC m=+44.922171542" watchObservedRunningTime="2026-08-01 03:47:07.382207412 +0000 UTC m=+45.518902304" Aug 01 03:47:07.382547 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.382531 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g"] Aug 01 03:47:07.403839 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.403811 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g"] Aug 01 03:47:07.404006 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.403918 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:07.406329 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.406305 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 01 03:47:07.406456 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.406367 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 01 03:47:07.406579 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.406565 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g6gmj\"" Aug 01 03:47:07.451954 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.451933 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:07.452065 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.452044 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:07.481725 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.481698 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9"] Aug 01 03:47:07.501523 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.501503 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9"] Aug 01 03:47:07.501611 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.501593 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" Aug 01 03:47:07.504015 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.503956 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 01 03:47:07.504015 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.503998 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-96fr9\"" Aug 01 03:47:07.504184 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.504019 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 01 03:47:07.553256 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.553230 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwf6r\" (UniqueName: \"kubernetes.io/projected/d7ba6b03-ad93-4959-bdad-e0b550207e27-kube-api-access-lwf6r\") pod \"migrator-68bc745d87-7hzc9\" (UID: \"d7ba6b03-ad93-4959-bdad-e0b550207e27\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" Aug 01 03:47:07.553379 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.553311 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:07.553440 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.553425 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:07.553479 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.553461 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 01 03:47:07.553525 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.553516 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert podName:894acdc9-8f1e-4dbf-a8e3-9a186d36b112 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:08.053500827 +0000 UTC m=+46.190195696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-2nl8g" (UID: "894acdc9-8f1e-4dbf-a8e3-9a186d36b112") : secret "networking-console-plugin-cert" not found Aug 01 03:47:07.554142 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.554124 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:07.655378 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.654933 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwf6r\" (UniqueName: \"kubernetes.io/projected/d7ba6b03-ad93-4959-bdad-e0b550207e27-kube-api-access-lwf6r\") pod \"migrator-68bc745d87-7hzc9\" (UID: \"d7ba6b03-ad93-4959-bdad-e0b550207e27\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" Aug 01 03:47:07.667473 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.667439 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwf6r\" (UniqueName: \"kubernetes.io/projected/d7ba6b03-ad93-4959-bdad-e0b550207e27-kube-api-access-lwf6r\") pod \"migrator-68bc745d87-7hzc9\" (UID: \"d7ba6b03-ad93-4959-bdad-e0b550207e27\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" Aug 01 03:47:07.688032 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.688001 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:47:07.688535 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.688515 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/0.log" Aug 01 03:47:07.688655 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.688571 2551 generic.go:356] "Generic (PLEG): container finished" podID="aa83b609-4013-49b9-8e15-96baea198202" containerID="323b48cbebefe1aa1fe11b0f387c680e6b2a2c2a7e3fff093eca0209b7b077f2" exitCode=255 Aug 01 03:47:07.688713 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.688672 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" event={"ID":"aa83b609-4013-49b9-8e15-96baea198202","Type":"ContainerDied","Data":"323b48cbebefe1aa1fe11b0f387c680e6b2a2c2a7e3fff093eca0209b7b077f2"} Aug 01 03:47:07.688763 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.688737 2551 scope.go:117] "RemoveContainer" containerID="636cb3bc65ff5d34dcdbb9420c3daae965867855ab4a1f9f68dcfcfb481c5c2a" Aug 01 03:47:07.689071 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.688953 2551 scope.go:117] "RemoveContainer" containerID="323b48cbebefe1aa1fe11b0f387c680e6b2a2c2a7e3fff093eca0209b7b077f2" Aug 01 03:47:07.689162 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.689132 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-gc6tf_openshift-console-operator(aa83b609-4013-49b9-8e15-96baea198202)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" podUID="aa83b609-4013-49b9-8e15-96baea198202" Aug 01 03:47:07.720364 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.720342 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wl7tv"] Aug 01 03:47:07.753972 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.753938 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wl7tv"] Aug 01 03:47:07.754105 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.754026 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.756493 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.756464 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 01 03:47:07.756746 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.756728 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 01 03:47:07.757170 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.757149 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f66qc\"" Aug 01 03:47:07.812368 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.812341 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" Aug 01 03:47:07.857970 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.857946 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/294622a3-9f6f-4e56-a6fb-1d815192cae6-crio-socket\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.857970 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.857975 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/294622a3-9f6f-4e56-a6fb-1d815192cae6-data-volume\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.858158 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.858074 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.858214 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.858200 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.858275 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.858258 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfdk\" (UniqueName: \"kubernetes.io/projected/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-api-access-drfdk\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959401 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959371 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959534 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959441 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959534 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959474 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drfdk\" (UniqueName: \"kubernetes.io/projected/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-api-access-drfdk\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959596 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.959531 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 03:47:07.959596 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.959580 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 01 03:47:07.959687 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.959607 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:08.459585163 +0000 UTC m=+46.596280050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : secret "insights-runtime-extractor-tls" not found Aug 01 03:47:07.959687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959629 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/294622a3-9f6f-4e56-a6fb-1d815192cae6-crio-socket\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959660 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/294622a3-9f6f-4e56-a6fb-1d815192cae6-data-volume\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959799 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:07.959713 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:08.45968001 +0000 UTC m=+46.596374893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : configmap "kube-rbac-proxy" not found Aug 01 03:47:07.959840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959803 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/294622a3-9f6f-4e56-a6fb-1d815192cae6-crio-socket\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.959970 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.959946 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/294622a3-9f6f-4e56-a6fb-1d815192cae6-data-volume\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:07.975229 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.975210 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9"] Aug 01 03:47:07.977545 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:07.977524 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ba6b03_ad93_4959_bdad_e0b550207e27.slice/crio-4087534c7488b9025a9e75b5933e6d98bcbb93b0c90d744cfe01b9308fc38fef WatchSource:0}: Error finding container 4087534c7488b9025a9e75b5933e6d98bcbb93b0c90d744cfe01b9308fc38fef: Status 404 returned error can't find the container with id 4087534c7488b9025a9e75b5933e6d98bcbb93b0c90d744cfe01b9308fc38fef Aug 01 03:47:07.982345 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:07.982325 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfdk\" (UniqueName: \"kubernetes.io/projected/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-api-access-drfdk\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:08.060926 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:08.060888 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:08.061105 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.061031 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 01 03:47:08.061105 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.061105 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert podName:894acdc9-8f1e-4dbf-a8e3-9a186d36b112 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:09.061091392 +0000 UTC m=+47.197786266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-2nl8g" (UID: "894acdc9-8f1e-4dbf-a8e3-9a186d36b112") : secret "networking-console-plugin-cert" not found Aug 01 03:47:08.464251 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:08.464218 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:08.464415 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:08.464281 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:08.464415 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.464360 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 03:47:08.464415 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.464389 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 01 03:47:08.464530 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.464420 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:09.464406308 +0000 UTC m=+47.601101179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : secret "insights-runtime-extractor-tls" not found Aug 01 03:47:08.464530 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.464434 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:09.464427453 +0000 UTC m=+47.601122323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : configmap "kube-rbac-proxy" not found Aug 01 03:47:08.694424 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:08.694391 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:47:08.694835 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:08.694744 2551 scope.go:117] "RemoveContainer" containerID="323b48cbebefe1aa1fe11b0f387c680e6b2a2c2a7e3fff093eca0209b7b077f2" Aug 01 03:47:08.694982 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:08.694960 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-gc6tf_openshift-console-operator(aa83b609-4013-49b9-8e15-96baea198202)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" podUID="aa83b609-4013-49b9-8e15-96baea198202" Aug 01 03:47:08.695747 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:08.695721 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" event={"ID":"d7ba6b03-ad93-4959-bdad-e0b550207e27","Type":"ContainerStarted","Data":"4087534c7488b9025a9e75b5933e6d98bcbb93b0c90d744cfe01b9308fc38fef"} Aug 01 03:47:09.069601 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:09.069560 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:09.069772 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:09.069734 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 01 03:47:09.069828 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:09.069816 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert podName:894acdc9-8f1e-4dbf-a8e3-9a186d36b112 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:11.069795547 +0000 UTC m=+49.206490420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-2nl8g" (UID: "894acdc9-8f1e-4dbf-a8e3-9a186d36b112") : secret "networking-console-plugin-cert" not found Aug 01 03:47:09.473002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:09.472965 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:09.473164 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:09.473116 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 03:47:09.473205 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:09.473155 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:09.473205 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:09.473178 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:11.473163012 +0000 UTC m=+49.609857883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : secret "insights-runtime-extractor-tls" not found Aug 01 03:47:09.473569 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:09.473547 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/294622a3-9f6f-4e56-a6fb-1d815192cae6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:09.699925 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:09.699899 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" event={"ID":"d7ba6b03-ad93-4959-bdad-e0b550207e27","Type":"ContainerStarted","Data":"0c59d5ef36908849f5b87697b83335dbadb3f016f4c068b39f32ea9786eab90a"} Aug 01 03:47:10.277295 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:10.277258 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wxxsx_cbb9551d-b961-4e27-b5d8-a91579f5515d/dns-node-resolver/0.log" Aug 01 03:47:10.704676 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:10.704637 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" event={"ID":"d7ba6b03-ad93-4959-bdad-e0b550207e27","Type":"ContainerStarted","Data":"938d28da3f8de33124090869b17cd0d417022e1e707fb6ce5734b636c357edf4"} Aug 01 03:47:10.739127 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:10.739080 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-7hzc9" podStartSLOduration=2.136570526 podStartE2EDuration="3.739065731s" totalImagesPullingTime="1.602495205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:10.738250961 +0000 UTC m=+48.874945854" watchObservedRunningTime="2026-08-01 03:47:10.739065731 +0000 UTC m=+48.875760784" Aug 01 03:47:10.877555 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:10.877528 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8j2vw_4269d1c8-5d35-4410-b7b2-ba3ee5fac652/node-ca/0.log" Aug 01 03:47:11.084612 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:11.084534 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:11.084777 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:11.084710 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 01 03:47:11.084838 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:11.084788 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert podName:894acdc9-8f1e-4dbf-a8e3-9a186d36b112 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:15.084767953 +0000 UTC m=+53.221462823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-2nl8g" (UID: "894acdc9-8f1e-4dbf-a8e3-9a186d36b112") : secret "networking-console-plugin-cert" not found Aug 01 03:47:11.487448 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:11.487420 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:11.487606 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:11.487577 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 03:47:11.487648 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:11.487641 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:15.487626563 +0000 UTC m=+53.624321433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : secret "insights-runtime-extractor-tls" not found Aug 01 03:47:11.876429 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:11.876356 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sxb52_a67a604a-ccf6-4870-aa1c-69bc9342ccb2/serve-healthcheck-canary/0.log" Aug 01 03:47:12.076274 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.076245 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-7hzc9_d7ba6b03-ad93-4959-bdad-e0b550207e27/migrator/0.log" Aug 01 03:47:12.276373 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.276347 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-7hzc9_d7ba6b03-ad93-4959-bdad-e0b550207e27/graceful-termination/0.log" Aug 01 03:47:12.477006 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.476974 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-9mm6d_7ad4ff14-ea4e-4145-b166-5e806cd41fb6/kube-storage-version-migrator-operator/0.log" Aug 01 03:47:12.595841 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.595769 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:47:12.595841 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.595836 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:12.596024 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.595880 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:12.596024 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.595898 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:47:12.596024 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.595921 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 01 03:47:12.596024 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.595932 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:12.596024 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.595988 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.596023 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.595991 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls podName:f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.595972511 +0000 UTC m=+66.732667398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jmbpt" (UID: "f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb") : secret "samples-operator-tls" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.595992 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.596081 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.596068621 +0000 UTC m=+66.732763506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : secret "router-metrics-certs-default" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.596087 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cc45b48f7-kvhsq: secret "image-registry-tls" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.596102 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle podName:9fdb4e9d-da57-424b-bb79-d64a3433cdae nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.596090735 +0000 UTC m=+66.732785619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle") pod "router-default-8667677bb4-4p75c" (UID: "9fdb4e9d-da57-424b-bb79-d64a3433cdae") : configmap references non-existent config key: service-ca.crt Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.596126 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls podName:0df5cb39-debb-4d1b-842f-622c5a03f694 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.596111426 +0000 UTC m=+66.732806300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls") pod "image-registry-cc45b48f7-kvhsq" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694") : secret "image-registry-tls" not found Aug 01 03:47:12.596187 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.596140 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls podName:db5cce20-153a-4b78-a13c-d2ccec37733b nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.596133865 +0000 UTC m=+66.732828739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-wt4cr" (UID: "db5cce20-153a-4b78-a13c-d2ccec37733b") : secret "cluster-monitoring-operator-tls" not found Aug 01 03:47:12.696970 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:12.696937 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:12.697119 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.697099 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 01 03:47:12.697182 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:12.697165 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls podName:aa565f1b-1f89-46a2-b11a-34f9d02cbc43 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:28.697149771 +0000 UTC m=+66.833844641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls") pod "dns-default-vbpgv" (UID: "aa565f1b-1f89-46a2-b11a-34f9d02cbc43") : secret "dns-default-metrics-tls" not found Aug 01 03:47:15.122201 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:15.122164 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:15.122614 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:15.122312 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 01 03:47:15.122614 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:15.122381 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert podName:894acdc9-8f1e-4dbf-a8e3-9a186d36b112 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:23.12236507 +0000 UTC m=+61.259059941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-2nl8g" (UID: "894acdc9-8f1e-4dbf-a8e3-9a186d36b112") : secret "networking-console-plugin-cert" not found Aug 01 03:47:15.526130 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:15.526093 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:15.526332 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:15.526267 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 03:47:15.526400 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:15.526351 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls podName:294622a3-9f6f-4e56-a6fb-1d815192cae6 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:23.526330207 +0000 UTC m=+61.663025077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl7tv" (UID: "294622a3-9f6f-4e56-a6fb-1d815192cae6") : secret "insights-runtime-extractor-tls" not found Aug 01 03:47:17.102151 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.102115 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:47:17.102641 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.102173 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:47:17.102641 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.102469 2551 scope.go:117] "RemoveContainer" containerID="323b48cbebefe1aa1fe11b0f387c680e6b2a2c2a7e3fff093eca0209b7b077f2" Aug 01 03:47:17.727655 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.727630 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:47:17.727819 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.727672 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" event={"ID":"aa83b609-4013-49b9-8e15-96baea198202","Type":"ContainerStarted","Data":"ee6c6d8d382510ed4131f3feb4f319b04da13b9ffcd502e5dc74e61c7d7f48f6"} Aug 01 03:47:17.727999 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.727979 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:47:17.732493 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.732468 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" Aug 01 03:47:17.744559 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:17.744517 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-gc6tf" podStartSLOduration=35.238527751 podStartE2EDuration="42.744504236s" totalImagesPullingTime="7.505976485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:17.743977851 +0000 UTC m=+55.880672743" watchObservedRunningTime="2026-08-01 03:47:17.744504236 +0000 UTC m=+55.881199127" Aug 01 03:47:23.193524 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.193481 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:23.195786 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.195764 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/894acdc9-8f1e-4dbf-a8e3-9a186d36b112-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-2nl8g\" (UID: \"894acdc9-8f1e-4dbf-a8e3-9a186d36b112\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:23.317054 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.317024 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g6gmj\"" Aug 01 03:47:23.325838 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.325822 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" Aug 01 03:47:23.445461 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.445396 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g"] Aug 01 03:47:23.448423 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:23.448391 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894acdc9_8f1e_4dbf_a8e3_9a186d36b112.slice/crio-0912e58c829a91859fa62d204e1f6e2aedc9a516de85d5cf73b67045238e4aa9 WatchSource:0}: Error finding container 0912e58c829a91859fa62d204e1f6e2aedc9a516de85d5cf73b67045238e4aa9: Status 404 returned error can't find the container with id 0912e58c829a91859fa62d204e1f6e2aedc9a516de85d5cf73b67045238e4aa9 Aug 01 03:47:23.500860 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.500837 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjdln" Aug 01 03:47:23.602071 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.602042 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:23.604328 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.604307 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/294622a3-9f6f-4e56-a6fb-1d815192cae6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl7tv\" (UID: \"294622a3-9f6f-4e56-a6fb-1d815192cae6\") " pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:23.666972 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.666948 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f66qc\"" Aug 01 03:47:23.674848 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.674825 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wl7tv" Aug 01 03:47:23.752906 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.752845 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" event={"ID":"894acdc9-8f1e-4dbf-a8e3-9a186d36b112","Type":"ContainerStarted","Data":"0912e58c829a91859fa62d204e1f6e2aedc9a516de85d5cf73b67045238e4aa9"} Aug 01 03:47:23.795363 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:23.795339 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wl7tv"] Aug 01 03:47:23.798409 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:23.798384 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294622a3_9f6f_4e56_a6fb_1d815192cae6.slice/crio-241c3b72ddae6226ab85e9987f9f5ad823c4692cacee6344f07d2ca841476dc8 WatchSource:0}: Error finding container 241c3b72ddae6226ab85e9987f9f5ad823c4692cacee6344f07d2ca841476dc8: Status 404 returned error can't find the container with id 241c3b72ddae6226ab85e9987f9f5ad823c4692cacee6344f07d2ca841476dc8 Aug 01 03:47:24.758310 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:24.758279 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" event={"ID":"894acdc9-8f1e-4dbf-a8e3-9a186d36b112","Type":"ContainerStarted","Data":"c3609bd0246b293495e9bec7f0a221ac49bf00f43a54955209db4b429f096fa9"} Aug 01 03:47:24.760073 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:24.760054 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl7tv" event={"ID":"294622a3-9f6f-4e56-a6fb-1d815192cae6","Type":"ContainerStarted","Data":"e3141673b8b49c6d745d6ccf7fa85b94411158611fdde0f6bcf76ea36996cebd"} Aug 01 03:47:24.760157 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:24.760094 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl7tv" event={"ID":"294622a3-9f6f-4e56-a6fb-1d815192cae6","Type":"ContainerStarted","Data":"241c3b72ddae6226ab85e9987f9f5ad823c4692cacee6344f07d2ca841476dc8"} Aug 01 03:47:24.772927 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:24.772879 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-2nl8g" podStartSLOduration=16.680921823 podStartE2EDuration="17.77285174s" totalImagesPullingTime="1.091929917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:24.772155778 +0000 UTC m=+62.908850671" watchObservedRunningTime="2026-08-01 03:47:24.77285174 +0000 UTC m=+62.909546632" Aug 01 03:47:25.764775 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:25.764741 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl7tv" event={"ID":"294622a3-9f6f-4e56-a6fb-1d815192cae6","Type":"ContainerStarted","Data":"4d53cbd64daef8ef37e4d52d6eee536f7463ff9eeffea0418ed472a49e49fb59"} Aug 01 03:47:26.769787 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:26.769747 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl7tv" event={"ID":"294622a3-9f6f-4e56-a6fb-1d815192cae6","Type":"ContainerStarted","Data":"eaf9c9274b35b387797a77362be14620d2304852972ffe8652a63625245d3dec"} Aug 01 03:47:26.788273 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:26.788224 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wl7tv" podStartSLOduration=17.464887391 podStartE2EDuration="19.788207385s" totalImagesPullingTime="2.323319994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:47:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:26.787610675 +0000 UTC m=+64.924305572" watchObservedRunningTime="2026-08-01 03:47:26.788207385 +0000 UTC m=+64.924902276" Aug 01 03:47:28.044397 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.044350 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:47:28.044807 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.044484 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:47:28.046738 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.046717 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 01 03:47:28.046858 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.046745 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 01 03:47:28.056765 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.056725 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b077824-7dc9-4c9d-90f7-fa316a428ed8-metrics-certs\") pod \"network-metrics-daemon-drdqf\" (UID: \"9b077824-7dc9-4c9d-90f7-fa316a428ed8\") " pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:47:28.056933 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.056727 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf767701-eecb-43af-9d53-914dd86cd5a7-original-pull-secret\") pod \"global-pull-secret-syncer-4dzmp\" (UID: \"bf767701-eecb-43af-9d53-914dd86cd5a7\") " pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:47:28.145217 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.145180 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:47:28.147613 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.147590 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jgt\" (UniqueName: \"kubernetes.io/projected/b815631a-7938-46e6-b36b-26afc52fd391-kube-api-access-p2jgt\") pod \"network-check-target-qgv49\" (UID: \"b815631a-7938-46e6-b36b-26afc52fd391\") " pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:47:28.158998 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.158978 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cmc5v\"" Aug 01 03:47:28.163622 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.163604 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5kk5q\"" Aug 01 03:47:28.167316 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.167303 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:47:28.170207 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.170190 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dzmp" Aug 01 03:47:28.172911 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.172798 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drdqf" Aug 01 03:47:28.339522 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.339495 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drdqf"] Aug 01 03:47:28.342680 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:28.342654 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b077824_7dc9_4c9d_90f7_fa316a428ed8.slice/crio-de4d6bd4d737140fb35c5cc8e32404289570ceaa2ef33d7db04d7541a68d5261 WatchSource:0}: Error finding container de4d6bd4d737140fb35c5cc8e32404289570ceaa2ef33d7db04d7541a68d5261: Status 404 returned error can't find the container with id de4d6bd4d737140fb35c5cc8e32404289570ceaa2ef33d7db04d7541a68d5261 Aug 01 03:47:28.557927 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.557832 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dzmp"] Aug 01 03:47:28.561220 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.561195 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qgv49"] Aug 01 03:47:28.562649 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:28.562621 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf767701_eecb_43af_9d53_914dd86cd5a7.slice/crio-110fad04b655b2a967c8397bd27bc465f061bc6d4fec2194908c961f52f46123 WatchSource:0}: Error finding container 110fad04b655b2a967c8397bd27bc465f061bc6d4fec2194908c961f52f46123: Status 404 returned error can't find the container with id 110fad04b655b2a967c8397bd27bc465f061bc6d4fec2194908c961f52f46123 Aug 01 03:47:28.563401 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:28.563378 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb815631a_7938_46e6_b36b_26afc52fd391.slice/crio-a8f6e0abad8847a305d4f08f78366476bc8bed0fd80334d41243032bc85974d6 WatchSource:0}: Error finding container a8f6e0abad8847a305d4f08f78366476bc8bed0fd80334d41243032bc85974d6: Status 404 returned error can't find the container with id a8f6e0abad8847a305d4f08f78366476bc8bed0fd80334d41243032bc85974d6 Aug 01 03:47:28.652692 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.652659 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:28.652810 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.652715 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:47:28.652810 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.652762 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:28.652810 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.652784 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:28.653005 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.652808 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:47:28.653370 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.653317 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdb4e9d-da57-424b-bb79-d64a3433cdae-service-ca-bundle\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:28.655090 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.655069 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jmbpt\" (UID: \"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:47:28.655197 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.655132 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/db5cce20-153a-4b78-a13c-d2ccec37733b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-wt4cr\" (UID: \"db5cce20-153a-4b78-a13c-d2ccec37733b\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:47:28.655477 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.655458 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fdb4e9d-da57-424b-bb79-d64a3433cdae-metrics-certs\") pod \"router-default-8667677bb4-4p75c\" (UID: \"9fdb4e9d-da57-424b-bb79-d64a3433cdae\") " pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:28.655477 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.655474 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"image-registry-cc45b48f7-kvhsq\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:28.754048 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.754010 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:28.756272 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.756251 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa565f1b-1f89-46a2-b11a-34f9d02cbc43-metrics-tls\") pod \"dns-default-vbpgv\" (UID: \"aa565f1b-1f89-46a2-b11a-34f9d02cbc43\") " pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:28.776934 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.776903 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dzmp" event={"ID":"bf767701-eecb-43af-9d53-914dd86cd5a7","Type":"ContainerStarted","Data":"110fad04b655b2a967c8397bd27bc465f061bc6d4fec2194908c961f52f46123"} Aug 01 03:47:28.778012 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.777984 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drdqf" event={"ID":"9b077824-7dc9-4c9d-90f7-fa316a428ed8","Type":"ContainerStarted","Data":"de4d6bd4d737140fb35c5cc8e32404289570ceaa2ef33d7db04d7541a68d5261"} Aug 01 03:47:28.779245 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.779227 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgv49" event={"ID":"b815631a-7938-46e6-b36b-26afc52fd391","Type":"ContainerStarted","Data":"cb53388d7aaf3a3b9e9b8d47700a8c25feaa850e9f6d607792f956a43ebf7060"} Aug 01 03:47:28.779327 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.779258 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qgv49" event={"ID":"b815631a-7938-46e6-b36b-26afc52fd391","Type":"ContainerStarted","Data":"a8f6e0abad8847a305d4f08f78366476bc8bed0fd80334d41243032bc85974d6"} Aug 01 03:47:28.779375 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.779349 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:47:28.793850 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.793806 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qgv49" podStartSLOduration=66.793793408 podStartE2EDuration="1m6.793793408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:28.793289173 +0000 UTC m=+66.929984065" watchObservedRunningTime="2026-08-01 03:47:28.793793408 +0000 UTC m=+66.930488299" Aug 01 03:47:28.856024 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.855965 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hc9pw\"" Aug 01 03:47:28.863782 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.863760 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" Aug 01 03:47:28.867178 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.867163 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m44mr\"" Aug 01 03:47:28.875909 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.875893 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:28.896397 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.896378 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jpfqc\"" Aug 01 03:47:28.905200 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.905184 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" Aug 01 03:47:28.918974 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.918939 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h8ffs\"" Aug 01 03:47:28.926904 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.926857 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:28.930038 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.930008 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xd9zx\"" Aug 01 03:47:28.939058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:28.938989 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:29.056077 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.054912 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr"] Aug 01 03:47:29.102309 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.102206 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8667677bb4-4p75c"] Aug 01 03:47:29.141590 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.141494 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt"] Aug 01 03:47:29.184352 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.183610 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cc45b48f7-kvhsq"] Aug 01 03:47:29.213964 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.213938 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vbpgv"] Aug 01 03:47:29.216952 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:29.216915 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa565f1b_1f89_46a2_b11a_34f9d02cbc43.slice/crio-548a97fa0b3d7712f6419b185e402de6c2476606a45fc693cf61fdedf2c3c342 WatchSource:0}: Error finding container 548a97fa0b3d7712f6419b185e402de6c2476606a45fc693cf61fdedf2c3c342: Status 404 returned error can't find the container with id 548a97fa0b3d7712f6419b185e402de6c2476606a45fc693cf61fdedf2c3c342 Aug 01 03:47:29.776193 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.776159 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cc45b48f7-kvhsq"] Aug 01 03:47:29.786377 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.786346 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbpgv" event={"ID":"aa565f1b-1f89-46a2-b11a-34f9d02cbc43","Type":"ContainerStarted","Data":"548a97fa0b3d7712f6419b185e402de6c2476606a45fc693cf61fdedf2c3c342"} Aug 01 03:47:29.787880 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.787829 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" event={"ID":"db5cce20-153a-4b78-a13c-d2ccec37733b","Type":"ContainerStarted","Data":"e5dd4dbcdaddefbd4520d637b9deefa5742b56ed4dd093b64cc0c09806eba246"} Aug 01 03:47:29.790417 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.790336 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" event={"ID":"0df5cb39-debb-4d1b-842f-622c5a03f694","Type":"ContainerStarted","Data":"3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9"} Aug 01 03:47:29.790417 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.790383 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" event={"ID":"0df5cb39-debb-4d1b-842f-622c5a03f694","Type":"ContainerStarted","Data":"ba967401b85cf2010fd13c5e0bc469fc13b6ae4954b50f06cdd52a1558823ca9"} Aug 01 03:47:29.790609 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.790558 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:29.792446 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.792422 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8667677bb4-4p75c" event={"ID":"9fdb4e9d-da57-424b-bb79-d64a3433cdae","Type":"ContainerStarted","Data":"523810352e85f67b33423253e014b45b08436c74e7c7114fe267a771c4447bcc"} Aug 01 03:47:29.792555 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.792464 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8667677bb4-4p75c" event={"ID":"9fdb4e9d-da57-424b-bb79-d64a3433cdae","Type":"ContainerStarted","Data":"a71c1b8151a71fea5dde046fbddf231746d7edcece0d6d1f43706353b52cb032"} Aug 01 03:47:29.794032 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.794007 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" event={"ID":"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb","Type":"ContainerStarted","Data":"0a4ca74487468730304e925b18d23ca23dda258d3f053621e0d3e87bb7ffa41b"} Aug 01 03:47:29.818470 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.818395 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" podStartSLOduration=48.818373634 podStartE2EDuration="48.818373634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:29.817201922 +0000 UTC m=+67.953896815" watchObservedRunningTime="2026-08-01 03:47:29.818373634 +0000 UTC m=+67.955068528" Aug 01 03:47:29.865246 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.865182 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8667677bb4-4p75c" podStartSLOduration=59.865158737 podStartE2EDuration="59.865158737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:29.845556142 +0000 UTC m=+67.982251060" watchObservedRunningTime="2026-08-01 03:47:29.865158737 +0000 UTC m=+68.001853631" Aug 01 03:47:29.866478 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.866458 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5697cd44b7-pdgb4"] Aug 01 03:47:29.901185 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.901147 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5697cd44b7-pdgb4"] Aug 01 03:47:29.901380 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.901212 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:29.901380 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.901298 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:29.901380 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:29.901371 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.065755 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.065675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b665x\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-kube-api-access-b665x\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.065767 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-bound-sa-token\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.065823 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-registry-tls\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.065854 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cebacf9f-f776-4f92-ba7a-65d82845558f-trusted-ca\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.065908 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cebacf9f-f776-4f92-ba7a-65d82845558f-ca-trust-extracted\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.065945 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cebacf9f-f776-4f92-ba7a-65d82845558f-installation-pull-secrets\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.066026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cebacf9f-f776-4f92-ba7a-65d82845558f-registry-certificates\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.066166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.066087 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cebacf9f-f776-4f92-ba7a-65d82845558f-image-registry-private-configuration\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167409 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cebacf9f-f776-4f92-ba7a-65d82845558f-registry-certificates\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cebacf9f-f776-4f92-ba7a-65d82845558f-image-registry-private-configuration\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167522 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b665x\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-kube-api-access-b665x\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167555 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-bound-sa-token\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167595 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-registry-tls\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167617 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cebacf9f-f776-4f92-ba7a-65d82845558f-trusted-ca\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167640 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cebacf9f-f776-4f92-ba7a-65d82845558f-ca-trust-extracted\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168248 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.167715 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cebacf9f-f776-4f92-ba7a-65d82845558f-installation-pull-secrets\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.168784 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.168711 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cebacf9f-f776-4f92-ba7a-65d82845558f-ca-trust-extracted\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.169262 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.169236 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cebacf9f-f776-4f92-ba7a-65d82845558f-trusted-ca\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.170081 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.170056 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cebacf9f-f776-4f92-ba7a-65d82845558f-registry-certificates\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.171978 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.171955 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cebacf9f-f776-4f92-ba7a-65d82845558f-image-registry-private-configuration\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.172135 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.172096 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cebacf9f-f776-4f92-ba7a-65d82845558f-installation-pull-secrets\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.174628 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.174601 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-registry-tls\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.175913 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.175830 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-bound-sa-token\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.177379 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.177342 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b665x\" (UniqueName: \"kubernetes.io/projected/cebacf9f-f776-4f92-ba7a-65d82845558f-kube-api-access-b665x\") pod \"image-registry-5697cd44b7-pdgb4\" (UID: \"cebacf9f-f776-4f92-ba7a-65d82845558f\") " pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.213057 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.212846 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.407555 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.407046 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5697cd44b7-pdgb4"] Aug 01 03:47:30.413565 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:30.413504 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebacf9f_f776_4f92_ba7a_65d82845558f.slice/crio-29bf38d86eb71903f04079cb10244c4201ca254800d652d337231415cfb57f43 WatchSource:0}: Error finding container 29bf38d86eb71903f04079cb10244c4201ca254800d652d337231415cfb57f43: Status 404 returned error can't find the container with id 29bf38d86eb71903f04079cb10244c4201ca254800d652d337231415cfb57f43 Aug 01 03:47:30.802628 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.802585 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" event={"ID":"cebacf9f-f776-4f92-ba7a-65d82845558f","Type":"ContainerStarted","Data":"e1a72faf004a7c69fe2c15f148e1b1801bbc703347f23f13896e1316f87a2e98"} Aug 01 03:47:30.802804 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.802657 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" event={"ID":"cebacf9f-f776-4f92-ba7a-65d82845558f","Type":"ContainerStarted","Data":"29bf38d86eb71903f04079cb10244c4201ca254800d652d337231415cfb57f43"} Aug 01 03:47:30.803546 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.803522 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:30.806222 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.806139 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drdqf" event={"ID":"9b077824-7dc9-4c9d-90f7-fa316a428ed8","Type":"ContainerStarted","Data":"e18f5009d0e4b71ccf8f3b55b05eedcb4f6268dbde57b9c39d3d66235a3b80ea"} Aug 01 03:47:30.806222 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.806185 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drdqf" event={"ID":"9b077824-7dc9-4c9d-90f7-fa316a428ed8","Type":"ContainerStarted","Data":"807a68e61e753138690cdc1526bc29546d58d2ab1c305aef69f95a456bb3e932"} Aug 01 03:47:30.806513 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.806475 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:30.808099 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.808050 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8667677bb4-4p75c" Aug 01 03:47:30.822070 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.821629 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" podStartSLOduration=1.8216124470000001 podStartE2EDuration="1.821612447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:30.821004893 +0000 UTC m=+68.957699809" watchObservedRunningTime="2026-08-01 03:47:30.821612447 +0000 UTC m=+68.958307334" Aug 01 03:47:30.838346 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:30.838211 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-drdqf" podStartSLOduration=67.098983259 podStartE2EDuration="1m8.838191418s" totalImagesPullingTime="1.739208159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:30.837981193 +0000 UTC m=+68.974676086" watchObservedRunningTime="2026-08-01 03:47:30.838191418 +0000 UTC m=+68.974886313" Aug 01 03:47:35.827090 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.827054 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" event={"ID":"db5cce20-153a-4b78-a13c-d2ccec37733b","Type":"ContainerStarted","Data":"a48782eee9796fafa66c571dbc564e5e255f2d16e9ceda6359d35de25e4391b5"} Aug 01 03:47:35.828630 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.828598 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dzmp" event={"ID":"bf767701-eecb-43af-9d53-914dd86cd5a7","Type":"ContainerStarted","Data":"02ed8055cb9aa29ce44049ff3ec5f6f177046346502635b956a7b587fd9ebb93"} Aug 01 03:47:35.830359 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.830340 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" event={"ID":"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb","Type":"ContainerStarted","Data":"dae2203b66ebd500a6bbe3aa115c686eb92a2bc270868b380a78497d4977b437"} Aug 01 03:47:35.830454 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.830386 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" event={"ID":"f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb","Type":"ContainerStarted","Data":"152a156da55bf09097bf5b54416f11d5ac5e3ebb36ee5022b14909b74f029352"} Aug 01 03:47:35.831959 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.831937 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbpgv" event={"ID":"aa565f1b-1f89-46a2-b11a-34f9d02cbc43","Type":"ContainerStarted","Data":"f6b484068da921b14d1c804999f3fca389afe845238b664691a02eee2c55f01c"} Aug 01 03:47:35.832055 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.831981 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbpgv" event={"ID":"aa565f1b-1f89-46a2-b11a-34f9d02cbc43","Type":"ContainerStarted","Data":"08e8efb905e7ec0294773589e924ad3a977b9c05343a6b413dc6f1342d173525"} Aug 01 03:47:35.832111 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.832093 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:35.855580 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.855537 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-wt4cr" podStartSLOduration=59.809771201 podStartE2EDuration="1m5.855525564s" totalImagesPullingTime="6.045754363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:35.852802633 +0000 UTC m=+73.989497525" watchObservedRunningTime="2026-08-01 03:47:35.855525564 +0000 UTC m=+73.992220474" Aug 01 03:47:35.878541 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.878494 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4dzmp" podStartSLOduration=67.328085669 podStartE2EDuration="1m13.878483203s" totalImagesPullingTime="6.550397534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:35.876695879 +0000 UTC m=+74.013390772" watchObservedRunningTime="2026-08-01 03:47:35.878483203 +0000 UTC m=+74.015178096" Aug 01 03:47:35.933588 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.933542 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jmbpt" podStartSLOduration=57.052890834 podStartE2EDuration="1m2.933523898s" totalImagesPullingTime="5.880633064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:35.93018023 +0000 UTC m=+74.066875122" watchObservedRunningTime="2026-08-01 03:47:35.933523898 +0000 UTC m=+74.070218794" Aug 01 03:47:35.953922 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:35.953845 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vbpgv" podStartSLOduration=34.057674522 podStartE2EDuration="39.953827976s" totalImagesPullingTime="5.896153454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:35.953496271 +0000 UTC m=+74.090191155" watchObservedRunningTime="2026-08-01 03:47:35.953827976 +0000 UTC m=+74.090522871" Aug 01 03:47:45.837946 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:45.837824 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vbpgv" Aug 01 03:47:47.170689 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.170660 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zqvk9"] Aug 01 03:47:47.172995 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.172976 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.175026 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.175003 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 01 03:47:47.175398 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.175377 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 01 03:47:47.175465 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.175408 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 01 03:47:47.176011 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.175994 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 01 03:47:47.176011 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.176010 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d6d4x\"" Aug 01 03:47:47.198326 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198302 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rcvb\" (UniqueName: \"kubernetes.io/projected/687952f9-195a-4c64-b544-9b4a268ffd03-kube-api-access-2rcvb\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198440 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198338 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/687952f9-195a-4c64-b544-9b4a268ffd03-metrics-client-ca\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198440 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198366 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-textfile\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198440 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198408 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198440 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198438 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-sys\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198577 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198482 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198577 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198527 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-tls\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198577 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198543 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-wtmp\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.198577 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.198557 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-root\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.298940 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.298910 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-tls\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.298940 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.298941 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-wtmp\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.298957 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-root\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.298978 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rcvb\" (UniqueName: \"kubernetes.io/projected/687952f9-195a-4c64-b544-9b4a268ffd03-kube-api-access-2rcvb\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299000 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/687952f9-195a-4c64-b544-9b4a268ffd03-metrics-client-ca\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299029 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-textfile\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:47.299051 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299057 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-root\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299088 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-wtmp\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299126 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:47.299117 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-tls podName:687952f9-195a-4c64-b544-9b4a268ffd03 nodeName:}" failed. No retries permitted until 2026-08-01 03:47:47.799097193 +0000 UTC m=+85.935792064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-tls") pod "node-exporter-zqvk9" (UID: "687952f9-195a-4c64-b544-9b4a268ffd03") : secret "node-exporter-tls" not found Aug 01 03:47:47.299516 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299143 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299516 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299171 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-sys\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299516 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299210 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299516 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299259 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/687952f9-195a-4c64-b544-9b4a268ffd03-sys\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299516 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299347 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-textfile\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299695 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299564 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/687952f9-195a-4c64-b544-9b4a268ffd03-metrics-client-ca\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.299695 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.299687 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.301383 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.301363 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.307183 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.307163 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rcvb\" (UniqueName: \"kubernetes.io/projected/687952f9-195a-4c64-b544-9b4a268ffd03-kube-api-access-2rcvb\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.803472 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.803444 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-tls\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:47.805652 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:47.805633 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/687952f9-195a-4c64-b544-9b4a268ffd03-node-exporter-tls\") pod \"node-exporter-zqvk9\" (UID: \"687952f9-195a-4c64-b544-9b4a268ffd03\") " pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:48.086009 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:48.085925 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqvk9" Aug 01 03:47:48.097676 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:47:48.097641 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687952f9_195a_4c64_b544_9b4a268ffd03.slice/crio-82be7097b5b130b005684c03904d8eb841315fdb4b86693b5a4afafc242a8961 WatchSource:0}: Error finding container 82be7097b5b130b005684c03904d8eb841315fdb4b86693b5a4afafc242a8961: Status 404 returned error can't find the container with id 82be7097b5b130b005684c03904d8eb841315fdb4b86693b5a4afafc242a8961 Aug 01 03:47:48.880456 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:48.880409 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqvk9" event={"ID":"687952f9-195a-4c64-b544-9b4a268ffd03","Type":"ContainerStarted","Data":"82be7097b5b130b005684c03904d8eb841315fdb4b86693b5a4afafc242a8961"} Aug 01 03:47:49.885343 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:49.885312 2551 generic.go:356] "Generic (PLEG): container finished" podID="687952f9-195a-4c64-b544-9b4a268ffd03" containerID="836ac08a2e88f6bfd7905f90fc7c6240c162d62902e302e19ed76ffdf0a81402" exitCode=0 Aug 01 03:47:49.885717 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:49.885378 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqvk9" event={"ID":"687952f9-195a-4c64-b544-9b4a268ffd03","Type":"ContainerDied","Data":"836ac08a2e88f6bfd7905f90fc7c6240c162d62902e302e19ed76ffdf0a81402"} Aug 01 03:47:50.811636 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:50.811609 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:50.891664 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:50.891636 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqvk9" event={"ID":"687952f9-195a-4c64-b544-9b4a268ffd03","Type":"ContainerStarted","Data":"a91c4f1732a352fa3180d671cf73d44f60ffb6c65ea9d47a92e92ca744555ed9"} Aug 01 03:47:50.892017 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:50.891681 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqvk9" event={"ID":"687952f9-195a-4c64-b544-9b4a268ffd03","Type":"ContainerStarted","Data":"09f212be6d4db36183b99a50370a2d45d86d16125ee371a6f54fd57ece125b8b"} Aug 01 03:47:50.910057 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:50.910011 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zqvk9" podStartSLOduration=2.944423239 podStartE2EDuration="3.909996776s" totalImagesPullingTime="899.871844ms" totalInitContainerRuntime="65.701693ms" isStatefulPod=true podCreationTimestamp="2026-08-01 03:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:47:50.908745031 +0000 UTC m=+89.045439943" watchObservedRunningTime="2026-08-01 03:47:50.909996776 +0000 UTC m=+89.046691710" Aug 01 03:47:52.818553 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:52.818524 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5697cd44b7-pdgb4" Aug 01 03:47:55.834770 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:55.834722 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" podUID="0df5cb39-debb-4d1b-842f-622c5a03f694" containerName="registry" containerID="cri-o://3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9" gracePeriod=30 Aug 01 03:47:56.076117 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.076091 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:56.172356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172278 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ch57\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-kube-api-access-4ch57\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172347 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-trusted-ca\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172377 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0df5cb39-debb-4d1b-842f-622c5a03f694-ca-trust-extracted\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172399 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-image-registry-private-configuration\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172416 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-certificates\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172435 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172460 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-installation-pull-secrets\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172487 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-bound-sa-token\") pod \"0df5cb39-debb-4d1b-842f-622c5a03f694\" (UID: \"0df5cb39-debb-4d1b-842f-622c5a03f694\") " Aug 01 03:47:56.172913 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172859 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 03:47:56.173003 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.172973 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 03:47:56.175047 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.175003 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:47:56.175162 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.175046 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 03:47:56.175162 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.175097 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-kube-api-access-4ch57" (OuterVolumeSpecName: "kube-api-access-4ch57") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "kube-api-access-4ch57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:47:56.175284 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.175224 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:47:56.175320 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.175272 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 03:47:56.181268 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.181246 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df5cb39-debb-4d1b-842f-622c5a03f694-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0df5cb39-debb-4d1b-842f-622c5a03f694" (UID: "0df5cb39-debb-4d1b-842f-622c5a03f694"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:47:56.273325 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273296 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-trusted-ca\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273325 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273320 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0df5cb39-debb-4d1b-842f-622c5a03f694-ca-trust-extracted\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273332 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-image-registry-private-configuration\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273341 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-certificates\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273352 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-registry-tls\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273369 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0df5cb39-debb-4d1b-842f-622c5a03f694-installation-pull-secrets\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273377 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-bound-sa-token\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.273476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.273385 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ch57\" (UniqueName: \"kubernetes.io/projected/0df5cb39-debb-4d1b-842f-622c5a03f694-kube-api-access-4ch57\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:47:56.917062 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.917028 2551 generic.go:356] "Generic (PLEG): container finished" podID="0df5cb39-debb-4d1b-842f-622c5a03f694" containerID="3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9" exitCode=0 Aug 01 03:47:56.917505 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.917073 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" Aug 01 03:47:56.917505 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.917121 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" event={"ID":"0df5cb39-debb-4d1b-842f-622c5a03f694","Type":"ContainerDied","Data":"3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9"} Aug 01 03:47:56.917505 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.917182 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cc45b48f7-kvhsq" event={"ID":"0df5cb39-debb-4d1b-842f-622c5a03f694","Type":"ContainerDied","Data":"ba967401b85cf2010fd13c5e0bc469fc13b6ae4954b50f06cdd52a1558823ca9"} Aug 01 03:47:56.917505 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.917216 2551 scope.go:117] "RemoveContainer" containerID="3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9" Aug 01 03:47:56.927238 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.927222 2551 scope.go:117] "RemoveContainer" containerID="3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9" Aug 01 03:47:56.927495 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:47:56.927477 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9\": container with ID starting with 3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9 not found: ID does not exist" containerID="3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9" Aug 01 03:47:56.927563 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.927501 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9"} err="failed to get container status \"3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9\": rpc error: code = NotFound desc = could not find container \"3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9\": container with ID starting with 3f0e2383a86f2795873aca2848f404aa2036e14003ea41b2058fa31836a3ddc9 not found: ID does not exist" Aug 01 03:47:56.935477 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.935451 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cc45b48f7-kvhsq"] Aug 01 03:47:56.942976 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:56.942952 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cc45b48f7-kvhsq"] Aug 01 03:47:58.413388 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:58.413349 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df5cb39-debb-4d1b-842f-622c5a03f694" path="/var/lib/kubelet/pods/0df5cb39-debb-4d1b-842f-622c5a03f694/volumes" Aug 01 03:47:59.797001 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:47:59.796973 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qgv49" Aug 01 03:48:27.028506 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:27.028472 2551 generic.go:356] "Generic (PLEG): container finished" podID="fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68" containerID="cca4cd8020768afc4799ace02ee30a2529555d69e31b9ef255f6e269787ec6d1" exitCode=0 Aug 01 03:48:27.028975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:27.028543 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-42n7j" event={"ID":"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68","Type":"ContainerDied","Data":"cca4cd8020768afc4799ace02ee30a2529555d69e31b9ef255f6e269787ec6d1"} Aug 01 03:48:27.028975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:27.028858 2551 scope.go:117] "RemoveContainer" containerID="cca4cd8020768afc4799ace02ee30a2529555d69e31b9ef255f6e269787ec6d1" Aug 01 03:48:28.033885 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:28.033830 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-42n7j" event={"ID":"fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68","Type":"ContainerStarted","Data":"a09705e4cf11d55b26d396acf1b86c694ee519c667a8ab6df95427bf01e70f8a"} Aug 01 03:48:32.049184 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:32.049155 2551 generic.go:356] "Generic (PLEG): container finished" podID="7ad4ff14-ea4e-4145-b166-5e806cd41fb6" containerID="b3c664e9cc5697e0c0c89aa94400f7df3becd6b07093a0e70267d6889332beab" exitCode=0 Aug 01 03:48:32.049551 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:32.049234 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" event={"ID":"7ad4ff14-ea4e-4145-b166-5e806cd41fb6","Type":"ContainerDied","Data":"b3c664e9cc5697e0c0c89aa94400f7df3becd6b07093a0e70267d6889332beab"} Aug 01 03:48:32.049551 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:32.049546 2551 scope.go:117] "RemoveContainer" containerID="b3c664e9cc5697e0c0c89aa94400f7df3becd6b07093a0e70267d6889332beab" Aug 01 03:48:33.054346 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:33.054309 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-9mm6d" event={"ID":"7ad4ff14-ea4e-4145-b166-5e806cd41fb6","Type":"ContainerStarted","Data":"d9360687819c137a43ea73eae3472df1fe9af741b294db9646f4176923f21d3b"} Aug 01 03:48:37.070442 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:37.070417 2551 generic.go:356] "Generic (PLEG): container finished" podID="76502bb9-609e-4bd2-9be9-16c4d04b7c35" containerID="ead1a80a5b1e0bced19a402cc6f1f6796f6a9c552488dfc56a7f75682aeaf27d" exitCode=0 Aug 01 03:48:37.070732 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:37.070484 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" event={"ID":"76502bb9-609e-4bd2-9be9-16c4d04b7c35","Type":"ContainerDied","Data":"ead1a80a5b1e0bced19a402cc6f1f6796f6a9c552488dfc56a7f75682aeaf27d"} Aug 01 03:48:37.070840 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:37.070824 2551 scope.go:117] "RemoveContainer" containerID="ead1a80a5b1e0bced19a402cc6f1f6796f6a9c552488dfc56a7f75682aeaf27d" Aug 01 03:48:38.077478 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:48:38.077426 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gc5wz" event={"ID":"76502bb9-609e-4bd2-9be9-16c4d04b7c35","Type":"ContainerStarted","Data":"4d1055b58f16a5e28aec711e32f1da8f46360d1f4384f08079acbf25376d1f39"} Aug 01 03:49:38.187548 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.187510 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r"] Aug 01 03:49:38.188031 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.187930 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df5cb39-debb-4d1b-842f-622c5a03f694" containerName="registry" Aug 01 03:49:38.188031 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.187944 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df5cb39-debb-4d1b-842f-622c5a03f694" containerName="registry" Aug 01 03:49:38.188031 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.188000 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df5cb39-debb-4d1b-842f-622c5a03f694" containerName="registry" Aug 01 03:49:38.189953 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.189935 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.192400 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.192375 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Aug 01 03:49:38.192517 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.192377 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Aug 01 03:49:38.193459 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.193443 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Aug 01 03:49:38.193522 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.193467 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Aug 01 03:49:38.198852 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.198831 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r"] Aug 01 03:49:38.242760 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.242729 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e00ebee7-104f-459e-ad60-9ead2f38b91e-tmp\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.242947 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.242769 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e00ebee7-104f-459e-ad60-9ead2f38b91e-klusterlet-config\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.242947 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.242792 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnrfg\" (UniqueName: \"kubernetes.io/projected/e00ebee7-104f-459e-ad60-9ead2f38b91e-kube-api-access-gnrfg\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.344211 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.344180 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e00ebee7-104f-459e-ad60-9ead2f38b91e-tmp\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.344391 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.344221 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e00ebee7-104f-459e-ad60-9ead2f38b91e-klusterlet-config\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.344391 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.344243 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnrfg\" (UniqueName: \"kubernetes.io/projected/e00ebee7-104f-459e-ad60-9ead2f38b91e-kube-api-access-gnrfg\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.344608 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.344586 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e00ebee7-104f-459e-ad60-9ead2f38b91e-tmp\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.346782 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.346758 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e00ebee7-104f-459e-ad60-9ead2f38b91e-klusterlet-config\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.352356 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.352332 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnrfg\" (UniqueName: \"kubernetes.io/projected/e00ebee7-104f-459e-ad60-9ead2f38b91e-kube-api-access-gnrfg\") pod \"klusterlet-addon-workmgr-77d97f6b66-2ls2r\" (UID: \"e00ebee7-104f-459e-ad60-9ead2f38b91e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.499638 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.499602 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:38.623314 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:38.623285 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r"] Aug 01 03:49:38.625993 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:49:38.625967 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00ebee7_104f_459e_ad60_9ead2f38b91e.slice/crio-a7a514baf4ba7b7f94784504520c22ded74994875c18564cfcef132adaf23022 WatchSource:0}: Error finding container a7a514baf4ba7b7f94784504520c22ded74994875c18564cfcef132adaf23022: Status 404 returned error can't find the container with id a7a514baf4ba7b7f94784504520c22ded74994875c18564cfcef132adaf23022 Aug 01 03:49:39.298438 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:39.298399 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" event={"ID":"e00ebee7-104f-459e-ad60-9ead2f38b91e","Type":"ContainerStarted","Data":"a7a514baf4ba7b7f94784504520c22ded74994875c18564cfcef132adaf23022"} Aug 01 03:49:43.315947 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:43.315912 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" event={"ID":"e00ebee7-104f-459e-ad60-9ead2f38b91e","Type":"ContainerStarted","Data":"3724f35ada536a642e3dc6339687325fffca7da9d3bf2dd41b0df46be9825e49"} Aug 01 03:49:43.316321 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:43.316127 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:43.317973 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:43.317952 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" Aug 01 03:49:43.332958 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:43.332919 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77d97f6b66-2ls2r" podStartSLOduration=1.581277111 podStartE2EDuration="5.332908028s" totalImagesPullingTime="3.751630917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:49:43.331277797 +0000 UTC m=+201.467972689" watchObservedRunningTime="2026-08-01 03:49:43.332908028 +0000 UTC m=+201.469602919" Aug 01 03:49:56.601827 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.601791 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz"] Aug 01 03:49:56.604266 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.604245 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.606741 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.606721 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 01 03:49:56.606860 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.606844 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88gvk\"" Aug 01 03:49:56.607561 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.607548 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 01 03:49:56.613601 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.613575 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz"] Aug 01 03:49:56.700832 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.700805 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.701007 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.700856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.701007 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.700901 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk6gr\" (UniqueName: \"kubernetes.io/projected/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-kube-api-access-mk6gr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.801756 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.801717 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.801756 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.801757 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk6gr\" (UniqueName: \"kubernetes.io/projected/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-kube-api-access-mk6gr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.802028 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.801803 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.802189 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.802170 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.802250 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.802215 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.810435 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.810412 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk6gr\" (UniqueName: \"kubernetes.io/projected/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-kube-api-access-mk6gr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:56.913091 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:56.913014 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:49:57.034964 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:57.034938 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz"] Aug 01 03:49:57.037504 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:49:57.037474 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2901c3_6e8e_4c86_9a5e_a8280d19d671.slice/crio-ae49b4fe0324f1d7d94f647ae1ade77d4b9efe1def624fd1e7350364a34f9c83 WatchSource:0}: Error finding container ae49b4fe0324f1d7d94f647ae1ade77d4b9efe1def624fd1e7350364a34f9c83: Status 404 returned error can't find the container with id ae49b4fe0324f1d7d94f647ae1ade77d4b9efe1def624fd1e7350364a34f9c83 Aug 01 03:49:57.367321 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:49:57.367286 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" event={"ID":"2c2901c3-6e8e-4c86-9a5e-a8280d19d671","Type":"ContainerStarted","Data":"ae49b4fe0324f1d7d94f647ae1ade77d4b9efe1def624fd1e7350364a34f9c83"} Aug 01 03:50:03.392635 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:03.392595 2551 generic.go:356] "Generic (PLEG): container finished" podID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerID="9735071637d6fabaf7c90b55a419f86753f0b9547cb14245724444ac453ebed8" exitCode=0 Aug 01 03:50:03.393046 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:03.392658 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" event={"ID":"2c2901c3-6e8e-4c86-9a5e-a8280d19d671","Type":"ContainerDied","Data":"9735071637d6fabaf7c90b55a419f86753f0b9547cb14245724444ac453ebed8"} Aug 01 03:50:06.405320 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:06.405281 2551 generic.go:356] "Generic (PLEG): container finished" podID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerID="bdc5bfb4f6ec1ad5275eedde0fe3b487effa773fb06dcf548cc4bebe9ec36864" exitCode=0 Aug 01 03:50:06.405759 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:06.405325 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" event={"ID":"2c2901c3-6e8e-4c86-9a5e-a8280d19d671","Type":"ContainerDied","Data":"bdc5bfb4f6ec1ad5275eedde0fe3b487effa773fb06dcf548cc4bebe9ec36864"} Aug 01 03:50:14.439694 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:14.439657 2551 generic.go:356] "Generic (PLEG): container finished" podID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerID="e5bb97b62d6916a9fef0b0de20c58db89e35a5b2d70babc5847c4ff05eb31a8a" exitCode=0 Aug 01 03:50:14.440172 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:14.439706 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" event={"ID":"2c2901c3-6e8e-4c86-9a5e-a8280d19d671","Type":"ContainerDied","Data":"e5bb97b62d6916a9fef0b0de20c58db89e35a5b2d70babc5847c4ff05eb31a8a"} Aug 01 03:50:15.603499 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.603471 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:50:15.648474 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.648447 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-util\") pod \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " Aug 01 03:50:15.648648 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.648498 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-bundle\") pod \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " Aug 01 03:50:15.648648 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.648529 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk6gr\" (UniqueName: \"kubernetes.io/projected/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-kube-api-access-mk6gr\") pod \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\" (UID: \"2c2901c3-6e8e-4c86-9a5e-a8280d19d671\") " Aug 01 03:50:15.649088 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.649063 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-bundle" (OuterVolumeSpecName: "bundle") pod "2c2901c3-6e8e-4c86-9a5e-a8280d19d671" (UID: "2c2901c3-6e8e-4c86-9a5e-a8280d19d671"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:50:15.650755 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.650731 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-kube-api-access-mk6gr" (OuterVolumeSpecName: "kube-api-access-mk6gr") pod "2c2901c3-6e8e-4c86-9a5e-a8280d19d671" (UID: "2c2901c3-6e8e-4c86-9a5e-a8280d19d671"). InnerVolumeSpecName "kube-api-access-mk6gr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:50:15.652621 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.652603 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-util" (OuterVolumeSpecName: "util") pod "2c2901c3-6e8e-4c86-9a5e-a8280d19d671" (UID: "2c2901c3-6e8e-4c86-9a5e-a8280d19d671"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:50:15.749143 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.749115 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-util\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:50:15.749143 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.749138 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-bundle\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:50:15.749143 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:15.749148 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk6gr\" (UniqueName: \"kubernetes.io/projected/2c2901c3-6e8e-4c86-9a5e-a8280d19d671-kube-api-access-mk6gr\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:50:16.449132 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:16.449107 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" Aug 01 03:50:16.449331 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:16.449107 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qgrxz" event={"ID":"2c2901c3-6e8e-4c86-9a5e-a8280d19d671","Type":"ContainerDied","Data":"ae49b4fe0324f1d7d94f647ae1ade77d4b9efe1def624fd1e7350364a34f9c83"} Aug 01 03:50:16.449331 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:16.449231 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae49b4fe0324f1d7d94f647ae1ade77d4b9efe1def624fd1e7350364a34f9c83" Aug 01 03:50:19.382398 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382361 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj"] Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382643 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="util" Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382654 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="util" Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382666 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="pull" Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382672 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="pull" Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382678 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="extract" Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382683 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="extract" Aug 01 03:50:19.382767 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.382742 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c2901c3-6e8e-4c86-9a5e-a8280d19d671" containerName="extract" Aug 01 03:50:19.431367 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.431328 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj"] Aug 01 03:50:19.431527 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.431434 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.434251 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.434229 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Aug 01 03:50:19.434251 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.434239 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-627r5\"" Aug 01 03:50:19.434518 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.434244 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Aug 01 03:50:19.479154 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.479127 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlzpj\" (UniqueName: \"kubernetes.io/projected/e2da9542-42e1-4dbb-ae15-91189f7bb80a-kube-api-access-jlzpj\") pod \"cert-manager-operator-controller-manager-56b4598547-k99fj\" (UID: \"e2da9542-42e1-4dbb-ae15-91189f7bb80a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.479288 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.479180 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2da9542-42e1-4dbb-ae15-91189f7bb80a-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-k99fj\" (UID: \"e2da9542-42e1-4dbb-ae15-91189f7bb80a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.580546 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.580513 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2da9542-42e1-4dbb-ae15-91189f7bb80a-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-k99fj\" (UID: \"e2da9542-42e1-4dbb-ae15-91189f7bb80a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.580726 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.580569 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlzpj\" (UniqueName: \"kubernetes.io/projected/e2da9542-42e1-4dbb-ae15-91189f7bb80a-kube-api-access-jlzpj\") pod \"cert-manager-operator-controller-manager-56b4598547-k99fj\" (UID: \"e2da9542-42e1-4dbb-ae15-91189f7bb80a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.580947 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.580924 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2da9542-42e1-4dbb-ae15-91189f7bb80a-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-k99fj\" (UID: \"e2da9542-42e1-4dbb-ae15-91189f7bb80a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.594186 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.594162 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlzpj\" (UniqueName: \"kubernetes.io/projected/e2da9542-42e1-4dbb-ae15-91189f7bb80a-kube-api-access-jlzpj\") pod \"cert-manager-operator-controller-manager-56b4598547-k99fj\" (UID: \"e2da9542-42e1-4dbb-ae15-91189f7bb80a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.740052 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.740017 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" Aug 01 03:50:19.885699 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:19.885674 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj"] Aug 01 03:50:19.888436 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:50:19.888409 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2da9542_42e1_4dbb_ae15_91189f7bb80a.slice/crio-69d348a8ef399a7ed063238ef0bf68c80db5528046a8ec47a52a432f65d75df0 WatchSource:0}: Error finding container 69d348a8ef399a7ed063238ef0bf68c80db5528046a8ec47a52a432f65d75df0: Status 404 returned error can't find the container with id 69d348a8ef399a7ed063238ef0bf68c80db5528046a8ec47a52a432f65d75df0 Aug 01 03:50:20.464365 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:20.464329 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" event={"ID":"e2da9542-42e1-4dbb-ae15-91189f7bb80a","Type":"ContainerStarted","Data":"69d348a8ef399a7ed063238ef0bf68c80db5528046a8ec47a52a432f65d75df0"} Aug 01 03:50:22.474334 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:22.474302 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" event={"ID":"e2da9542-42e1-4dbb-ae15-91189f7bb80a","Type":"ContainerStarted","Data":"5d06630db204edb8e67743a0e09d6d89665dc62a18009e14c360c6dd7ddb5078"} Aug 01 03:50:22.510423 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:22.510374 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-k99fj" podStartSLOduration=1.819417231 podStartE2EDuration="3.510359708s" totalImagesPullingTime="1.690942477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:50:22.508514686 +0000 UTC m=+240.645209587" watchObservedRunningTime="2026-08-01 03:50:22.510359708 +0000 UTC m=+240.647054600" Aug 01 03:50:44.011417 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.011388 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4r4n2"] Aug 01 03:50:44.028574 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.028549 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4r4n2"] Aug 01 03:50:44.028705 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.028631 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.031074 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.031050 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xl6zh\"" Aug 01 03:50:44.031191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.031070 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 01 03:50:44.031938 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.031923 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 01 03:50:44.169027 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.168999 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4gsc\" (UniqueName: \"kubernetes.io/projected/f606dbd3-9465-4eda-ab57-b56dfb18cb91-kube-api-access-s4gsc\") pod \"cert-manager-55b4d954d5-4r4n2\" (UID: \"f606dbd3-9465-4eda-ab57-b56dfb18cb91\") " pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.169156 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.169040 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f606dbd3-9465-4eda-ab57-b56dfb18cb91-bound-sa-token\") pod \"cert-manager-55b4d954d5-4r4n2\" (UID: \"f606dbd3-9465-4eda-ab57-b56dfb18cb91\") " pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.269894 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.269804 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4gsc\" (UniqueName: \"kubernetes.io/projected/f606dbd3-9465-4eda-ab57-b56dfb18cb91-kube-api-access-s4gsc\") pod \"cert-manager-55b4d954d5-4r4n2\" (UID: \"f606dbd3-9465-4eda-ab57-b56dfb18cb91\") " pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.269894 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.269844 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f606dbd3-9465-4eda-ab57-b56dfb18cb91-bound-sa-token\") pod \"cert-manager-55b4d954d5-4r4n2\" (UID: \"f606dbd3-9465-4eda-ab57-b56dfb18cb91\") " pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.277966 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.277937 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f606dbd3-9465-4eda-ab57-b56dfb18cb91-bound-sa-token\") pod \"cert-manager-55b4d954d5-4r4n2\" (UID: \"f606dbd3-9465-4eda-ab57-b56dfb18cb91\") " pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.278146 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.278123 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4gsc\" (UniqueName: \"kubernetes.io/projected/f606dbd3-9465-4eda-ab57-b56dfb18cb91-kube-api-access-s4gsc\") pod \"cert-manager-55b4d954d5-4r4n2\" (UID: \"f606dbd3-9465-4eda-ab57-b56dfb18cb91\") " pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.350956 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.350930 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4r4n2" Aug 01 03:50:44.491106 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.491082 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4r4n2"] Aug 01 03:50:44.493678 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:50:44.493653 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf606dbd3_9465_4eda_ab57_b56dfb18cb91.slice/crio-4b33c4d868ddff6dfa1a2596f75ea149fd6fbd67f058b86f0c5482f7c8d74740 WatchSource:0}: Error finding container 4b33c4d868ddff6dfa1a2596f75ea149fd6fbd67f058b86f0c5482f7c8d74740: Status 404 returned error can't find the container with id 4b33c4d868ddff6dfa1a2596f75ea149fd6fbd67f058b86f0c5482f7c8d74740 Aug 01 03:50:44.562384 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:44.562324 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4r4n2" event={"ID":"f606dbd3-9465-4eda-ab57-b56dfb18cb91","Type":"ContainerStarted","Data":"4b33c4d868ddff6dfa1a2596f75ea149fd6fbd67f058b86f0c5482f7c8d74740"} Aug 01 03:50:47.577823 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:47.577783 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4r4n2" event={"ID":"f606dbd3-9465-4eda-ab57-b56dfb18cb91","Type":"ContainerStarted","Data":"5b0e971d3a5ea43a0d8b28e6193b05c7d34425b7d0dbb98ab971413215779724"} Aug 01 03:50:47.593388 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:47.593341 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4r4n2" podStartSLOduration=2.092581437 podStartE2EDuration="4.593324874s" totalImagesPullingTime="2.500743437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:50:47.592647421 +0000 UTC m=+265.729342313" watchObservedRunningTime="2026-08-01 03:50:47.593324874 +0000 UTC m=+265.730019766" Aug 01 03:50:48.598679 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.598636 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p"] Aug 01 03:50:48.601255 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.601238 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.603490 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.603472 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 01 03:50:48.603599 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.603577 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 01 03:50:48.603644 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.603620 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88gvk\"" Aug 01 03:50:48.609291 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.609251 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p"] Aug 01 03:50:48.706059 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.706023 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.706059 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.706060 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2zv\" (UniqueName: \"kubernetes.io/projected/4856b21c-3911-4c15-97bf-adb0b51084a2-kube-api-access-hx2zv\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.706301 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.706081 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.806856 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.806824 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.806985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.806861 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2zv\" (UniqueName: \"kubernetes.io/projected/4856b21c-3911-4c15-97bf-adb0b51084a2-kube-api-access-hx2zv\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.806985 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.806909 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.807242 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.807226 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.807279 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.807224 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.814593 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.814561 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2zv\" (UniqueName: \"kubernetes.io/projected/4856b21c-3911-4c15-97bf-adb0b51084a2-kube-api-access-hx2zv\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:48.910778 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:48.910698 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:49.034939 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:49.034915 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p"] Aug 01 03:50:49.037300 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:50:49.037256 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4856b21c_3911_4c15_97bf_adb0b51084a2.slice/crio-d9a66ea65259364625949f95ff5a09c646b03967cd69e70e083d827f5f2a848f WatchSource:0}: Error finding container d9a66ea65259364625949f95ff5a09c646b03967cd69e70e083d827f5f2a848f: Status 404 returned error can't find the container with id d9a66ea65259364625949f95ff5a09c646b03967cd69e70e083d827f5f2a848f Aug 01 03:50:49.587964 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:49.587923 2551 generic.go:356] "Generic (PLEG): container finished" podID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerID="5c83ef1e1c0ccfaf015b0908895d7d5eb36f0b0dce4047e4ed7b33cddbefa63c" exitCode=0 Aug 01 03:50:49.588121 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:49.588011 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" event={"ID":"4856b21c-3911-4c15-97bf-adb0b51084a2","Type":"ContainerDied","Data":"5c83ef1e1c0ccfaf015b0908895d7d5eb36f0b0dce4047e4ed7b33cddbefa63c"} Aug 01 03:50:49.588121 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:49.588064 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" event={"ID":"4856b21c-3911-4c15-97bf-adb0b51084a2","Type":"ContainerStarted","Data":"d9a66ea65259364625949f95ff5a09c646b03967cd69e70e083d827f5f2a848f"} Aug 01 03:50:51.604776 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:51.604746 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" event={"ID":"4856b21c-3911-4c15-97bf-adb0b51084a2","Type":"ContainerStarted","Data":"f39532d1cf57e6e7e71c9cae1f4d2fae715c75a8cae4d9c5c96f219f330dcc02"} Aug 01 03:50:52.610943 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:52.610911 2551 generic.go:356] "Generic (PLEG): container finished" podID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerID="f39532d1cf57e6e7e71c9cae1f4d2fae715c75a8cae4d9c5c96f219f330dcc02" exitCode=0 Aug 01 03:50:52.610943 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:52.610935 2551 generic.go:356] "Generic (PLEG): container finished" podID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerID="866ea0dd371362788adf95e555d39b7a421d5a4d2cbd80b8f4dc58294730102e" exitCode=0 Aug 01 03:50:52.611364 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:52.610994 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" event={"ID":"4856b21c-3911-4c15-97bf-adb0b51084a2","Type":"ContainerDied","Data":"f39532d1cf57e6e7e71c9cae1f4d2fae715c75a8cae4d9c5c96f219f330dcc02"} Aug 01 03:50:52.611364 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:52.611054 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" event={"ID":"4856b21c-3911-4c15-97bf-adb0b51084a2","Type":"ContainerDied","Data":"866ea0dd371362788adf95e555d39b7a421d5a4d2cbd80b8f4dc58294730102e"} Aug 01 03:50:53.735720 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.735696 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:53.850090 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.850063 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-util\") pod \"4856b21c-3911-4c15-97bf-adb0b51084a2\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " Aug 01 03:50:53.850261 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.850097 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-bundle\") pod \"4856b21c-3911-4c15-97bf-adb0b51084a2\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " Aug 01 03:50:53.850261 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.850125 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx2zv\" (UniqueName: \"kubernetes.io/projected/4856b21c-3911-4c15-97bf-adb0b51084a2-kube-api-access-hx2zv\") pod \"4856b21c-3911-4c15-97bf-adb0b51084a2\" (UID: \"4856b21c-3911-4c15-97bf-adb0b51084a2\") " Aug 01 03:50:53.850520 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.850484 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-bundle" (OuterVolumeSpecName: "bundle") pod "4856b21c-3911-4c15-97bf-adb0b51084a2" (UID: "4856b21c-3911-4c15-97bf-adb0b51084a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:50:53.852102 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.852076 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4856b21c-3911-4c15-97bf-adb0b51084a2-kube-api-access-hx2zv" (OuterVolumeSpecName: "kube-api-access-hx2zv") pod "4856b21c-3911-4c15-97bf-adb0b51084a2" (UID: "4856b21c-3911-4c15-97bf-adb0b51084a2"). InnerVolumeSpecName "kube-api-access-hx2zv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:50:53.855354 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.855315 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-util" (OuterVolumeSpecName: "util") pod "4856b21c-3911-4c15-97bf-adb0b51084a2" (UID: "4856b21c-3911-4c15-97bf-adb0b51084a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:50:53.951214 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.951145 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-util\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:50:53.951214 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.951172 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4856b21c-3911-4c15-97bf-adb0b51084a2-bundle\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:50:53.951214 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:53.951181 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx2zv\" (UniqueName: \"kubernetes.io/projected/4856b21c-3911-4c15-97bf-adb0b51084a2-kube-api-access-hx2zv\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:50:54.620336 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:54.620301 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" event={"ID":"4856b21c-3911-4c15-97bf-adb0b51084a2","Type":"ContainerDied","Data":"d9a66ea65259364625949f95ff5a09c646b03967cd69e70e083d827f5f2a848f"} Aug 01 03:50:54.620486 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:54.620343 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e64v7p" Aug 01 03:50:54.620486 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:50:54.620350 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9a66ea65259364625949f95ff5a09c646b03967cd69e70e083d827f5f2a848f" Aug 01 03:51:22.276824 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:51:22.276792 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:51:22.280270 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:51:22.280234 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:51:22.286511 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:51:22.286492 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:51:22.289319 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:51:22.289299 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:51:22.292102 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:51:22.292081 2551 kubelet.go:1648] "Image garbage collection succeeded" Aug 01 03:52:02.047675 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.047635 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw"] Aug 01 03:52:02.048191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048055 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="pull" Aug 01 03:52:02.048191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048073 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="pull" Aug 01 03:52:02.048191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048086 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="extract" Aug 01 03:52:02.048191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048095 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="extract" Aug 01 03:52:02.048191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048108 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="util" Aug 01 03:52:02.048191 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048116 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="util" Aug 01 03:52:02.048464 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.048201 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="4856b21c-3911-4c15-97bf-adb0b51084a2" containerName="extract" Aug 01 03:52:02.050674 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.050651 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.053086 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.053063 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Aug 01 03:52:02.053916 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.053895 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Aug 01 03:52:02.053996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.053921 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-lzpx5\"" Aug 01 03:52:02.059002 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.058985 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw"] Aug 01 03:52:02.160575 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.160547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.160731 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.160582 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dds7\" (UniqueName: \"kubernetes.io/projected/abbd8fca-76a7-4e25-bc54-11ece100c472-kube-api-access-6dds7\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.160731 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.160612 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.261489 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.261456 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.261654 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.261497 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dds7\" (UniqueName: \"kubernetes.io/projected/abbd8fca-76a7-4e25-bc54-11ece100c472-kube-api-access-6dds7\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.261654 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.261542 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.261847 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.261824 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.261847 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.261857 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.270884 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.270840 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dds7\" (UniqueName: \"kubernetes.io/projected/abbd8fca-76a7-4e25-bc54-11ece100c472-kube-api-access-6dds7\") pod \"trainer-operator-controller-manager-56f5b7fd56-8vzxw\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.361452 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.361386 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:02.490623 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.490592 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw"] Aug 01 03:52:02.493765 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:52:02.493730 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbd8fca_76a7_4e25_bc54_11ece100c472.slice/crio-7d65008ef1f3026ce5277db83cec6b1116c9d0a7df48f96c28c5e741061a016d WatchSource:0}: Error finding container 7d65008ef1f3026ce5277db83cec6b1116c9d0a7df48f96c28c5e741061a016d: Status 404 returned error can't find the container with id 7d65008ef1f3026ce5277db83cec6b1116c9d0a7df48f96c28c5e741061a016d Aug 01 03:52:02.495714 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.495699 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 03:52:02.901979 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:02.901947 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" event={"ID":"abbd8fca-76a7-4e25-bc54-11ece100c472","Type":"ContainerStarted","Data":"7d65008ef1f3026ce5277db83cec6b1116c9d0a7df48f96c28c5e741061a016d"} Aug 01 03:52:05.918371 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:05.918335 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" event={"ID":"abbd8fca-76a7-4e25-bc54-11ece100c472","Type":"ContainerStarted","Data":"efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187"} Aug 01 03:52:05.918753 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:05.918407 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:52:05.934321 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:05.934268 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" podStartSLOduration=1.518145477 podStartE2EDuration="3.934255195s" totalImagesPullingTime="2.416109718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:52:05.932914714 +0000 UTC m=+344.069609604" watchObservedRunningTime="2026-08-01 03:52:05.934255195 +0000 UTC m=+344.070950087" Aug 01 03:52:16.925491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:52:16.925420 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:53:14.311300 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.311264 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb"] Aug 01 03:53:14.316027 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.316011 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.324048 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.324025 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb"] Aug 01 03:53:14.439962 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.439928 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-manifests-work\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.440137 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.440005 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-tmp\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.440137 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.440061 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7472n\" (UniqueName: \"kubernetes.io/projected/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-kube-api-access-7472n\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.540947 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.540912 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-tmp\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.541116 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.540976 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7472n\" (UniqueName: \"kubernetes.io/projected/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-kube-api-access-7472n\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.541116 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.541007 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-manifests-work\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.541461 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.541432 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-manifests-work\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.541547 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.541437 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-tmp\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.548963 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.548935 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7472n\" (UniqueName: \"kubernetes.io/projected/ea9bae57-9c4b-4cc2-aeb2-901a334629d7-kube-api-access-7472n\") pod \"trainer-operator-controller-manager-69855b4775-5jbcb\" (UID: \"ea9bae57-9c4b-4cc2-aeb2-901a334629d7\") " pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.625678 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.625603 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:14.751772 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:14.751748 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb"] Aug 01 03:53:14.754062 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:53:14.754027 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9bae57_9c4b_4cc2_aeb2_901a334629d7.slice/crio-0429a71171a6c74e864eb0c70a676111676fb32b509458665e7d28504af7a663 WatchSource:0}: Error finding container 0429a71171a6c74e864eb0c70a676111676fb32b509458665e7d28504af7a663: Status 404 returned error can't find the container with id 0429a71171a6c74e864eb0c70a676111676fb32b509458665e7d28504af7a663 Aug 01 03:53:15.211806 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:15.211769 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" event={"ID":"ea9bae57-9c4b-4cc2-aeb2-901a334629d7","Type":"ContainerStarted","Data":"0429a71171a6c74e864eb0c70a676111676fb32b509458665e7d28504af7a663"} Aug 01 03:53:17.222764 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:17.222727 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" event={"ID":"ea9bae57-9c4b-4cc2-aeb2-901a334629d7","Type":"ContainerStarted","Data":"1534e884360c62b61f5e01a092d144b2d5c2b2d28c9d44287b708507d08e9000"} Aug 01 03:53:17.223169 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:17.222839 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:17.240205 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:17.240149 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" podStartSLOduration=1.657887237 podStartE2EDuration="3.240128902s" totalImagesPullingTime="1.582241665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:53:17.23758403 +0000 UTC m=+415.374278948" watchObservedRunningTime="2026-08-01 03:53:17.240128902 +0000 UTC m=+415.376823795" Aug 01 03:53:18.905517 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.905477 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4"] Aug 01 03:53:18.909994 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.909974 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:18.912384 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.912366 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Aug 01 03:53:18.913324 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.913303 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 01 03:53:18.913423 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.913346 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-gd5wp\"" Aug 01 03:53:18.913502 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.913417 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Aug 01 03:53:18.913502 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.913417 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 01 03:53:18.920086 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.920062 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4"] Aug 01 03:53:18.979280 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.979247 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:18.979280 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.979280 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:18.979467 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:18.979304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbszm\" (UniqueName: \"kubernetes.io/projected/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kube-api-access-wbszm\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.080631 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.080590 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.080631 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.080635 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.080823 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.080761 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbszm\" (UniqueName: \"kubernetes.io/projected/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kube-api-access-wbszm\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.081352 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.081328 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.083198 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.083175 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.088065 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.088042 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbszm\" (UniqueName: \"kubernetes.io/projected/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kube-api-access-wbszm\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-88kg4\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.219885 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.219833 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:19.350383 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:19.350362 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4"] Aug 01 03:53:19.353074 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:53:19.353048 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda68da52d_2fa4_4466_ba1c_5b87f00ef2cd.slice/crio-55c633aaa6f61a75467c01575a1fd2e17f50b23107e5b00d346fcfb86341a87b WatchSource:0}: Error finding container 55c633aaa6f61a75467c01575a1fd2e17f50b23107e5b00d346fcfb86341a87b: Status 404 returned error can't find the container with id 55c633aaa6f61a75467c01575a1fd2e17f50b23107e5b00d346fcfb86341a87b Aug 01 03:53:19.659367 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:19.659314 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:53:19.659565 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:19.659457 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-88kg4_opendatahub(a68da52d-2fa4-4466-ba1c-5b87f00ef2cd): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:53:19.659565 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:19.659499 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" podUID="a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" Aug 01 03:53:20.237389 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:20.237351 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" event={"ID":"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd","Type":"ContainerStarted","Data":"55c633aaa6f61a75467c01575a1fd2e17f50b23107e5b00d346fcfb86341a87b"} Aug 01 03:53:20.238594 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:20.238569 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" podUID="a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" Aug 01 03:53:20.376068 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:20.376034 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4"] Aug 01 03:53:21.244346 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:21.244236 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" podUID="a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" Aug 01 03:53:21.960478 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:21.960436 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6"] Aug 01 03:53:21.965443 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:21.965422 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:21.972813 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:21.972311 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6"] Aug 01 03:53:22.107414 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.107376 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69ff\" (UniqueName: \"kubernetes.io/projected/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kube-api-access-v69ff\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.107572 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.107427 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.107572 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.107514 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9862f5c8-0efa-484a-901c-ea1c9b3b0035-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.208845 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.208810 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.209031 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.208861 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9862f5c8-0efa-484a-901c-ea1c9b3b0035-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.209031 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.208935 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69ff\" (UniqueName: \"kubernetes.io/projected/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kube-api-access-v69ff\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.209490 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.209471 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.211406 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.211353 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9862f5c8-0efa-484a-901c-ea1c9b3b0035-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.216433 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.216413 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69ff\" (UniqueName: \"kubernetes.io/projected/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kube-api-access-v69ff\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-bcxj6\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.274766 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.274740 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:22.388122 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.388092 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:22.395562 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.395532 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6"] Aug 01 03:53:22.466828 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.466762 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6"] Aug 01 03:53:22.467001 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:53:22.466949 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9862f5c8_0efa_484a_901c_ea1c9b3b0035.slice/crio-ef35f0bd26bd0115c2f1b710bf659ba340ddddbecfc0e106b768605b25f96d68 WatchSource:0}: Error finding container ef35f0bd26bd0115c2f1b710bf659ba340ddddbecfc0e106b768605b25f96d68: Status 404 returned error can't find the container with id ef35f0bd26bd0115c2f1b710bf659ba340ddddbecfc0e106b768605b25f96d68 Aug 01 03:53:22.510859 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.510830 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-cert\") pod \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " Aug 01 03:53:22.510993 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.510893 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kubeflow-trainer-config\") pod \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " Aug 01 03:53:22.511107 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.511089 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbszm\" (UniqueName: \"kubernetes.io/projected/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kube-api-access-wbszm\") pod \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\" (UID: \"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd\") " Aug 01 03:53:22.511306 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.511284 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" (UID: "a68da52d-2fa4-4466-ba1c-5b87f00ef2cd"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 03:53:22.511396 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.511360 2551 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kubeflow-trainer-config\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:22.512907 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.512883 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-cert" (OuterVolumeSpecName: "cert") pod "a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" (UID: "a68da52d-2fa4-4466-ba1c-5b87f00ef2cd"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 03:53:22.512988 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.512945 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kube-api-access-wbszm" (OuterVolumeSpecName: "kube-api-access-wbszm") pod "a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" (UID: "a68da52d-2fa4-4466-ba1c-5b87f00ef2cd"). InnerVolumeSpecName "kube-api-access-wbszm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:53:22.612288 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.612260 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbszm\" (UniqueName: \"kubernetes.io/projected/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-kube-api-access-wbszm\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:22.612288 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:22.612286 2551 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd-cert\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:22.769286 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:22.769165 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:53:22.769429 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:22.769303 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-bcxj6_opendatahub(9862f5c8-0efa-484a-901c-ea1c9b3b0035): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:53:22.769429 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:22.769336 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" podUID="9862f5c8-0efa-484a-901c-ea1c9b3b0035" Aug 01 03:53:23.253940 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.253895 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" event={"ID":"9862f5c8-0efa-484a-901c-ea1c9b3b0035","Type":"ContainerStarted","Data":"ef35f0bd26bd0115c2f1b710bf659ba340ddddbecfc0e106b768605b25f96d68"} Aug 01 03:53:23.254972 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.254942 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" Aug 01 03:53:23.255086 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.254941 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4" event={"ID":"a68da52d-2fa4-4466-ba1c-5b87f00ef2cd","Type":"ContainerDied","Data":"55c633aaa6f61a75467c01575a1fd2e17f50b23107e5b00d346fcfb86341a87b"} Aug 01 03:53:23.292403 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.292369 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4"] Aug 01 03:53:23.297642 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.297619 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-88kg4"] Aug 01 03:53:23.391833 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.391805 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:23.520346 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.520265 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kubeflow-trainer-config\") pod \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " Aug 01 03:53:23.520346 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.520314 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9862f5c8-0efa-484a-901c-ea1c9b3b0035-cert\") pod \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " Aug 01 03:53:23.520525 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.520347 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v69ff\" (UniqueName: \"kubernetes.io/projected/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kube-api-access-v69ff\") pod \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\" (UID: \"9862f5c8-0efa-484a-901c-ea1c9b3b0035\") " Aug 01 03:53:23.520667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.520643 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "9862f5c8-0efa-484a-901c-ea1c9b3b0035" (UID: "9862f5c8-0efa-484a-901c-ea1c9b3b0035"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 03:53:23.522283 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.522248 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9862f5c8-0efa-484a-901c-ea1c9b3b0035-cert" (OuterVolumeSpecName: "cert") pod "9862f5c8-0efa-484a-901c-ea1c9b3b0035" (UID: "9862f5c8-0efa-484a-901c-ea1c9b3b0035"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 03:53:23.522384 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.522281 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kube-api-access-v69ff" (OuterVolumeSpecName: "kube-api-access-v69ff") pod "9862f5c8-0efa-484a-901c-ea1c9b3b0035" (UID: "9862f5c8-0efa-484a-901c-ea1c9b3b0035"). InnerVolumeSpecName "kube-api-access-v69ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:53:23.621374 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.621339 2551 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kubeflow-trainer-config\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:23.621374 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.621368 2551 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9862f5c8-0efa-484a-901c-ea1c9b3b0035-cert\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:23.621374 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:23.621378 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v69ff\" (UniqueName: \"kubernetes.io/projected/9862f5c8-0efa-484a-901c-ea1c9b3b0035-kube-api-access-v69ff\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:24.260030 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:24.260004 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" Aug 01 03:53:24.260030 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:24.260008 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6" event={"ID":"9862f5c8-0efa-484a-901c-ea1c9b3b0035","Type":"ContainerDied","Data":"ef35f0bd26bd0115c2f1b710bf659ba340ddddbecfc0e106b768605b25f96d68"} Aug 01 03:53:24.296147 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:24.296121 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6"] Aug 01 03:53:24.304476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:24.304447 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-bcxj6"] Aug 01 03:53:24.414252 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:24.414220 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9862f5c8-0efa-484a-901c-ea1c9b3b0035" path="/var/lib/kubelet/pods/9862f5c8-0efa-484a-901c-ea1c9b3b0035/volumes" Aug 01 03:53:24.414555 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:24.414541 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a68da52d-2fa4-4466-ba1c-5b87f00ef2cd" path="/var/lib/kubelet/pods/a68da52d-2fa4-4466-ba1c-5b87f00ef2cd/volumes" Aug 01 03:53:25.869227 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.869199 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs"] Aug 01 03:53:25.873758 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.873742 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:25.876242 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.876218 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 01 03:53:25.877321 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.877279 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Aug 01 03:53:25.877435 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.877318 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Aug 01 03:53:25.877435 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.877342 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-gd5wp\"" Aug 01 03:53:25.877435 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.877319 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 01 03:53:25.881151 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:25.881131 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs"] Aug 01 03:53:26.040133 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.040092 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhzm5\" (UniqueName: \"kubernetes.io/projected/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kube-api-access-jhzm5\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.040280 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.040171 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.040280 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.040240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.141524 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.141424 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhzm5\" (UniqueName: \"kubernetes.io/projected/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kube-api-access-jhzm5\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.141524 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.141500 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.141745 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.141567 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.142292 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.142270 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.143932 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.143912 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.153255 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.153227 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhzm5\" (UniqueName: \"kubernetes.io/projected/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kube-api-access-jhzm5\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-8tgvs\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.183222 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.183193 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:26.313422 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.313389 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs"] Aug 01 03:53:26.346821 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:26.346790 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs"] Aug 01 03:53:26.349061 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:53:26.349035 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode117ae0f_04d4_4c22_93ca_7a372bf29ee4.slice/crio-97463edbf28390aad9d082dd3a3f96732a8512ddf4a289fe1808f08f8be2679c WatchSource:0}: Error finding container 97463edbf28390aad9d082dd3a3f96732a8512ddf4a289fe1808f08f8be2679c: Status 404 returned error can't find the container with id 97463edbf28390aad9d082dd3a3f96732a8512ddf4a289fe1808f08f8be2679c Aug 01 03:53:26.640687 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:26.640638 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:53:26.640925 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:26.640755 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-8tgvs_opendatahub(e117ae0f-04d4-4c22-93ca-7a372bf29ee4): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:53:26.640925 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:26.640792 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" podUID="e117ae0f-04d4-4c22-93ca-7a372bf29ee4" Aug 01 03:53:27.274451 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.274407 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" event={"ID":"e117ae0f-04d4-4c22-93ca-7a372bf29ee4","Type":"ContainerStarted","Data":"97463edbf28390aad9d082dd3a3f96732a8512ddf4a289fe1808f08f8be2679c"} Aug 01 03:53:27.411227 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.411201 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:27.553183 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.553102 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-cert\") pod \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " Aug 01 03:53:27.553360 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.553214 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kubeflow-trainer-config\") pod \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " Aug 01 03:53:27.553360 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.553251 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhzm5\" (UniqueName: \"kubernetes.io/projected/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kube-api-access-jhzm5\") pod \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\" (UID: \"e117ae0f-04d4-4c22-93ca-7a372bf29ee4\") " Aug 01 03:53:27.553780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.553599 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "e117ae0f-04d4-4c22-93ca-7a372bf29ee4" (UID: "e117ae0f-04d4-4c22-93ca-7a372bf29ee4"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 03:53:27.555475 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.555437 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kube-api-access-jhzm5" (OuterVolumeSpecName: "kube-api-access-jhzm5") pod "e117ae0f-04d4-4c22-93ca-7a372bf29ee4" (UID: "e117ae0f-04d4-4c22-93ca-7a372bf29ee4"). InnerVolumeSpecName "kube-api-access-jhzm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:53:27.555602 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.555550 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-cert" (OuterVolumeSpecName: "cert") pod "e117ae0f-04d4-4c22-93ca-7a372bf29ee4" (UID: "e117ae0f-04d4-4c22-93ca-7a372bf29ee4"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 03:53:27.653969 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.653933 2551 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kubeflow-trainer-config\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:27.653969 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.653962 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhzm5\" (UniqueName: \"kubernetes.io/projected/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-kube-api-access-jhzm5\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:27.653969 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.653973 2551 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e117ae0f-04d4-4c22-93ca-7a372bf29ee4-cert\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:27.841082 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.841000 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d"] Aug 01 03:53:27.844843 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.844822 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:27.854319 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.854293 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d"] Aug 01 03:53:27.955969 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.955936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94fh\" (UniqueName: \"kubernetes.io/projected/760b7244-997c-46c4-b9d7-e06975d9e468-kube-api-access-p94fh\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:27.955969 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.955969 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/760b7244-997c-46c4-b9d7-e06975d9e468-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:27.956184 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:27.956071 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/760b7244-997c-46c4-b9d7-e06975d9e468-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.057321 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.057284 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/760b7244-997c-46c4-b9d7-e06975d9e468-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.057482 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.057438 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94fh\" (UniqueName: \"kubernetes.io/projected/760b7244-997c-46c4-b9d7-e06975d9e468-kube-api-access-p94fh\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.057482 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.057470 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/760b7244-997c-46c4-b9d7-e06975d9e468-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.058122 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.058102 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/760b7244-997c-46c4-b9d7-e06975d9e468-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.059849 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.059826 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/760b7244-997c-46c4-b9d7-e06975d9e468-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.065590 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.065558 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94fh\" (UniqueName: \"kubernetes.io/projected/760b7244-997c-46c4-b9d7-e06975d9e468-kube-api-access-p94fh\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-h724d\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.154780 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.154699 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:28.229617 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.229590 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-69855b4775-5jbcb" Aug 01 03:53:28.262399 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.262363 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d"] Aug 01 03:53:28.276304 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.276273 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw"] Aug 01 03:53:28.276718 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.276536 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" podUID="abbd8fca-76a7-4e25-bc54-11ece100c472" containerName="manager" containerID="cri-o://efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187" gracePeriod=10 Aug 01 03:53:28.281583 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.281544 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" Aug 01 03:53:28.281685 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.281574 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs" event={"ID":"e117ae0f-04d4-4c22-93ca-7a372bf29ee4","Type":"ContainerDied","Data":"97463edbf28390aad9d082dd3a3f96732a8512ddf4a289fe1808f08f8be2679c"} Aug 01 03:53:28.290828 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.290805 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d"] Aug 01 03:53:28.294704 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:53:28.294683 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod760b7244_997c_46c4_b9d7_e06975d9e468.slice/crio-5d9ff884b7852240624c3b0f3f03de8a32954eaf027c0e2c59ffad50d3eab803 WatchSource:0}: Error finding container 5d9ff884b7852240624c3b0f3f03de8a32954eaf027c0e2c59ffad50d3eab803: Status 404 returned error can't find the container with id 5d9ff884b7852240624c3b0f3f03de8a32954eaf027c0e2c59ffad50d3eab803 Aug 01 03:53:28.364763 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.364727 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs"] Aug 01 03:53:28.366619 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.366592 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-8tgvs"] Aug 01 03:53:28.415136 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.415064 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e117ae0f-04d4-4c22-93ca-7a372bf29ee4" path="/var/lib/kubelet/pods/e117ae0f-04d4-4c22-93ca-7a372bf29ee4/volumes" Aug 01 03:53:28.519912 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.519892 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:53:28.663155 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:28.663112 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:53:28.663323 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:28.663221 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-h724d_opendatahub(760b7244-997c-46c4-b9d7-e06975d9e468): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:53:28.663323 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:28.663257 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" podUID="760b7244-997c-46c4-b9d7-e06975d9e468" Aug 01 03:53:28.663323 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.663297 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dds7\" (UniqueName: \"kubernetes.io/projected/abbd8fca-76a7-4e25-bc54-11ece100c472-kube-api-access-6dds7\") pod \"abbd8fca-76a7-4e25-bc54-11ece100c472\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " Aug 01 03:53:28.663520 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.663378 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-manifests-work\") pod \"abbd8fca-76a7-4e25-bc54-11ece100c472\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " Aug 01 03:53:28.663520 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.663407 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-tmp\") pod \"abbd8fca-76a7-4e25-bc54-11ece100c472\" (UID: \"abbd8fca-76a7-4e25-bc54-11ece100c472\") " Aug 01 03:53:28.663725 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.663702 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-tmp" (OuterVolumeSpecName: "tmp") pod "abbd8fca-76a7-4e25-bc54-11ece100c472" (UID: "abbd8fca-76a7-4e25-bc54-11ece100c472"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:53:28.665255 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.665204 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-manifests-work" (OuterVolumeSpecName: "manifests-work") pod "abbd8fca-76a7-4e25-bc54-11ece100c472" (UID: "abbd8fca-76a7-4e25-bc54-11ece100c472"). InnerVolumeSpecName "manifests-work". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 03:53:28.665574 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.665552 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abbd8fca-76a7-4e25-bc54-11ece100c472-kube-api-access-6dds7" (OuterVolumeSpecName: "kube-api-access-6dds7") pod "abbd8fca-76a7-4e25-bc54-11ece100c472" (UID: "abbd8fca-76a7-4e25-bc54-11ece100c472"). InnerVolumeSpecName "kube-api-access-6dds7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:53:28.764392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.764356 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dds7\" (UniqueName: \"kubernetes.io/projected/abbd8fca-76a7-4e25-bc54-11ece100c472-kube-api-access-6dds7\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:28.764392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.764385 2551 reconciler_common.go:299] "Volume detached for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-manifests-work\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:28.764392 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:28.764394 2551 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8fca-76a7-4e25-bc54-11ece100c472-tmp\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:29.286790 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.286756 2551 generic.go:356] "Generic (PLEG): container finished" podID="abbd8fca-76a7-4e25-bc54-11ece100c472" containerID="efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187" exitCode=0 Aug 01 03:53:29.287265 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.286805 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" Aug 01 03:53:29.287265 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.286832 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" event={"ID":"abbd8fca-76a7-4e25-bc54-11ece100c472","Type":"ContainerDied","Data":"efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187"} Aug 01 03:53:29.287265 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.286916 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw" event={"ID":"abbd8fca-76a7-4e25-bc54-11ece100c472","Type":"ContainerDied","Data":"7d65008ef1f3026ce5277db83cec6b1116c9d0a7df48f96c28c5e741061a016d"} Aug 01 03:53:29.287265 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.286949 2551 scope.go:117] "RemoveContainer" containerID="efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187" Aug 01 03:53:29.288206 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.288106 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" event={"ID":"760b7244-997c-46c4-b9d7-e06975d9e468","Type":"ContainerStarted","Data":"5d9ff884b7852240624c3b0f3f03de8a32954eaf027c0e2c59ffad50d3eab803"} Aug 01 03:53:29.296213 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.296197 2551 scope.go:117] "RemoveContainer" containerID="efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187" Aug 01 03:53:29.296483 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:29.296464 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187\": container with ID starting with efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187 not found: ID does not exist" containerID="efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187" Aug 01 03:53:29.296573 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.296487 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187"} err="failed to get container status \"efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187\": rpc error: code = NotFound desc = could not find container \"efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187\": container with ID starting with efb398f1c34a9bde6805fec7acd3cca0e57dd98a4aaa5e303d7d8792d2df2187 not found: ID does not exist" Aug 01 03:53:29.317505 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.317473 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw"] Aug 01 03:53:29.320469 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.320447 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-8vzxw"] Aug 01 03:53:29.423058 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.423034 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:29.570086 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.570013 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/760b7244-997c-46c4-b9d7-e06975d9e468-cert\") pod \"760b7244-997c-46c4-b9d7-e06975d9e468\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " Aug 01 03:53:29.570086 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.570067 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p94fh\" (UniqueName: \"kubernetes.io/projected/760b7244-997c-46c4-b9d7-e06975d9e468-kube-api-access-p94fh\") pod \"760b7244-997c-46c4-b9d7-e06975d9e468\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " Aug 01 03:53:29.570312 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.570088 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/760b7244-997c-46c4-b9d7-e06975d9e468-kubeflow-trainer-config\") pod \"760b7244-997c-46c4-b9d7-e06975d9e468\" (UID: \"760b7244-997c-46c4-b9d7-e06975d9e468\") " Aug 01 03:53:29.570501 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.570464 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/760b7244-997c-46c4-b9d7-e06975d9e468-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "760b7244-997c-46c4-b9d7-e06975d9e468" (UID: "760b7244-997c-46c4-b9d7-e06975d9e468"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 03:53:29.572110 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.572081 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/760b7244-997c-46c4-b9d7-e06975d9e468-cert" (OuterVolumeSpecName: "cert") pod "760b7244-997c-46c4-b9d7-e06975d9e468" (UID: "760b7244-997c-46c4-b9d7-e06975d9e468"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 03:53:29.572223 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.572153 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/760b7244-997c-46c4-b9d7-e06975d9e468-kube-api-access-p94fh" (OuterVolumeSpecName: "kube-api-access-p94fh") pod "760b7244-997c-46c4-b9d7-e06975d9e468" (UID: "760b7244-997c-46c4-b9d7-e06975d9e468"). InnerVolumeSpecName "kube-api-access-p94fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 03:53:29.670789 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.670759 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p94fh\" (UniqueName: \"kubernetes.io/projected/760b7244-997c-46c4-b9d7-e06975d9e468-kube-api-access-p94fh\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:29.670789 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.670783 2551 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/760b7244-997c-46c4-b9d7-e06975d9e468-kubeflow-trainer-config\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:29.670789 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.670793 2551 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/760b7244-997c-46c4-b9d7-e06975d9e468-cert\") on node \"ip-10-0-143-175.ec2.internal\" DevicePath \"\"" Aug 01 03:53:29.691827 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.691798 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs"] Aug 01 03:53:29.692122 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.692110 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abbd8fca-76a7-4e25-bc54-11ece100c472" containerName="manager" Aug 01 03:53:29.692173 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.692124 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="abbd8fca-76a7-4e25-bc54-11ece100c472" containerName="manager" Aug 01 03:53:29.692203 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.692174 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="abbd8fca-76a7-4e25-bc54-11ece100c472" containerName="manager" Aug 01 03:53:29.695079 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.695064 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.703008 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.702988 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs"] Aug 01 03:53:29.872508 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.872424 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/8f8bfb16-42fb-4ab2-b2eb-e56909686980-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.872508 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.872460 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8bfb16-42fb-4ab2-b2eb-e56909686980-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.872508 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.872488 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmsx\" (UniqueName: \"kubernetes.io/projected/8f8bfb16-42fb-4ab2-b2eb-e56909686980-kube-api-access-xmmsx\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.972907 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.972853 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/8f8bfb16-42fb-4ab2-b2eb-e56909686980-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.973080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.972913 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8bfb16-42fb-4ab2-b2eb-e56909686980-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.973080 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.972933 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmsx\" (UniqueName: \"kubernetes.io/projected/8f8bfb16-42fb-4ab2-b2eb-e56909686980-kube-api-access-xmmsx\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.973539 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.973518 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/8f8bfb16-42fb-4ab2-b2eb-e56909686980-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.975335 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.975305 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f8bfb16-42fb-4ab2-b2eb-e56909686980-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:29.981649 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:29.981628 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmsx\" (UniqueName: \"kubernetes.io/projected/8f8bfb16-42fb-4ab2-b2eb-e56909686980-kube-api-access-xmmsx\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-m65gs\" (UID: \"8f8bfb16-42fb-4ab2-b2eb-e56909686980\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:30.004566 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.004538 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" Aug 01 03:53:30.139991 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.139965 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs"] Aug 01 03:53:30.142141 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:53:30.142111 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f8bfb16_42fb_4ab2_b2eb_e56909686980.slice/crio-1d026dbc5b6a46c161640ab61d278d1e96324fd8d322bc7bf78b039352f83ed0 WatchSource:0}: Error finding container 1d026dbc5b6a46c161640ab61d278d1e96324fd8d322bc7bf78b039352f83ed0: Status 404 returned error can't find the container with id 1d026dbc5b6a46c161640ab61d278d1e96324fd8d322bc7bf78b039352f83ed0 Aug 01 03:53:30.294646 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.294608 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" Aug 01 03:53:30.294646 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.294620 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d" event={"ID":"760b7244-997c-46c4-b9d7-e06975d9e468","Type":"ContainerDied","Data":"5d9ff884b7852240624c3b0f3f03de8a32954eaf027c0e2c59ffad50d3eab803"} Aug 01 03:53:30.295731 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.295697 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" event={"ID":"8f8bfb16-42fb-4ab2-b2eb-e56909686980","Type":"ContainerStarted","Data":"1d026dbc5b6a46c161640ab61d278d1e96324fd8d322bc7bf78b039352f83ed0"} Aug 01 03:53:30.332344 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.332309 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d"] Aug 01 03:53:30.339789 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.339758 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-h724d"] Aug 01 03:53:30.415444 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.415374 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="760b7244-997c-46c4-b9d7-e06975d9e468" path="/var/lib/kubelet/pods/760b7244-997c-46c4-b9d7-e06975d9e468/volumes" Aug 01 03:53:30.415740 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:53:30.415724 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abbd8fca-76a7-4e25-bc54-11ece100c472" path="/var/lib/kubelet/pods/abbd8fca-76a7-4e25-bc54-11ece100c472/volumes" Aug 01 03:53:30.505981 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:30.505944 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:53:30.506192 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:30.506039 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-m65gs_opendatahub(8f8bfb16-42fb-4ab2-b2eb-e56909686980): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:53:30.506192 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:30.506071 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:53:31.301141 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:31.301111 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:53:44.737229 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:44.737189 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:53:44.737623 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:44.737339 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-m65gs_opendatahub(8f8bfb16-42fb-4ab2-b2eb-e56909686980): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:53:44.737623 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:44.737374 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:53:59.409840 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:53:59.409811 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:54:10.722836 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:10.722794 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:54:10.723258 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:10.722908 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-m65gs_opendatahub(8f8bfb16-42fb-4ab2-b2eb-e56909686980): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:54:10.723258 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:10.722938 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:54:25.409970 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:25.409938 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:54:38.414809 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:38.410302 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:54:51.703552 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:51.703511 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:54:51.704062 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:51.703612 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-m65gs_opendatahub(8f8bfb16-42fb-4ab2-b2eb-e56909686980): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:54:51.704062 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:54:51.703642 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:55:04.409742 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:55:04.409706 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:55:18.410339 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:55:18.410245 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:55:31.410564 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:55:31.410532 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:55:45.409919 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:55:45.409888 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:55:58.409936 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:55:58.409901 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:56:13.705911 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:56:13.705874 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:56:13.706261 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:56:13.705982 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-m65gs_opendatahub(8f8bfb16-42fb-4ab2-b2eb-e56909686980): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:56:13.706261 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:56:13.706025 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:56:22.307958 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:56:22.307923 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:56:22.308398 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:56:22.308190 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:56:22.314651 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:56:22.314629 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:56:22.314967 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:56:22.314946 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:56:28.410480 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:56:28.410383 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:56:40.410311 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:56:40.410281 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:56:55.410674 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:56:55.410607 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:57:07.411566 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:57:07.409476 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 03:57:07.411566 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:57:07.409648 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:57:20.410159 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:57:20.410110 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:57:31.410464 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:57:31.410380 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:57:45.410012 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:57:45.409972 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:58:00.409694 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:58:00.409646 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:58:12.412165 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:58:12.412095 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:58:25.410295 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:58:25.410261 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:58:28.487367 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:58:28.487327 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/trainer-operator-system_trainer-operator-controller-manager-69855b4775-5jbcb_ea9bae57-9c4b-4cc2-aeb2-901a334629d7/manager/0.log" Aug 01 03:58:36.410315 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:58:36.410287 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:58:46.024810 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:58:46.024777 2551 ???:1] "http: TLS handshake error from 10.0.137.81:45622: EOF" Aug 01 03:58:50.414732 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:58:50.414688 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:59:04.735460 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:59:04.735419 2551 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 03:59:04.735899 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:59:04.735533 2551 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-m65gs_opendatahub(8f8bfb16-42fb-4ab2-b2eb-e56909686980): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 03:59:04.735899 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:59:04.735579 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:59:15.410610 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:59:15.410549 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:59:23.334033 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.334001 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ssgs6/must-gather-xwllv"] Aug 01 03:59:23.337181 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.337161 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.339491 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.339467 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ssgs6\"/\"kube-root-ca.crt\"" Aug 01 03:59:23.339607 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.339469 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ssgs6\"/\"default-dockercfg-v9rss\"" Aug 01 03:59:23.339841 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.339825 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ssgs6\"/\"openshift-service-ca.crt\"" Aug 01 03:59:23.344526 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.344505 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ssgs6/must-gather-xwllv"] Aug 01 03:59:23.418011 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.417979 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0485481d-6a56-44e2-a6e5-8b0058edf7e8-must-gather-output\") pod \"must-gather-xwllv\" (UID: \"0485481d-6a56-44e2-a6e5-8b0058edf7e8\") " pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.418011 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.418012 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7x6\" (UniqueName: \"kubernetes.io/projected/0485481d-6a56-44e2-a6e5-8b0058edf7e8-kube-api-access-gw7x6\") pod \"must-gather-xwllv\" (UID: \"0485481d-6a56-44e2-a6e5-8b0058edf7e8\") " pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.518706 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.518665 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0485481d-6a56-44e2-a6e5-8b0058edf7e8-must-gather-output\") pod \"must-gather-xwllv\" (UID: \"0485481d-6a56-44e2-a6e5-8b0058edf7e8\") " pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.518706 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.518711 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7x6\" (UniqueName: \"kubernetes.io/projected/0485481d-6a56-44e2-a6e5-8b0058edf7e8-kube-api-access-gw7x6\") pod \"must-gather-xwllv\" (UID: \"0485481d-6a56-44e2-a6e5-8b0058edf7e8\") " pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.518987 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.518970 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0485481d-6a56-44e2-a6e5-8b0058edf7e8-must-gather-output\") pod \"must-gather-xwllv\" (UID: \"0485481d-6a56-44e2-a6e5-8b0058edf7e8\") " pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.526205 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.526183 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7x6\" (UniqueName: \"kubernetes.io/projected/0485481d-6a56-44e2-a6e5-8b0058edf7e8-kube-api-access-gw7x6\") pod \"must-gather-xwllv\" (UID: \"0485481d-6a56-44e2-a6e5-8b0058edf7e8\") " pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.647197 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.647112 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssgs6/must-gather-xwllv" Aug 01 03:59:23.774605 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.774581 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ssgs6/must-gather-xwllv"] Aug 01 03:59:23.776628 ip-10-0-143-175 kubenswrapper[2551]: W0801 03:59:23.776601 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0485481d_6a56_44e2_a6e5_8b0058edf7e8.slice/crio-c88bee1d345344f6567f621046455a4033bb7993b6410e8a37f9217f5fecc02c WatchSource:0}: Error finding container c88bee1d345344f6567f621046455a4033bb7993b6410e8a37f9217f5fecc02c: Status 404 returned error can't find the container with id c88bee1d345344f6567f621046455a4033bb7993b6410e8a37f9217f5fecc02c Aug 01 03:59:23.799592 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:23.799563 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssgs6/must-gather-xwllv" event={"ID":"0485481d-6a56-44e2-a6e5-8b0058edf7e8","Type":"ContainerStarted","Data":"c88bee1d345344f6567f621046455a4033bb7993b6410e8a37f9217f5fecc02c"} Aug 01 03:59:24.806687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:24.806604 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssgs6/must-gather-xwllv" event={"ID":"0485481d-6a56-44e2-a6e5-8b0058edf7e8","Type":"ContainerStarted","Data":"aa10035985e78525ca4f715ea4d878ef87100987d5d09f4a970aef5435086a08"} Aug 01 03:59:24.806687 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:24.806652 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssgs6/must-gather-xwllv" event={"ID":"0485481d-6a56-44e2-a6e5-8b0058edf7e8","Type":"ContainerStarted","Data":"4bd601ba263acaaf4fcd40ad82a5c99c0aed661ed696df6ae794e6e8881758a9"} Aug 01 03:59:24.822721 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:24.822660 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ssgs6/must-gather-xwllv" podStartSLOduration=1.073462938 podStartE2EDuration="1.822640109s" totalImagesPullingTime="749.177171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 03:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:59:24.820946249 +0000 UTC m=+782.957641142" watchObservedRunningTime="2026-08-01 03:59:24.822640109 +0000 UTC m=+782.959335002" Aug 01 03:59:25.822968 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:25.822905 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4dzmp_bf767701-eecb-43af-9d53-914dd86cd5a7/global-pull-secret-syncer/0.log" Aug 01 03:59:25.998826 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:25.998791 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zxh2s_8d17ed91-9c86-4cd8-b1a9-4aad65a68dbc/konnectivity-agent/0.log" Aug 01 03:59:26.069667 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:26.069641 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-175.ec2.internal_7af8bc9cf8fd0a7a7e70bdaef42f76a1/haproxy/0.log" Aug 01 03:59:30.244772 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:30.244717 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-wt4cr_db5cce20-153a-4b78-a13c-d2ccec37733b/cluster-monitoring-operator/0.log" Aug 01 03:59:30.414206 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:59:30.414164 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:59:30.556841 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:30.556767 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqvk9_687952f9-195a-4c64-b544-9b4a268ffd03/node-exporter/0.log" Aug 01 03:59:30.581531 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:30.581496 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqvk9_687952f9-195a-4c64-b544-9b4a268ffd03/kube-rbac-proxy/0.log" Aug 01 03:59:30.606996 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:30.606962 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqvk9_687952f9-195a-4c64-b544-9b4a268ffd03/init-textfile/0.log" Aug 01 03:59:32.355742 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:32.355712 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-2nl8g_894acdc9-8f1e-4dbf-a8e3-9a186d36b112/networking-console-plugin/0.log" Aug 01 03:59:32.772269 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:32.772235 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/1.log" Aug 01 03:59:32.778761 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:32.778734 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-gc6tf_aa83b609-4013-49b9-8e15-96baea198202/console-operator/2.log" Aug 01 03:59:33.108910 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.108807 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx"] Aug 01 03:59:33.114560 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.114534 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.122793 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.122555 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx"] Aug 01 03:59:33.302696 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.302657 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-proc\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.302696 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.302703 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-lib-modules\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.302975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.302748 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-sys\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.302975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.302824 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-podres\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.302975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.302917 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pv62\" (UniqueName: \"kubernetes.io/projected/cfbf0738-adad-47c1-ba90-016e4b90df5a-kube-api-access-5pv62\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404000 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.403910 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pv62\" (UniqueName: \"kubernetes.io/projected/cfbf0738-adad-47c1-ba90-016e4b90df5a-kube-api-access-5pv62\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404000 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.403956 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-proc\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404000 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.403985 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-lib-modules\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404540 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.404030 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-sys\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404540 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.404055 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-proc\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404540 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.404069 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-podres\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404540 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.404120 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-sys\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404540 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.404205 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-lib-modules\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.404540 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.404210 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfbf0738-adad-47c1-ba90-016e4b90df5a-podres\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.412885 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.412844 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pv62\" (UniqueName: \"kubernetes.io/projected/cfbf0738-adad-47c1-ba90-016e4b90df5a-kube-api-access-5pv62\") pod \"perf-node-gather-daemonset-svpxx\" (UID: \"cfbf0738-adad-47c1-ba90-016e4b90df5a\") " pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.428747 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.428719 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.587335 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.586816 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx"] Aug 01 03:59:33.726608 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.726577 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-wb5bh_2beeb1cd-95df-4440-b939-1b9ab91fe9db/volume-data-source-validator/0.log" Aug 01 03:59:33.861461 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.861428 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" event={"ID":"cfbf0738-adad-47c1-ba90-016e4b90df5a","Type":"ContainerStarted","Data":"e8795a4e36013d00699169f6a8caf8fe231a3e8661204c4829f55f1ce6d9f019"} Aug 01 03:59:33.861620 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.861485 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" event={"ID":"cfbf0738-adad-47c1-ba90-016e4b90df5a","Type":"ContainerStarted","Data":"ff1e149156caca3312a02b092497a0e1f255e951169bc30e9350d25249132c21"} Aug 01 03:59:33.861620 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.861515 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:33.878449 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:33.878397 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" podStartSLOduration=0.878373955 podStartE2EDuration="878.373955ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 03:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 03:59:33.876361105 +0000 UTC m=+792.013055998" watchObservedRunningTime="2026-08-01 03:59:33.878373955 +0000 UTC m=+792.015068849" Aug 01 03:59:34.603476 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:34.603446 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vbpgv_aa565f1b-1f89-46a2-b11a-34f9d02cbc43/dns/0.log" Aug 01 03:59:34.623330 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:34.623309 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vbpgv_aa565f1b-1f89-46a2-b11a-34f9d02cbc43/kube-rbac-proxy/0.log" Aug 01 03:59:34.689710 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:34.689683 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wxxsx_cbb9551d-b961-4e27-b5d8-a91579f5515d/dns-node-resolver/0.log" Aug 01 03:59:35.070410 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:35.070383 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5697cd44b7-pdgb4_cebacf9f-f776-4f92-ba7a-65d82845558f/registry/0.log" Aug 01 03:59:35.089360 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:35.089332 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8j2vw_4269d1c8-5d35-4410-b7b2-ba3ee5fac652/node-ca/0.log" Aug 01 03:59:35.811156 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:35.811128 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8667677bb4-4p75c_9fdb4e9d-da57-424b-bb79-d64a3433cdae/router/0.log" Aug 01 03:59:36.185883 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:36.185793 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sxb52_a67a604a-ccf6-4870-aa1c-69bc9342ccb2/serve-healthcheck-canary/0.log" Aug 01 03:59:36.521234 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:36.521187 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-42n7j_fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68/insights-operator/1.log" Aug 01 03:59:36.521426 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:36.521251 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-42n7j_fe6799ce-b06d-42ae-8f46-9bf6e2dc6b68/insights-operator/0.log" Aug 01 03:59:36.675845 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:36.675810 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl7tv_294622a3-9f6f-4e56-a6fb-1d815192cae6/kube-rbac-proxy/0.log" Aug 01 03:59:36.695929 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:36.695903 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl7tv_294622a3-9f6f-4e56-a6fb-1d815192cae6/exporter/0.log" Aug 01 03:59:36.716536 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:36.716513 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl7tv_294622a3-9f6f-4e56-a6fb-1d815192cae6/extractor/0.log" Aug 01 03:59:39.880181 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:39.880153 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ssgs6/perf-node-gather-daemonset-svpxx" Aug 01 03:59:41.422623 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:41.422598 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-7hzc9_d7ba6b03-ad93-4959-bdad-e0b550207e27/migrator/0.log" Aug 01 03:59:41.448362 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:41.448334 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-7hzc9_d7ba6b03-ad93-4959-bdad-e0b550207e27/graceful-termination/0.log" Aug 01 03:59:41.793360 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:41.793315 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-9mm6d_7ad4ff14-ea4e-4145-b166-5e806cd41fb6/kube-storage-version-migrator-operator/1.log" Aug 01 03:59:41.794162 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:41.794134 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-9mm6d_7ad4ff14-ea4e-4145-b166-5e806cd41fb6/kube-storage-version-migrator-operator/0.log" Aug 01 03:59:43.147772 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.147747 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/kube-multus-additional-cni-plugins/0.log" Aug 01 03:59:43.168782 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.168752 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/egress-router-binary-copy/0.log" Aug 01 03:59:43.189621 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.189599 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/cni-plugins/0.log" Aug 01 03:59:43.209997 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.209976 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/bond-cni-plugin/0.log" Aug 01 03:59:43.231131 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.231114 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/routeoverride-cni/0.log" Aug 01 03:59:43.252377 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.252355 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/whereabouts-cni-bincopy/0.log" Aug 01 03:59:43.272756 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.272740 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-st7xq_acf6d1fa-9c69-4c0e-b093-8004856b35ec/whereabouts-cni/0.log" Aug 01 03:59:43.303256 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.303231 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ft6ws_2e606418-4d64-4a3f-b0d9-9ca33852fffd/kube-multus/0.log" Aug 01 03:59:43.405441 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.405371 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drdqf_9b077824-7dc9-4c9d-90f7-fa316a428ed8/network-metrics-daemon/0.log" Aug 01 03:59:43.426597 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:43.426571 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drdqf_9b077824-7dc9-4c9d-90f7-fa316a428ed8/kube-rbac-proxy/0.log" Aug 01 03:59:44.410759 ip-10-0-143-175 kubenswrapper[2551]: E0801 03:59:44.410720 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-m65gs" podUID="8f8bfb16-42fb-4ab2-b2eb-e56909686980" Aug 01 03:59:44.647888 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.647814 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-controller/0.log" Aug 01 03:59:44.666262 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.666237 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/0.log" Aug 01 03:59:44.666503 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.666486 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovn-acl-logging/1.log" Aug 01 03:59:44.684070 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.684051 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/kube-rbac-proxy-node/0.log" Aug 01 03:59:44.703945 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.703921 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/kube-rbac-proxy-ovn-metrics/0.log" Aug 01 03:59:44.727166 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.727144 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/northd/0.log" Aug 01 03:59:44.748681 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.748632 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/nbdb/0.log" Aug 01 03:59:44.770057 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.770037 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/sbdb/0.log" Aug 01 03:59:44.810808 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:44.810780 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjdln_d403f0a7-92b9-4a38-9228-c1d62c700a7c/ovnkube-controller/0.log" Aug 01 03:59:45.764065 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:45.764035 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-65bdbbff45-lbbp7_899240e5-73dd-4598-a795-da0780772b80/check-endpoints/0.log" Aug 01 03:59:45.848302 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:45.848272 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qgv49_b815631a-7938-46e6-b36b-26afc52fd391/network-check-target-container/0.log" Aug 01 03:59:46.710975 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:46.710948 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nrsnc_d2a8f9e4-bfac-4310-b820-994597255ab2/iptables-alerter/0.log" Aug 01 03:59:47.349341 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:47.349313 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lzb5r_345ef099-5968-4f54-bad1-1861c9ca47da/tuned/0.log" Aug 01 03:59:49.021409 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:49.021375 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-559cbf5745-jmbpt_f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb/cluster-samples-operator/0.log" Aug 01 03:59:49.037626 ip-10-0-143-175 kubenswrapper[2551]: I0801 03:59:49.037602 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-559cbf5745-jmbpt_f1b8cdf2-2133-4227-a7a1-54c3a7df8bcb/cluster-samples-operator-watch/0.log"